00000100:00100000:0.0:1746143817.484648:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.488869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.494108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.495405:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.496052:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.497400:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143817.497860:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73b038a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.497866:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73b038a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746143817.497909:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:0.0:1746143817.497945:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143817.497963:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73b038a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.497973:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73b038a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.497984:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.497990:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.497995:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498001:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498006:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143817.498010:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498029:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498038:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143817.498040:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143817.498044:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498049:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b037c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498072:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498077:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498082:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498085:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143817.498087:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498092:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498099:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5bd5100) 00010000:00010000:0.0:1746143817.498101:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143817.498103:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498107:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b0383 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143817.498143:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b0375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef5c expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.498153:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3000/0x87925e4cb73b038a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef5c expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.498160:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143817.498162:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143817.498165:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3000, rc 0) 00000100:00100000:0.0:1746143817.498200:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:1732:x1830963624224128:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3910us (4104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.498206:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13537 00000100:00100000:0.0:1746143817.500277:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.500977:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.501042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.501381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.502409:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.513673:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.516144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.519560:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.523734:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624226432 00000100:00100000:0.0:1746143817.523743:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624226432 00000100:00100000:0.0:1746143817.524029:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13540 00000100:00100000:0.0:1746143817.524037:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:1732:x1830963624226432:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143817.524061:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.524079:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b03d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ef8d expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.524146:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b03d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef8d expref: 16 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.524157:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b03d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef8d expref: 16 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.524174:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143817.524177:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143817.524180:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084200, rc 0) 00000100:00100000:0.0:1746143817.524828:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+16:1732:x1830963624226432:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 790us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.524835:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13540 00000100:00100000:0.0:1746143817.527471:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624226688 00000100:00100000:0.0:1746143817.527481:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624226688 00000100:00100000:0.0:1746143817.527538:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5112 00000100:00100000:0.0:1746143817.527546:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+33:1729:x1830963624226688:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143817.527755:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+34:1729:x1830963624226688:12345-192.168.202.3@tcp:35:cat.0 Request processed in 209us (590us total) trans 8589944436 rc 0/0 00000100:00100000:0.0:1746143817.527761:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5112 00000100:00100000:0.0:1746143817.527784:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14795 00000100:00100000:0.0:1746143817.527790:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624226944:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143817.527810:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b03e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.527822:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.527840:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.527846:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b0360 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef47 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.527851:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.527853:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.527855:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b03e5 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.527872:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b0360 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef47 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.527880:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b0360 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef47 expref: 11 pid: 1945 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.527890:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627185920:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143817.527947:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.527955:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 11 pid: 13430 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.527963:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627186176:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143817.527993:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.528000:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 25 pid: 9839 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.528008:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627186304:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143817.528021:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4f2fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143817.538545:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.538587:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624227840 00000100:00100000:0.0:1746143817.538594:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624227840 00010000:00010000:0.0:1746143817.538630:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 13 pid: 13430 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.538661:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7011 00000100:00100000:0.0:1746143817.538669:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963624227840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.538683:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.538705:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 13 pid: 13430 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.538715:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 13 pid: 13430 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.538737:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b0398 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef6a expref: 13 pid: 13430 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.538777:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.538819:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963624227840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 151us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.538825:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7011 00000100:00100000:0.0:1746143817.538859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.538979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.538990:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624228224 00000100:00100000:0.0:1746143817.538993:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624228224 00010000:00010000:0.0:1746143817.539004:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 26 pid: 9839 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.539019:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7012 00000100:00100000:0.0:1746143817.539023:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624228224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.539029:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.539035:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 26 pid: 9839 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.539043:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 26 pid: 9839 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.539054:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b02f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef1d expref: 26 pid: 9839 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.539063:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.539080:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624228224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.539090:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7012 00000100:00100000:0.0:1746143817.540271:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.540301:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.540332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.540346:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624228608 00000100:00100000:0.0:1746143817.540350:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624228608 00010000:00010000:0.0:1746143817.540371:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b021e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee9f expref: 12 pid: 12328 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.540387:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624228992 00000100:00100000:0.0:1746143817.540389:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624228992 00010000:00010000:0.0:1746143817.540398:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091380000/0x87925e4cb73b01c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee75 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.540408:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624228736 00000100:00100000:0.0:1746143817.540410:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624228736 00010000:00010000:0.0:1746143817.540417:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b0225 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840eea6 expref: 12 pid: 3135 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.540442:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7013 00000100:00100000:0.0:1746143817.540448:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624228608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.540457:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.540469:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b021e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee9f expref: 12 pid: 12328 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.540477:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b021e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee9f expref: 12 pid: 12328 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.540501:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b021e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee9f expref: 12 pid: 12328 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.540512:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.540534:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624228608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.540539:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7013 00000100:00100000:0.0:1746143817.540564:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7014 00000100:00100000:0.0:1746143817.540569:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963624228992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.540575:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.540581:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091380000/0x87925e4cb73b01c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee75 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.540589:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091380000/0x87925e4cb73b01c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee75 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.541519:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380000/0x87925e4cb73b01c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee75 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.541532:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.544017:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624228096 00000100:00100000:0.0:1746143817.544027:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624228096 00010000:00010000:0.0:1746143817.544054:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e1d5200/0x87925e4cb73b039f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef71 expref: 11 pid: 9839 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.544074:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7017 00000100:00100000:0.0:1746143817.544089:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624228096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.544097:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.544111:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e1d5200/0x87925e4cb73b039f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef71 expref: 11 pid: 9839 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.544119:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e1d5200/0x87925e4cb73b039f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef71 expref: 11 pid: 9839 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.544133:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e1d5200/0x87925e4cb73b039f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef71 expref: 11 pid: 9839 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.544144:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.544174:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624228096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.544178:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7017 00010000:00010000:0.0:1746143817.545615:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545622:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545633:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545638:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545662:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545667:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143817.545669:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545674:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545681:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.545685:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7c200/0x87925e4cb73b03fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143817.545722:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624227328:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 16695us (17516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.545727:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14798 00000100:00100000:0.0:1746143817.546392:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624229120 00000100:00100000:0.0:1746143817.546396:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624229120 00010000:00010000:0.0:1746143817.546408:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76400/0x87925e4cb73b01a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee60 expref: 12 pid: 1945 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.546422:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7019 00000100:00100000:0.0:1746143817.546426:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624227584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.546439:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.546450:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b0391 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef63 expref: 10 pid: 9839 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.546458:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b0391 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef63 expref: 10 pid: 9839 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.546471:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b0391 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef63 expref: 10 pid: 9839 timeout: 976 lvb_type: 1 00010000:00010000:0.0:1746143817.546903:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.546933:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624227584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 506us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.546938:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7019 00000100:00100000:0.0:1746143817.547445:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624229376 00000100:00100000:0.0:1746143817.547450:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624229376 00010000:00010000:0.0:1746143817.547465:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b0199 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee59 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.547493:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7024 00000100:00100000:0.0:1746143817.547497:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624229376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143817.547504:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143817.547511:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b0199 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee59 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.547519:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b0199 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee59 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.547543:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b0199 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ee59 expref: 25 pid: 1945 timeout: 976 lvb_type: 0 00010000:00010000:0.0:1746143817.547560:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.547561:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.547564:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b0401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.547570:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b0401 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.547923:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143817.547960:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624229376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 462us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.547966:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7024 00000100:00100000:0.0:1746143817.549120:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.551225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.553777:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.553810:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.554098:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.554175:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.557768:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627188480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.557823:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627188224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.557870:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.557895:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627188736:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746143817.557946:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143817.557955:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.557974:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627189248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.557988:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.558000:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627189760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.558012:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.558031:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627189760 00000100:00100000:0.0:1746143817.558033:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627189760 00000100:00100000:0.0:1746143817.558377:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14802 00000100:00100000:0.0:1746143817.558382:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627188608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.558452:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963627188608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (562us total) trans 17179873618 rc 0/0 00000100:00100000:0.0:1746143817.558458:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14802 00000100:00100000:0.0:1746143817.558471:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14804 00000100:00100000:0.0:1746143817.558475:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3772:x1830963627189120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.558526:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963627189120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (595us total) trans 21474840909 rc 0/0 00000100:00100000:0.0:1746143817.558532:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14804 00000100:00100000:0.0:1746143817.558540:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627189632 00000100:00100000:0.0:1746143817.558543:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627189632 00000100:00100000:0.0:1746143817.558806:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14807 00000100:00100000:0.0:1746143817.558811:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963627189760:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143817.558858:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143817.558861:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.558863:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143817.558865:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.558872:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143817.558887:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3773:x1830963627189760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (874us total) trans 21474840910 rc 0/0 00000100:00100000:0.0:1746143817.558892:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14807 00000100:00100000:0.0:1746143817.558899:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627188480 00000100:00100000:0.0:1746143817.558902:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627188480 00000100:00100000:0.0:1746143817.558934:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14809 00000100:00100000:0.0:1746143817.558938:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627188480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.558989:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963627188480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (103us total) trans 21474840912 rc 0/0 00000100:00100000:0.0:1746143817.558994:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14809 00000100:00100000:0.0:1746143817.559001:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627188992 00000100:00100000:0.0:1746143817.559004:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627188992 00000100:00100000:0.0:1746143817.559011:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627189504 00000100:00100000:0.0:1746143817.559013:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627189504 00000100:00100000:0.0:1746143817.559020:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14810 00000100:00100000:0.0:1746143817.559024:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963627188992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.559078:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963627188992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (145us total) trans 17179873621 rc 0/0 00000100:00100000:0.0:1746143817.559082:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14810 00000100:00080000:0.0:1746143817.559105:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746143817.559396:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b09f80/2, rc 0, transno 21474840908 00000100:00100000:0.0:1746143817.559399:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627188224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143817.559410:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719ed80/2, rc 0, transno 17179873619 00000100:00100000:0.0:1746143817.559413:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627188736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143817.559422:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0ad80/2, rc 0, transno 21474840910 00000100:00100000:0.0:1746143817.559425:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627189760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.559444:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627190016 00000100:00100000:0.0:1746143817.559446:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627190016 00000100:00100000:0.0:1746143817.559463:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14813 00000100:00100000:0.0:1746143817.559467:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963627190016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.559544:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3771:x1830963627190016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (128us total) trans 21474840913 rc 0/0 00000100:00100000:0.0:1746143817.559550:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14813 00000100:00100000:0.0:1746143817.559571:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14814 00000100:00100000:0.0:1746143817.559575:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3774:x1830963627189376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143817.559617:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143817.559619:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.559620:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143817.559622:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.559623:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143817.559651:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627189376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (122us total) trans 21474840914 rc 0/0 00000100:00100000:0.0:1746143817.559656:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14814 00000004:00080000:0.0:1746143817.559821:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719e680/2, rc 0, transno 17179873624 00000100:00100000:0.0:1746143817.559825:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627189248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.561451:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.564154:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.566852:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.567643:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.567658:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.567673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.567685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.567737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.568025:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14820 00000100:00100000:0.0:1746143817.568031:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624230656:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143817.568037:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.568044:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1e00/0x87925e4cb73b0439 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840efa2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143817.568055:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a49, atime: 0x68140a49, ctime: 0x68140a49, blocks: 0x748 00010000:00010000:0.0:1746143817.568063:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.568064:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.568068:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1e00/0x87925e4cb73b0439 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efa2 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.568076:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1e00/0x87925e4cb73b0439 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efa2 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.568082:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1e00, rc 0) 00000100:00100000:0.0:1746143817.568437:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624230656:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 405us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.568442:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14820 00000100:00100000:0.0:1746143817.593148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.600217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.611170:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.612649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.614127:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.614608:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13547 00000100:00100000:0.0:1746143817.614616:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:1735:x1830963624232320:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143817.614694:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.614696:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143817.614714:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091381000/0x87925e4cb73b0471 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efd3 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.614742:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143817.614746:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143817.614753:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b048d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840efe1 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.614776:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143817.614787:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73b041d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef9b expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.614794:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b040f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef94 expref: 7 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.614800:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143817.615064:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b040f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef94 expref: 7 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.615076:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b040f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef94 expref: 7 pid: 7243 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.615184:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627190400:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143817.615758:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73b041d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef9b expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.615766:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7dc00/0x87925e4cb73b041d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ef9b expref: 7 pid: 14991 timeout: 976 lvb_type: 0 00000100:00100000:0.0:1746143817.615775:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627190528:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143817.616323:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143817.617017:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.618355:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624232576 00000100:00100000:0.0:1746143817.618359:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624232576 00000100:00100000:0.0:1746143817.618389:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13548 00000100:00100000:0.0:1746143817.618394:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:1738:x1830963624232576:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143817.618411:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.618421:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b04a9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840efe8 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.618485:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.618493:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143817.618497:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.618510:0:14991:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143817.618517:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143817.619488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143817.620536:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143817.620543:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00000040:00080000:0.0:1746143817.620730:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3020, 88 off253592 00000004:00080000:0.0:1746143817.620734:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876844821543ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.620755:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3040, 88 off255008 00000004:00080000:0.0:1746143817.620758:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876844845458ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620769:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3041, 88 off255096 00000004:00080000:0.0:1746143817.620772:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876844859711ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620780:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3021, 88 off253680 00000004:00080000:0.0:1746143817.620783:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876844870451ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.620795:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3022, 88 off253768 00000004:00080000:0.0:1746143817.620797:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876844885285ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.620805:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3042, 88 off255184 00000004:00080000:0.0:1746143817.620807:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876844895240ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620814:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3043, 88 off255272 00000004:00080000:0.0:1746143817.620816:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876844904123ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620823:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3044, 88 off255360 00000004:00080000:0.0:1746143817.620826:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876844913478ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620835:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3023, 88 off253856 00000004:00080000:0.0:1746143817.620838:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876844926100ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.620848:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3045, 88 off255448 00000004:00080000:0.0:1746143817.620851:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876844938523ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620946:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3025, 88 off254040 00000004:00080000:0.0:1746143817.620950:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876845038230ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.620979:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3046, 88 off255536 00000004:00080000:0.0:1746143817.620982:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876845069968ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143817.620991:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3026, 88 off254128 00000004:00080000:0.0:1746143817.620994:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876845081651ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.621000:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3027, 88 off254216 00000004:00080000:0.0:1746143817.621002:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876845090075ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.621008:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3028, 88 off254304 00000004:00080000:0.0:1746143817.621010:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876845098033ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.621016:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3029, 88 off254392 00000004:00080000:0.0:1746143817.621019:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 876845106803ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143817.621026:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3047, 88 off255624 00000004:00080000:0.0:1746143817.621028:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 876845115710ns, next at 850789974850ns, rc = 0 00000100:00100000:0.0:1746143817.625440:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627191040:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143817.625504:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe1 expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.625514:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143817.625516:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143817.625519:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.625526:0:10936:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.625531:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.625576:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b048d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe1 expref: 9 pid: 10936 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143817.625589:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b0494 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe1 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.625609:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0200, rc 0) 00000100:00100000:0.0:1746143817.625642:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:1735:x1830963624232320:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11026us (11520us total) trans 8589944440 rc 0/0 00000100:00100000:0.0:1746143817.625649:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13547 00000100:00100000:0.0:1746143817.625673:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627191296 00000100:00100000:0.0:1746143817.625676:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627191296 00000100:00100000:0.0:1746143817.625690:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627192320 00000100:00100000:0.0:1746143817.625692:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627192320 00000100:00100000:0.0:1746143817.625701:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627191168 00000100:00100000:0.0:1746143817.625703:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627191168 00000100:00100000:0.0:1746143817.625709:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627192192 00000100:00100000:0.0:1746143817.625711:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627192192 00000100:00100000:0.0:1746143817.625720:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14824 00000100:00100000:0.0:1746143817.625725:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3774:x1830963627191296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143817.625799:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4804992 -> 4804992 00002000:00010000:0.0:1746143817.625802:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143817 -> 1746143817 00002000:00010000:0.0:1746143817.625804:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143817 -> 1746143817 00002000:00010000:0.0:1746143817.625806:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143817 -> 1746143817 00002000:00010000:0.0:1746143817.625807:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5304 -> 5304 00000100:00100000:0.0:1746143817.625830:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963627191296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (328us total) trans 17179873626 rc 0/0 00000100:00100000:0.0:1746143817.625842:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14824 00000100:00100000:0.0:1746143817.625852:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14826 00000100:00100000:0.0:1746143817.625856:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3774:x1830963627192320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143817.625890:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143817.625892:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.625894:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143817.625895:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.625897:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143817.625935:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963627192320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (396us total) trans 17179873627 rc 0/0 00000100:00100000:0.0:1746143817.625940:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14826 00000100:00100000:0.0:1746143817.625949:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14828 00000100:00100000:0.0:1746143817.625953:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963627191168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143817.625987:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143817.625990:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143817 -> 1746143817 00002000:00010000:0.0:1746143817.625991:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143817 -> 1746143817 00002000:00010000:0.0:1746143817.625993:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143817 -> 1746143817 00002000:00010000:0.0:1746143817.625995:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143817.626011:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3774:x1830963627191168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (407us total) trans 21474840918 rc 0/0 00000100:00100000:0.0:1746143817.626017:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14828 00000100:00100000:0.0:1746143817.626026:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14830 00000100:00100000:0.0:1746143817.626031:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963627192192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.626077:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963627192192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (433us total) trans 21474840920 rc 0/0 00000100:00100000:0.0:1746143817.626086:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14830 00000100:00100000:0.0:1746143817.626099:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626112:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627191552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.626126:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626136:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627192064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.626147:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626155:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627192576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.626165:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626174:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746143817.626178:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627190912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.626190:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626199:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627191424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.626209:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626216:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627191936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.626227:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143817.626234:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627192448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.626247:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143817.626265:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719ca80/2, rc 0, transno 21474840921 00000100:00100000:0.0:1746143817.626269:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627191040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143817.626280:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627191936 00000100:00100000:0.0:1746143817.626282:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627191936 00000100:00100000:0.0:1746143817.626291:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627192448 00000100:00100000:0.0:1746143817.626293:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627192448 00000100:00100000:0.0:1746143817.626311:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14834 00000100:00100000:0.0:1746143817.626315:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963627192576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143817.626357:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:0.0:1746143817.626360:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.626361:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143817.626363:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.626365:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143817.626381:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3772:x1830963627192576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (215us total) trans 17179873631 rc 0/0 00000100:00100000:0.0:1746143817.626386:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14834 00000100:00100000:0.0:1746143817.626395:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14836 00000100:00100000:0.0:1746143817.627229:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3772:x1830963627191424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143817.627281:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143817.627284:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.627286:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143817.627288:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143817.627289:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143817.627311:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963627191424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 911us (1100us total) trans 21474840922 rc 0/0 00000100:00100000:0.0:1746143817.627316:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14836 00010000:00010000:0.0:1746143817.627508:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.627718:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143817.627754:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:0.0:1746143817.627757:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143817.627773:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.628053:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b04a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe8 expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.628067:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe8 expref: 261 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.628074:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143817.628077:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746143817.628079:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1600, rc 0) 00000100:00100000:0.0:1746143817.628107:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:1738:x1830963624232576:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9712us (10094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.628113:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13548 00000100:00100000:0.0:1746143817.628298:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627192704 00000100:00100000:0.0:1746143817.628302:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627192704 00000100:00100000:0.0:1746143817.628321:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14839 00000100:00100000:0.0:1746143817.628325:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627192704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143817.628394:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627192704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (186us total) trans 17179873634 rc 0/0 00000100:00100000:0.0:1746143817.628399:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14839 00000100:00100000:0.0:1746143817.630468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.631349:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624232960 00000100:00100000:0.0:1746143817.631353:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624232960 00000100:00100000:0.0:1746143817.631372:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14840 00000100:00100000:0.0:1746143817.631378:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+9:1735:x1830963624232960:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143817.631385:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.631393:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b04be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840eff6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.631414:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73b0447 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efbe expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.631421:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.631423:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.631426:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b04be lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2797568->3055615] (req 2797568->3055615) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840eff6 expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.631448:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73b0447 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efbe expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.631458:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ca00/0x87925e4cb73b0447 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efbe expref: 9 pid: 12327 timeout: 976 lvb_type: 1 00000100:00100000:0.0:1746143817.631468:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627192832:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143817.631526:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143817.633794:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.633817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.633843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.633884:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.633896:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.634320:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14843 00000100:00100000:0.0:1746143817.634327:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624233216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143817.634332:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.634339:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b04d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f004 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.634357:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.634358:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.634362:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b04d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f004 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.634371:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b04d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f004 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.634376:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ce00, rc 0) 00000100:00100000:0.0:1746143817.634393:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624233216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 68us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.634398:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14843 00000100:00100000:0.0:1746143817.634410:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14845 00000100:00100000:0.0:1746143817.634414:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624233600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143817.634419:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.634424:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b04e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f019 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.634432:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.634438:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b04e1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f019 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.634445:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b04e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f019 expref: 27 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.634458:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d400, rc 0) 00000100:00100000:0.0:1746143817.634478:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624233600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (580us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143817.634483:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14845 00000100:00100000:0.0:1746143817.634681:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.634712:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.640667:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624234112 00000100:00100000:0.0:1746143817.640674:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624234112 00002000:00100000:0.0:1746143817.640712:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2797568->2801663) req@ffff880090e7aa00 x1830963624234112/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:213/0 lens 488/0 e 0 to 0 dl 1746143828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143817.640721:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7aa00 with x1830963624234112 ext(2797568->2801663) 00002000:00010000:0.0:1746143817.640725:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e7aa00 00000100:00100000:0.0:1746143817.640742:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6295 00000100:00100000:0.0:1746143817.640748:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2010:x1830963624234112:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143817.640861:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2010:x1830963624234112:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 112us (268us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143817.640868:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6295 00002000:00100000:0.0:1746143817.640873:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2797568->2801663) req@ffff880090e7aa00 x1830963624234112/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:213/0 lens 488/4536 e 0 to 0 dl 1746143828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143817.640879:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7aa00 with x1830963624234112 ext(2797568->2801663) 00002000:00010000:0.0:1746143817.640882:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e7aa00 00000100:00100000:0.0:1746143817.645621:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.647761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.647793:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.647816:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.647855:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.649056:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.687057:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.702598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.708215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.724300:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.727576:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624236800 00000100:00100000:0.0:1746143817.727583:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624236800 00002000:00100000:0.0:1746143817.727619:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c33480 x1830963624236800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:213/0 lens 488/0 e 0 to 0 dl 1746143828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143817.727628:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33480 with x1830963624236800 ext(2097152->4194303) 00002000:00010000:0.0:1746143817.727633:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33480 00000100:00100000:0.0:1746143817.727667:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6302 00000100:00100000:0.0:1746143817.727675:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624236800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143817.762218:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.772799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.777182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.778173:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.778237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.778440:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624237696 00000100:00100000:0.0:1746143817.778443:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624237696 00000100:00100000:0.0:1746143817.778467:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13553 00000100:00100000:0.0:1746143817.778472:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:1747:x1830963624237696:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143817.778479:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.778487:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b054a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f043 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.778522:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778696:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778704:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778714:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778719:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778724:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778784:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778790:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778795:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143817.778801:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143817.778829:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778835:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778840:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778852:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143817.778856:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778861:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778869:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143817.778871:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143817.778873:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778877:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3800/0x87925e4cb73b055f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778904:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778908:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778926:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778931:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778934:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143817.778937:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778941:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778955:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143817.778957:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143817.778959:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778964:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2200/0x87925e4cb73b0551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778970:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778974:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778978:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778982:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143817.778985:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778989:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.778994:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f44e600) 00010000:00010000:0.0:1746143817.778996:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143817.778997:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.779001:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b0558 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143817.779023:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b054a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f043 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.779033:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b054a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f043 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.779040:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3a00, rc 0) 00000100:00100000:0.0:1746143817.779061:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:1747:x1830963624237696:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 589us (889us total) trans 8589944445 rc 301/301 00000100:00100000:0.0:1746143817.779066:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13553 00000100:00100000:0.0:1746143817.780947:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.782680:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.782709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.782733:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.782755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.782776:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.782817:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624238720 00000100:00100000:0.0:1746143817.782819:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624238720 00000100:00100000:0.0:1746143817.782833:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14850 00000100:00100000:0.0:1746143817.782837:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624238592:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143817.782843:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.782849:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b057b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f066 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.782858:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.782859:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.782865:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b057b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f066 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.782884:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b057b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f066 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.782889:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2c00, rc 0) 00000100:00100000:0.0:1746143817.782907:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624238592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.783313:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14850 00000100:00100000:0.0:1746143817.784497:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.787985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.789178:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.789581:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.791324:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624239616 00000100:00100000:0.0:1746143817.791328:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624239616 00002000:00100000:0.0:1746143817.791354:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880093414a80 x1830963624239616/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:213/0 lens 488/0 e 0 to 0 dl 1746143828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143817.791362:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414a80 with x1830963624239616 ext(0->1048575) 00002000:00010000:0.0:1746143817.791365:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414a80 00000100:00100000:0.0:1746143817.792094:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624239744 00000100:00100000:0.0:1746143817.792098:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624239744 00002000:00100000:0.0:1746143817.792113:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880093415f80 x1830963624239744/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:213/0 lens 488/0 e 0 to 0 dl 1746143828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143817.792121:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963624239744 ext(1048576->2097151) 00002000:00010000:0.0:1746143817.792124:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093415f80 00000100:00100000:0.0:1746143817.792149:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6304 00000100:00100000:0.0:1746143817.792156:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624239616:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143817.806308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.810489:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.819537:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.821516:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.829349:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.830424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.831102:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.841515:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.841566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.847029:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.855811:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.862531:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.870193:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.879560:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624243200 00000100:00100000:0.0:1746143817.879569:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624243200 00002000:00100000:0.0:1746143817.879605:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c31c00 x1830963624243200/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:213/0 lens 488/0 e 0 to 0 dl 1746143828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143817.879613:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31c00 with x1830963624243200 ext(1048576->2097151) 00002000:00010000:0.0:1746143817.879618:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c31c00 00000100:00100000:0.0:1746143817.879648:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6310 00000100:00100000:0.0:1746143817.879655:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624243200:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143817.897978:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.901652:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.901689:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.902243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.902286:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624243840 00000100:00100000:0.0:1746143817.902299:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624243840 00000100:00100000:0.0:1746143817.902418:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14860 00000100:00100000:0.0:1746143817.902424:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963624243712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143817.902440:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143817.902463:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3600/0x87925e4cb73b05e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f0a5 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143817.902481:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.902483:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143817.902489:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3600/0x87925e4cb73b05e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f0a5 expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.902502:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3600/0x87925e4cb73b05e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f0a5 expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143817.902510:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3600, rc 0) 00000100:00100000:0.0:1746143817.902537:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963624243712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 113us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143817.902542:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14860 00000100:00100000:0.0:1746143817.907135:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6312 00000100:00100000:0.0:1746143817.907145:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624244352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143817.939546:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.948377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.952157:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.955542:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.963844:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.968536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143817.985223:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.024414:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.059419:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.084746:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.090262:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143818.090846:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143818.092439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.095509:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.095534:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.095578:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.099039:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.103814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.118190:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.123714:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.125737:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.134635:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.134701:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.134747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.156240:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963624249728:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8219us (8430us total) trans 21474840925 rc 0/0 00000100:00100000:0.0:1746143818.156258:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2408 00002000:00100000:0.0:1746143818.156272:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1572863) req@ffff880090e78700 x1830963624249728/t21474840925(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:214/0 lens 488/448 e 0 to 0 dl 1746143829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143818.156283:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78700 with x1830963624249728 ext(1048576->1572863) 00010000:00010000:0.0:1746143818.156294:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b0670 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f0dd expref: 14 pid: 1945 timeout: 977 lvb_type: 0 00010000:00010000:0.0:1746143818.156339:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b0670 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1572863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f0dd expref: 14 pid: 1945 timeout: 977 lvb_type: 0 00002000:00010000:0.0:1746143818.156346:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e78700 00000100:00100000:0.0:1746143818.160127:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.161267:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.165576:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.175784:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.181446:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963624250752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5416us (5661us total) trans 0 rc 614400/614400 00000100:00100000:0.0:1746143818.181459:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6323 00002000:00100000:0.0:1746143818.181472:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88012b1d8380 x1830963624250752/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:214/0 lens 488/440 e 0 to 0 dl 1746143829 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143818.181482:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8380 with x1830963624250752 ext(4194304->4808703) 00002000:00010000:0.0:1746143818.181489:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8380 00000100:00100000:0.0:1746143818.183131:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.183896:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.188285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.189642:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.195004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.198119:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.203125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.274731:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.297589:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.301379:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.309426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.314944:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.327507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.334261:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.334296:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.334317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.337121:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6327 00000100:00100000:0.0:1746143818.337130:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624254080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143818.341428:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.351706:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.351755:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.352832:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624253824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16018us (18534us total) trans 0 rc 651264/651264 00000100:00100000:0.0:1746143818.352839:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6326 00002000:00100000:0.0:1746143818.352847:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1699839) req@ffff880095e31180 x1830963624253824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:214/0 lens 488/440 e 0 to 0 dl 1746143829 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143818.352854:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963624253824 ext(1048576->1699839) 00002000:00010000:0.0:1746143818.352858:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:0.0:1746143818.360898:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.364535:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.365848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.369930:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627198592:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143818.369953:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b06fc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f131 expref: 29 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.369967:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28e00, rc 0) 00000100:00100000:0.0:1746143818.370011:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:1770:x1830963624254976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4076us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.370018:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14875 00000100:00100000:0.0:1746143818.376105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.387484:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.387521:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.387614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.391702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.393381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.395020:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.406060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.409330:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.419002:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.423216:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.428774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.430386:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.430555:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.439963:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.439994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.440030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.441486:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.441512:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.441537:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.446787:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.451613:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624259712 00000100:00100000:0.0:1746143818.451618:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624259712 00002000:00100000:0.0:1746143818.451635:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff880095c39f80 x1830963624259712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:214/0 lens 488/0 e 0 to 0 dl 1746143829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143818.451656:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39f80 with x1830963624259712 ext(4194304->4808703) 00002000:00010000:0.0:1746143818.451659:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39f80 00000100:00100000:0.0:1746143818.459837:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.471198:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624260224 00000100:00100000:0.0:1746143818.471210:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624260224 00000100:00100000:0.0:1746143818.471264:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624260480 00000100:00100000:0.0:1746143818.471267:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624260480 00000100:00100000:0.0:1746143818.471283:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5123 00000100:00100000:0.0:1746143818.471295:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+272:1773:x1830963624260224:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143818.471981:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:1773:x1830963624260224:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 690us (868us total) trans 8589944463 rc 0/0 00000100:00100000:0.0:1746143818.471988:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5123 00000100:00100000:0.0:1746143818.485631:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143818.488311:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143818.490703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.507746:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.512886:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.520051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.528908:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.545731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.550034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.559025:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.568088:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.568130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.575816:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624262912 00000100:00100000:0.0:1746143818.575831:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624262912 00000100:00100000:0.0:1746143818.575909:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5125 00000100:00100000:0.0:1746143818.575931:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+6:1732:x1830963624262912:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143818.576170:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:1732:x1830963624262912:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 239us (807us total) trans 8589944464 rc 0/0 00000100:00100000:0.0:1746143818.576178:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5125 00000100:00100000:0.0:1746143818.587348:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.605152:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.620160:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.626167:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 892 00000100:00100000:0.0:1746143818.626175:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963624264320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143818.626188:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143818.627808:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b07ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f19a expref: 24 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.628428:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143818.628435:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143818.631443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.637239:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.643060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.647650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.696763:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.701239:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.701293:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.706082:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.707961:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.708944:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.712577:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.724024:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.728623:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.728666:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.730563:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.731095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.738055:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.738106:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.746619:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.755058:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.761238:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.761286:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.770434:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.770565:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.770593:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624269568 00000100:00100000:0.0:1746143818.770596:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624269568 00000100:00100000:0.0:1746143818.770639:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13566 00000100:00100000:0.0:1746143818.770644:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:1795:x1830963624269568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143818.770665:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143818.770688:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55bc00/0x87925e4cb73b084c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f1f5 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.770782:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b0853 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143818.770797:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe8 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.770804:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b0543 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f03c expref: 25 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.770834:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b07ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f193 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.770840:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b0853 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143818.770869:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b07ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f193 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.770878:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b07ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f193 expref: 279 pid: 14991 timeout: 977 lvb_type: 0 00000100:00100000:0.0:1746143818.770892:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627202688:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143818.771002:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b0543 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f03c expref: 25 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.771009:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b0543 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f03c expref: 25 pid: 10936 timeout: 977 lvb_type: 0 00000100:00100000:0.0:1746143818.771016:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627202816:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143818.771063:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe8 expref: 279 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.771069:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b04b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840efe8 expref: 279 pid: 14991 timeout: 977 lvb_type: 0 00000100:00100000:0.0:1746143818.771076:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627202944:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143818.771178:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938549c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746143818.777671:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b0853 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143818.777677:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b0853 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143818.777697:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143818.777808:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55bc00/0x87925e4cb73b084c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1f5 expref: 279 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.777838:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b0853 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1f5 expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.777844:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143818.777847:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143818.777850:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a200, rc 0) 00000100:00100000:0.0:1746143818.777870:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:1795:x1830963624269568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7226us (7304us total) trans 8589944473 rc 0/0 00000100:00100000:0.0:1746143818.777876:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13566 00000100:00100000:0.0:1746143818.780862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.788964:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.789002:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.791222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.809961:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.819681:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.822555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.825203:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.830724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.831347:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.833065:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.836745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.841843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.844344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.844377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.863140:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.867194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.873142:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.878684:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.896725:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.904409:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.911163:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.915467:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.915484:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.915506:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143818.915989:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143818.918608:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.921734:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.924474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.927172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.930742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.942972:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.952376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.959215:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.965146:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624277120 00000100:00100000:0.0:1746143818.965150:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624277120 00010000:00010000:0.0:1746143818.965166:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b06ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f123 expref: 31 pid: 1945 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143818.972963:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624277760 00000100:00100000:0.0:1746143818.972967:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624277760 00002000:00100000:0.0:1746143818.973005:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1347584->1740799) req@ffff88009e490a80 x1830963624277760/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:214/0 lens 488/0 e 0 to 0 dl 1746143829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143818.973017:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963624277760 ext(1347584->1740799) 00010000:00010000:0.0:1746143818.973022:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b0861 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1fc expref: 29 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.973031:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b0861 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->1740799) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1fc expref: 29 pid: 9839 timeout: 978 lvb_type: 0 00002000:00010000:0.0:1746143818.973036:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009e490a80 00000100:00100000:0.0:1746143818.973633:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2418 00000100:00100000:0.0:1746143818.973639:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963624277760:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:0.0:1746143818.973764:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973772:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973787:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973795:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973822:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973828:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143818.973832:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973839:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973850:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.973855:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33200/0x87925e4cb73b0925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143818.973909:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624276608:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 20503us (21053us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.973933:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14913 00000100:00100000:0.0:1746143818.974872:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624277248 00000100:00100000:0.0:1746143818.974876:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624277248 00010000:00010000:0.0:1746143818.974895:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b0757 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f154 expref: 18 pid: 9587 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143818.974922:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624277888 00000100:00100000:0.0:1746143818.974924:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624277888 00010000:00010000:0.0:1746143818.974940:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b0845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1ee expref: 19 pid: 9839 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143818.974949:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624278400 00000100:00100000:0.0:1746143818.974950:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624278400 00010000:00010000:0.0:1746143818.974958:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b04c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840effd expref: 33 pid: 3134 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143818.974964:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624278656 00000100:00100000:0.0:1746143818.974966:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624278656 00010000:00010000:0.0:1746143818.974972:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b0837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1e0 expref: 20 pid: 13436 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143818.974978:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624278528 00000100:00100000:0.0:1746143818.974979:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624278528 00010000:00010000:0.0:1746143818.974986:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b0814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1cb expref: 34 pid: 9839 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143818.974993:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7093 00000100:00100000:0.0:1746143818.974996:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624277248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143818.975004:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143818.975014:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b0757 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f154 expref: 18 pid: 9587 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975022:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b0757 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f154 expref: 18 pid: 9587 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975033:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b0757 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f154 expref: 18 pid: 9587 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975046:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975048:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975051:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b0917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975057:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b0917 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975072:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143818.975089:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963624277248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.975093:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7093 00000100:00100000:0.0:1746143818.975102:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7094 00000100:00100000:0.0:1746143818.975105:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624277888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143818.975111:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143818.975120:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b0845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1ee expref: 20 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.975128:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b0845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1ee expref: 20 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.975139:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b0845 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1ee expref: 20 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.975150:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975155:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975158:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73b091e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975164:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd86600/0x87925e4cb73b091e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975178:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143818.975192:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963624277888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.975197:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7094 00000100:00100000:0.0:1746143818.975205:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7095 00000100:00100000:0.0:1746143818.975209:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624278400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143818.975215:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143818.975222:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b04c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840effd expref: 34 pid: 3134 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975229:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b04c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840effd expref: 34 pid: 3134 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975240:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b04c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840effd expref: 34 pid: 3134 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975247:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975249:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975251:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b0910 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975266:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b0910 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975278:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143818.975291:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624278400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.975296:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7095 00000100:00100000:0.0:1746143818.975305:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7096 00000100:00100000:0.0:1746143818.975308:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624278656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143818.975313:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143818.975320:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b0837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1e0 expref: 18 pid: 13436 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975327:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b0837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1e0 expref: 18 pid: 13436 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975335:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b0837 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1e0 expref: 18 pid: 13436 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143818.975343:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143818.975354:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963624278656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.975358:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7096 00000100:00100000:0.0:1746143818.975364:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7097 00000100:00100000:0.0:1746143818.975367:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963624278528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143818.975377:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143818.975382:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b0814 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1cb expref: 32 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.975388:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b0814 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1cb expref: 32 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.975396:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b0814 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f1cb expref: 32 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143818.975403:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975404:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143818.975406:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975412:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975421:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143818.975432:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963624278528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.975435:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7097 00010000:00010000:0.0:1746143818.975462:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975468:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975488:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975494:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975499:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975503:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143818.975505:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975510:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975517:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143818.975522:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a800/0x87925e4cb73b0933 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143818.975563:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624276480:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 21750us (21917us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143818.975568:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14915 00000100:00100000:0.0:1746143818.985726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.989477:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.996475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.996514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.996533:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.996625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.999762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143818.999811:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.006281:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627207424:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746143819.007270:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143819.007301:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627208704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.007330:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14917 00000100:00100000:0.0:1746143819.007335:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963627208320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.007471:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3774:x1830963627208320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (472us total) trans 21474840932 rc 0/0 00000100:00100000:0.0:1746143819.007477:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14917 00000100:00100000:0.0:1746143819.007492:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14918 00000100:00100000:0.0:1746143819.007497:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3774:x1830963627207680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.007555:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3774:x1830963627207680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (381us total) trans 21474840933 rc 0/0 00000100:00100000:0.0:1746143819.007560:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14918 00000100:00100000:0.0:1746143819.008047:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.008074:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627207936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.008091:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.008104:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008117:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.008138:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008157:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.008165:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746143819.008169:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.008183:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.008190:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008201:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.008209:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627209088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008221:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143819.008233:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143819.008241:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14922 00000100:00100000:0.0:1746143819.008245:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963627207424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.008296:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3771:x1830963627207424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (249us total) trans 21474840935 rc 0/0 00000100:00100000:0.0:1746143819.008301:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14922 00000100:00100000:0.0:1746143819.008311:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627209216 00000100:00100000:0.0:1746143819.008313:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627209216 00000100:00100000:0.0:1746143819.008332:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14925 00000100:00100000:0.0:1746143819.008336:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3771:x1830963627208960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008393:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3771:x1830963627208960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (234us total) trans 17179873646 rc 0/0 00000100:00100000:0.0:1746143819.008398:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14925 00000100:00100000:0.0:1746143819.008409:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14929 00000100:00100000:0.0:1746143819.008413:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800911fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627209216:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.008452:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490380/2, rc 0, transno 21474840937 00000100:00100000:0.0:1746143819.008459:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.008469:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdca80/2, rc 0, transno 17179873647 00000100:00100000:0.0:1746143819.008476:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.008482:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bded80/2, rc 0, transno 17179873648 00000100:00100000:0.0:1746143819.008484:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627209088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.008490:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490700/2, rc 0, transno 21474840936 00000100:00100000:0.0:1746143819.008493:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627207936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.008499:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bde300/2, rc 0, transno 17179873645 00000100:00100000:0.0:1746143819.008501:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.008506:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdf100/2, rc 0, transno 17179873646 00000100:00100000:0.0:1746143819.008509:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627208960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.008516:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492d80/2, rc 0, transno 21474840935 00000100:00100000:0.0:1746143819.008518:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627207424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.008562:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bddc00/2, rc 0, transno 17179873650 00000100:00100000:0.0:1746143819.008565:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627208704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008601:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627209472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.008621:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143819.008724:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491500/2, rc 0, transno 21474840938 00000100:00100000:0.0:1746143819.008727:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627207552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.008739:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bddf80/2, rc 0, transno 17179873651 00000100:00100000:0.0:1746143819.008742:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627209472:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746143819.012761:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143819.021348:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.025527:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.025576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.025606:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.025636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.026208:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624280576 00000100:00100000:0.0:1746143819.026212:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624280576 00000100:00100000:0.0:1746143819.026232:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14935 00000100:00100000:0.0:1746143819.026237:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963624280576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143819.026244:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.026252:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73b0964 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f288 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143819.026266:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a4a, atime: 0x68140a4a, ctime: 0x68140a4a, blocks: 0x808 00010000:00010000:0.0:1746143819.026274:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.026276:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.026280:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73b0964 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f288 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.026290:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73b0964 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f288 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.026297:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107a00, rc 0) 00000100:00100000:0.0:1746143819.026316:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624280576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 78us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.027853:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14935 00000100:00100000:0.0:1746143819.031318:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.031351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.031394:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.031416:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624281344 00000100:00100000:0.0:1746143819.031425:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624281344 00000100:00100000:0.0:1746143819.031765:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624281600 00000100:00100000:0.0:1746143819.031768:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624281600 00000100:00100000:0.0:1746143819.032468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.032484:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624281216 00000100:00100000:0.0:1746143819.032487:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624281216 00000100:00100000:0.0:1746143819.032512:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14942 00000100:00100000:0.0:1746143819.032517:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624281216:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143819.032586:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624281216:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 68us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.032592:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14942 00000100:00100000:0.0:1746143819.032726:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624281472 00000100:00100000:0.0:1746143819.032729:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624281472 00000100:00100000:0.0:1746143819.032875:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14944 00000100:00100000:0.0:1746143819.032879:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624281472:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143819.032933:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624281472:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.032938:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14944 00000100:00100000:0.0:1746143819.036674:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.036712:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.036739:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.036754:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.036766:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.036793:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.042778:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.046722:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.051592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.055692:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.055736:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.055771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.056906:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.056933:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624284160 00000100:00100000:0.0:1746143819.056938:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624284160 00000100:00100000:0.0:1746143819.056968:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6361 00000100:00100000:0.0:1746143819.056973:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963624284160:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143819.056989:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b099c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.057547:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.057549:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.057552:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b099c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.057561:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b099c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.061162:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.061194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.096837:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.101199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.101236:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.101284:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.101309:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624285312 00000100:00100000:0.0:1746143819.101316:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624285312 00000100:00100000:0.0:1746143819.101363:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624285440 00000100:00100000:0.0:1746143819.101374:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624285440 00000100:00100000:0.0:1746143819.101389:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624285568 00000100:00100000:0.0:1746143819.101390:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624285568 00000100:00100000:0.0:1746143819.101402:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14953 00000100:00100000:0.0:1746143819.101409:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624285312:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143819.101545:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143819.101548:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143817 -> 1746143819 00002000:00010000:0.0:1746143819.101551:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143817 -> 1746143819 00002000:00010000:0.0:1746143819.101553:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143817 -> 1746143819 00002000:00010000:0.0:1746143819.101555:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:0.0:1746143819.101592:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624285312:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 184us (401us total) trans 17179873653 rc 0/0 00000100:00100000:0.0:1746143819.101598:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14953 00000100:00100000:0.0:1746143819.101611:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14954 00000100:00100000:0.0:1746143819.101615:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624285440:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143819.101675:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143819.101677:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143818 -> 1746143819 00002000:00010000:0.0:1746143819.101679:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143818 -> 1746143819 00002000:00010000:0.0:1746143819.101681:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143818 -> 1746143819 00002000:00010000:0.0:1746143819.101682:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143819.101697:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963624285440:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 81us (461us total) trans 21474840940 rc 0/0 00000100:00100000:0.0:1746143819.101701:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14954 00000100:00100000:0.0:1746143819.101708:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14955 00000100:00100000:0.0:1746143819.101712:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624285568:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143819.101749:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143819.101750:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.101752:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.101753:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.101755:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143819.101769:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963624285568:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 56us (486us total) trans 21474840941 rc 0/0 00000100:00100000:0.0:1746143819.101773:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14955 00000100:00100000:0.0:1746143819.102468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.102494:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.104389:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.107611:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.110739:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.116276:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627209728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.116300:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627210240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.116318:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627211008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.117194:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117209:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627210752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.117228:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117239:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627211264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.117253:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117271:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117283:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627209856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.117298:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117319:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627210368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.117333:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117340:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627210880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.117350:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117357:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627211392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.117370:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143819.117402:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdc380/2, rc 0, transno 17179873658 00000100:00100000:0.0:1746143819.117410:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627210240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.117419:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117428:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627211520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.117443:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.117456:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627211520 00000100:00100000:0.0:1746143819.117459:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627211520 00000100:00100000:0.0:1746143819.117472:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14967 00000100:00100000:0.0:1746143819.117475:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627211264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.117528:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627211264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (274us total) trans 21474840946 rc 0/0 00000100:00100000:0.0:1746143819.117534:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14967 00000100:00100000:0.0:1746143819.117553:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14969 00000100:00100000:0.0:1746143819.117557:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963627209856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143819.117595:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143819.117597:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.117599:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.117601:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.117603:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143819.117628:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963627209856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (329us total) trans 21474840947 rc 0/0 00000100:00100000:0.0:1746143819.117634:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14969 00000100:00100000:0.0:1746143819.117643:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14970 00000100:00100000:0.0:1746143819.117647:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963627210368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.117698:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627210368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (363us total) trans 17179873660 rc 0/0 00000100:00100000:0.0:1746143819.117703:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14970 00000100:00100000:0.0:1746143819.117710:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14971 00000100:00100000:0.0:1746143819.117714:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963627210880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143819.117755:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:0.0:1746143819.117757:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143819.117759:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143819.117760:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143819.117762:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143819.117777:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627210880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (426us total) trans 17179873661 rc 0/0 00000100:00100000:0.0:1746143819.117782:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14971 00000100:00100000:0.0:1746143819.117791:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14972 00000100:00100000:0.0:1746143819.117795:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963627211392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143819.117830:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143819.117832:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143819.117834:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143819.117836:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143819.117838:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143819.117858:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963627211392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (487us total) trans 21474840948 rc 0/0 00000100:00100000:0.0:1746143819.117863:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14972 00000100:00100000:0.0:1746143819.117872:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14973 00000100:00100000:0.0:1746143819.117876:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963627211008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143819.117909:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143819.117929:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.117931:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.117933:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.117935:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143819.117953:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627211008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (532us total) trans 21474840949 rc 0/0 00000100:00100000:0.0:1746143819.117957:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14973 00000100:00100000:0.0:1746143819.117965:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14974 00000100:00100000:0.0:1746143819.117968:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963627211520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.118014:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627211520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (571us total) trans 21474840950 rc 0/0 00000100:00100000:0.0:1746143819.118019:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14974 00000004:00080000:0.0:1746143819.118039:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843b80/2, rc 0, transno 17179873659 00000100:00100000:0.0:1746143819.118042:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627210752:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.118050:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a6680/2, rc 0, transno 21474840946 00000100:00100000:0.0:1746143819.118053:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627211264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.118063:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a7b80/2, rc 0, transno 21474840949 00000100:00100000:0.0:1746143819.118065:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627211008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.118071:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef2d80/2, rc 0, transno 21474840950 00000100:00100000:0.0:1746143819.118077:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627211520:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.118089:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a5c00/2, rc 0, transno 21474840947 00000100:00100000:0.0:1746143819.118092:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627209856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.118097:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdd500/2, rc 0, transno 17179873660 00000100:00100000:0.0:1746143819.118100:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627210368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.118105:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d842d80/2, rc 0, transno 17179873661 00000100:00100000:0.0:1746143819.118108:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627210880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.118113:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a7480/2, rc 0, transno 21474840948 00000100:00100000:0.0:1746143819.118116:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627211392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.118121:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdfb80/2, rc 0, transno 17179873662 00000100:00100000:0.0:1746143819.118123:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627209728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.118825:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627211776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.121626:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624286464 00000100:00100000:0.0:1746143819.121630:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624286464 00000100:00100000:0.0:1746143819.121660:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13575 00000100:00100000:0.0:1746143819.121665:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+6:1798:x1830963624286464:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143819.121682:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.121700:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b09c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f2ab expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.121747:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b09c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ab expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.121761:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b09c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ab expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.121792:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.121795:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143819.121799:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3aa00, rc 0) 00000100:00100000:0.0:1746143819.121849:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+7:1798:x1830963624286464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 182us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.121855:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13575 00000004:00080000:0.0:1746143819.121980:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840a80/2, rc 0, transno 17179873664 00000100:00100000:0.0:1746143819.121985:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627211776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.124536:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.142265:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143819.143282:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143819.143495:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143819.144259:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143819.153961:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624287360 00000100:00100000:0.0:1746143819.153974:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624287360 00000100:00100000:0.0:1746143819.154043:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14976 00000100:00100000:0.0:1746143819.154053:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:1811:x1830963624287360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.154075:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.154097:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b0a13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f2c0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.154127:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.154130:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.154141:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b0a13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2c0 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.154178:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b0a13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2c0 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.154191:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3ba00, rc 0) 00000100:00100000:0.0:1746143819.154249:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:1811:x1830963624287360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 196us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.154256:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14976 00000100:00080000:0.0:1746143819.154284:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143819.159155:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624288256 00000100:00100000:0.0:1746143819.159158:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624288256 00000100:00100000:0.0:1746143819.159179:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624288384 00000100:00100000:0.0:1746143819.159181:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624288384 00000100:00100000:0.0:1746143819.159194:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13580 00000100:00100000:0.0:1746143819.159198:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:1811:x1830963624288256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.159212:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.159225:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b0a3d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f2d5 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.159271:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b0a3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2d5 expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.159280:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b0a3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2d5 expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.159294:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.159296:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143819.159308:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3be00, rc 0) 00000100:00100000:0.0:1746143819.159327:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:1811:x1830963624288256:12345-192.168.202.3@tcp:101:cat.0 Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.159332:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13580 00000100:00100000:0.0:1746143819.165601:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.165660:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.200573:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624289152 00000100:00100000:0.0:1746143819.200587:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624289152 00002000:00100000:0.0:1746143819.200664:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129dc0700 x1830963624289152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:215/0 lens 488/0 e 0 to 0 dl 1746143830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.200675:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0700 with x1830963624289152 ext(0->1048575) 00002000:00010000:0.0:1746143819.200680:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0700 00000100:00100000:0.0:1746143819.200718:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6366 00000100:00100000:0.0:1746143819.200726:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963624289152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143819.203652:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143819.203845:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143819.212649:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.222310:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.230489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.231201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.241673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.243342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.254999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.261474:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800911f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627212800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.261508:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.261529:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.261574:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.262671:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627214208 00000100:00100000:0.0:1746143819.262674:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627214208 00000100:00100000:0.0:1746143819.262792:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14990 00000100:00100000:0.0:1746143819.262797:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963627213696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143819.262859:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143819.262861:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.262863:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.262865:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143819 -> 1746143819 00002000:00010000:0.0:1746143819.262866:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143819.262887:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3774:x1830963627213696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (299us total) trans 21474840953 rc 0/0 00000100:00100000:0.0:1746143819.262891:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14990 00000100:00100000:0.0:1746143819.262924:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.262943:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.262954:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627214336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.262967:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143819.262981:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800911f8700/2, rc 0, transno 17179873669 00000100:00100000:0.0:1746143819.262984:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800911f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627212800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.262990:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746143819.262994:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.263009:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.263017:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.263030:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.263037:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627214464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.263056:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143819.263068:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdd880/2, rc 0, transno 21474840955 00000100:00100000:0.0:1746143819.263071:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.263077:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457ca80/2, rc 0, transno 21474840956 00000100:00100000:0.0:1746143819.263079:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627214336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.263092:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14997 00000100:00100000:0.0:1746143819.263096:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3771:x1830963627214464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.263144:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627214464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (87us total) trans 21474840958 rc 0/0 00000100:00100000:0.0:1746143819.263149:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14997 00000004:00080000:0.0:1746143819.263399:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cd180/2, rc 0, transno 17179873671 00000100:00100000:0.0:1746143819.263402:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.263409:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdce00/2, rc 0, transno 21474840957 00000100:00100000:0.0:1746143819.263411:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.263416:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457ed80/2, rc 0, transno 21474840958 00000100:00100000:0.0:1746143819.263419:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627214464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.263425:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491f80/2, rc 0, transno 17179873672 00000100:00100000:0.0:1746143819.263427:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627213312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.263947:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.264879:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.265949:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.268032:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.270274:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.270613:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.275210:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.277160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.277201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.281529:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.281572:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.281672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.287976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.289295:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.289338:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.289578:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624293376 00000100:00100000:0.0:1746143819.289582:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624293376 00000100:00100000:0.0:1746143819.289606:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15002 00000100:00100000:0.0:1746143819.289635:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:1812:x1830963624293376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.289647:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.289660:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b0aad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f330 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.290965:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.290969:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.290978:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b0aad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f330 expref: 18 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.290998:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b0aad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f330 expref: 18 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.291009:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66400, rc 0) 00000100:00100000:0.0:1746143819.291042:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:1812:x1830963624293376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1427us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.291064:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15002 00000100:00100000:0.0:1746143819.292158:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624293760 00000100:00100000:0.0:1746143819.292162:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624293760 00000100:00100000:0.0:1746143819.292191:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15004 00000100:00100000:0.0:1746143819.292197:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624293760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.292205:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.292216:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d66800/0x87925e4cb73b0abb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f33e expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.292228:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.292229:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.292234:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d66800/0x87925e4cb73b0abb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f33e expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.292244:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d66800/0x87925e4cb73b0abb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f33e expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.292253:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66800, rc 0) 00000100:00100000:0.0:1746143819.292275:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624293760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 78us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.292280:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15004 00000100:00100000:0.0:1746143819.292335:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624293888 00000100:00100000:0.0:1746143819.292338:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624293888 00000100:00100000:0.0:1746143819.292360:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15005 00000100:00100000:0.0:1746143819.292365:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624293888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.292371:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.292386:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f345 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.292395:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.292397:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.292401:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f345 expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.292410:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f345 expref: 34 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.292418:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3800, rc 0) 00000100:00100000:0.0:1746143819.292434:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624293888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.292439:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15005 00000100:00100000:0.0:1746143819.294215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.294357:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.296848:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.305212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.305244:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.305267:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.305366:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624294912 00000100:00100000:0.0:1746143819.305370:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624294912 00010000:00010000:0.0:1746143819.305386:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107a00/0x87925e4cb73b0964 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f288 expref: 13 pid: 9585 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143819.305403:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7116 00000100:00100000:0.0:1746143819.305408:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624294656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.305422:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.305430:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b0a60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ea expref: 33 pid: 9585 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.305441:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b0a60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ea expref: 33 pid: 9585 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.306142:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b0a60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ea expref: 33 pid: 9585 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.306153:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.306155:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.306162:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b0ac9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f34c expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.306169:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b0ac9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f34c expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.306200:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b0ac9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f34c expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.306279:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627216256:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143819.306343:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.312744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.312793:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.321088:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.326660:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627216384:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143819.326682:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627216512:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143819.326690:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627216640:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143819.326718:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b0ad0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1052671] (req 1048576->1052671) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f35a expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.326732:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3ba00, rc 0) 00000100:00100000:0.0:1746143819.326756:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:1808:x1830963624295680:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9908us (10422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.326762:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15007 00000100:00100000:0.0:1746143819.328302:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624296704 00000100:00100000:0.0:1746143819.328310:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624296704 00010000:00010000:0.0:1746143819.328337:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b0aad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f330 expref: 20 pid: 9839 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143819.328357:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624296832 00000100:00100000:0.0:1746143819.328359:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624296832 00010000:00010000:0.0:1746143819.328369:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b0979 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f296 expref: 13 pid: 13436 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143819.328381:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624296960 00000100:00100000:0.0:1746143819.328383:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624296960 00010000:00010000:0.0:1746143819.328391:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76e00/0x87925e4cb73b0a98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f31b expref: 34 pid: 13430 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143819.328475:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7120 00000100:00100000:0.0:1746143819.328481:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624296960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.328494:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.328502:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76e00/0x87925e4cb73b0a98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f31b expref: 34 pid: 13430 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.328510:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76e00/0x87925e4cb73b0a98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f31b expref: 34 pid: 13430 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.328521:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76e00/0x87925e4cb73b0a98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f31b expref: 34 pid: 13430 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.329666:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.329699:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624296960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1215us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.329708:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7120 00000100:00100000:0.0:1746143819.338950:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.340305:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.342723:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.351768:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624297856 00000100:00100000:0.0:1746143819.351773:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624297856 00000100:00100000:0.0:1746143819.351800:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13585 00000100:00100000:0.0:1746143819.351806:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+6:1814:x1830963624297856:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143819.351817:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.351834:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b0af3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f376 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.351890:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.351990:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352002:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352015:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352021:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352027:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352091:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b0b08 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352099:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b0b08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352104:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b0b08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143819.352128:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:0.0:1746143819.352132:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143819.352143:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b0b08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352150:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b0b08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352158:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352171:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352177:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352183:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352188:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143819.352192:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352198:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352208:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143819.352211:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143819.352215:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352221:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b0afa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352235:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352240:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352245:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352249:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a9c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143819.352254:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352260:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352266:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65e00) 00010000:00010000:0.0:1746143819.352267:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143819.352269:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352274:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b0b01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143819.352296:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b0af3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f376 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.352306:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b0b08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f376 expref: 7 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.352313:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.352314:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143819.352316:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c2dba00, rc 0) 00000100:00100000:0.0:1746143819.352336:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+7:1814:x1830963624297856:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 530us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.352342:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13585 00000100:00100000:0.0:1746143819.365260:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.365450:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.365478:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.365504:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.366010:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15015 00000100:00100000:0.0:1746143819.366028:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624298496:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143819.366036:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.366046:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b0b24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f38b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.366072:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627217536:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143819.366096:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.366116:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15017 00000100:00100000:0.0:1746143819.366122:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963624298880:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143819.366128:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.366135:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b0b32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f3a0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.366156:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627217792:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143819.366175:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd79000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.371909:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627217792:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143819.371970:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b0b32 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f3a0 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.371984:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b0b32 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f3a0 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.371999:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27e00, rc 0) 00000100:00100000:0.0:1746143819.372041:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963624298880:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 5918us (6535us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143819.372060:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15017 00000100:00100000:0.0:1746143819.375499:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.379669:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.381100:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.382085:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.385436:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143819.386228:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b0b40 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.386235:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b0b40 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143819.386254:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143819.386478:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b0b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f3ae expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.386493:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b0b40 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f3ae expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.386499:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.386501:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143819.386503:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00000100:00100000:0.0:1746143819.386521:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:1814:x1830963624299520:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6730us (6863us total) trans 8589944490 rc 0/0 00000100:00100000:0.0:1746143819.386526:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13586 00000100:00100000:0.0:1746143819.388893:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.389694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.390101:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15020 00000100:00100000:0.0:1746143819.390118:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624299904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.390127:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.390138:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b20ac600/0x87925e4cb73b0b71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f3bc expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.390183:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627218304:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143819.390237:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.390728:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.395433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.401554:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.401630:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.401646:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.401660:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.401672:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.401785:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.402830:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.402856:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.402964:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624301568 00000100:00100000:0.0:1746143819.402967:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624301568 00000100:00100000:0.0:1746143819.402983:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15028 00000100:00100000:0.0:1746143819.402987:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963624301696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.402996:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.403004:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b0bb0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f3df expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.403030:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627219712:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143819.403051:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd79180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.406390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.410974:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627219712:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143819.411002:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b0bb0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f3df expref: 36 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.411012:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b0bb0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f3df expref: 36 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.411025:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:0.0:1746143819.411048:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963624301696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8059us (8217us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143819.411054:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15028 00000100:00100000:0.0:1746143819.411134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.411148:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624302720 00000100:00100000:0.0:1746143819.411150:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624302720 00010000:00010000:0.0:1746143819.411617:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b0ae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f368 expref: 23 pid: 9586 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143819.411645:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7123 00000100:00100000:0.0:1746143819.411651:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963624302720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.411659:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.411666:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b0ae5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f368 expref: 23 pid: 9586 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143819.411674:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b0ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f368 expref: 23 pid: 9586 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143819.411701:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b0ae5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f368 expref: 23 pid: 9586 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143819.411709:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.412306:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624302720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 653us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.412313:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7123 00000100:00100000:0.0:1746143819.418099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.418286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.418305:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624303232 00000100:00100000:0.0:1746143819.418308:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624303232 00010000:00010000:0.0:1746143819.418326:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f345 expref: 34 pid: 9839 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143819.418419:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7125 00000100:00100000:0.0:1746143819.418426:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624303232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.418433:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.418441:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f345 expref: 34 pid: 9839 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143819.418450:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f345 expref: 34 pid: 9839 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143819.418463:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d3800/0x87925e4cb73b0ac2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f345 expref: 34 pid: 9839 timeout: 978 lvb_type: 1 00010000:00010000:0.0:1746143819.418484:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.418520:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624303232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.418526:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7125 00000100:00100000:0.0:1746143819.422412:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.425286:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.426500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.432366:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627220352:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143819.432393:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73b0b94 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.432403:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73b0b94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.432661:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624301312:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 30435us (31008us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.432668:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15024 00000100:00100000:0.0:1746143819.432690:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15035 00000100:00100000:0.0:1746143819.432696:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963624304256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.432703:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.432711:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b0be1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f409 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143819.432743:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627220608:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143819.432802:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd79000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.432996:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.433137:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.433158:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624304384 00000100:00100000:0.0:1746143819.433161:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624304384 00010000:00010000:0.0:1746143819.433176:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b0a9f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f322 expref: 25 pid: 9839 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143819.433196:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7130 00000100:00100000:0.0:1746143819.433202:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963624304384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.433214:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.433223:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b0a9f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f322 expref: 25 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.433232:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24400/0x87925e4cb73b0a9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1380352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f322 expref: 25 pid: 9839 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.433244:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.433246:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.433249:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b0b8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.433256:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b0b8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.433273:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.433288:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963624304384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.433300:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7130 00000100:00100000:0.0:1746143819.438155:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.440997:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.441314:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.441336:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624305280 00000100:00100000:0.0:1746143819.441344:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624305280 00010000:00010000:0.0:1746143819.441372:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b0a8a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f30d expref: 263 pid: 7243 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143819.441407:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624305152 00000100:00100000:0.0:1746143819.441409:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624305152 00010000:00010000:0.0:1746143819.441422:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73b0a91 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f314 expref: 10 pid: 7243 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143819.441436:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7132 00000100:00100000:0.0:1746143819.441443:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963624305280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.441455:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.441461:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b0a8a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f30d expref: 263 pid: 7243 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.441470:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b0a8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f30d expref: 263 pid: 7243 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.441489:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.441493:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b0bf6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.441502:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.441551:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963624305280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.441557:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7132 00000100:00100000:0.0:1746143819.441596:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7133 00000100:00100000:0.0:1746143819.441601:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624305152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.441606:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.441610:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73b0a91 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f314 expref: 10 pid: 7243 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.441617:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73b0a91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f314 expref: 10 pid: 7243 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.441627:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.441630:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b0bf6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.441634:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.441645:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624305152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.441649:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7133 00000100:00100000:0.0:1746143819.441715:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.441728:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624305408 00000100:00100000:0.0:1746143819.441731:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624305408 00010000:00010000:0.0:1746143819.441741:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73b0a7c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ff expref: 10 pid: 10936 timeout: 978 lvb_type: 0 00000100:00100000:0.0:1746143819.441756:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7134 00000100:00100000:0.0:1746143819.441761:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624305408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143819.441774:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143819.441778:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73b0a7c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ff expref: 10 pid: 10936 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.441785:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55da00/0x87925e4cb73b0a7c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f2ff expref: 10 pid: 10936 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.441795:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.441798:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b0bf6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.441804:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b0bf6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.441810:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b0bf6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.441827:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143819.441843:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624305408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.441849:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7134 00000100:00100000:0.0:1746143819.442927:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.448693:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143819.449956:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944493 is committed 00000004:00080000:0.0:1746143819.449964:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2294 committed 00000004:00080000:0.0:1746143819.449980:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2283 committed 00000004:00080000:0.0:1746143819.449986:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2282 committed 00000004:00080000:0.0:1746143819.449988:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2281 committed 00000004:00080000:0.0:1746143819.449990:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2280 committed 00000004:00080000:0.0:1746143819.449991:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2293 committed 00000004:00080000:0.0:1746143819.450001:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2279 committed 00000004:00080000:0.0:1746143819.450002:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2292 committed 00000004:00080000:0.0:1746143819.450004:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2278 committed 00000004:00080000:0.0:1746143819.450005:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2291 committed 00000004:00080000:0.0:1746143819.450007:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2290 committed 00000004:00080000:0.0:1746143819.450008:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2289 committed 00000004:00080000:0.0:1746143819.450010:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2277 committed 00000004:00080000:0.0:1746143819.450011:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2276 committed 00000004:00080000:0.0:1746143819.450012:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2288 committed 00000004:00080000:0.0:1746143819.450014:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2287 committed 00000004:00080000:0.0:1746143819.450015:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2275 committed 00000001:00080000:0.0:1746143819.450019:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944492 is committed 00000001:00080000:0.0:1746143819.450027:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944489 is committed 00000100:00100000:0.0:1746143819.451422:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627222400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.452709:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.452724:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627222912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.452862:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.452951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.452967:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624306048 00000100:00100000:0.0:1746143819.452970:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624306048 00000100:00100000:0.0:1746143819.452995:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13590 00000100:00100000:0.0:1746143819.453000:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+7:1814:x1830963624306048:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143819.453015:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.453030:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b0bfd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f41e expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.453076:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b0bfd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f41e expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.453101:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b0bfd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f41e expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.453117:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.453120:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143819.453122:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00000100:00100000:0.0:1746143819.453147:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:1814:x1830963624306048:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 148us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143819.453152:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13590 00000004:00080000:0.0:1746143819.453183:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921ce680/2, rc 0, transno 17179873683 00000100:00100000:0.0:1746143819.453186:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627222912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.453215:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800921cf800/2, rc 0, transno 17179873682 00000100:00100000:0.0:1746143819.453217:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627222400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.458031:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.467030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.469265:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.469371:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.469398:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.471526:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.484381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.486836:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.495596:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.500998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.509399:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.510801:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.517453:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143819.517473:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627223680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.517559:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.517589:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627224064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.517606:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.517619:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627224576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.517631:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143819.517646:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627225088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143819.517661:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143819.518386:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35bb80/2, rc 0, transno 21474840969 00000100:00100000:0.0:1746143819.518391:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627225088:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143819.518399:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb480/2, rc 0, transno 17179873685 00000100:00100000:0.0:1746143819.518406:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627223680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.518414:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368ebb80/2, rc 0, transno 17179873686 00000100:00100000:0.0:1746143819.518417:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627224064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143819.518423:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eaa00/2, rc 0, transno 17179873687 00000100:00100000:0.0:1746143819.518425:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627224576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.518444:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15072 00000100:00100000:0.0:1746143819.518449:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3774:x1830963627224192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.518506:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3774:x1830963627224192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (611us total) trans 17179873692 rc 0/0 00000100:00100000:0.0:1746143819.518519:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15072 00000100:00100000:0.0:1746143819.518561:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143819.518567:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627225728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.518595:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143819.519454:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322fb80/2, rc 0, transno 17179873693 00000100:00100000:0.0:1746143819.519460:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627225728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143819.523615:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624308096 00000100:00100000:0.0:1746143819.523625:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624308096 00000100:00100000:0.0:1746143819.523686:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15078 00000100:00100000:0.0:1746143819.523693:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+20:1819:x1830963624308096:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143819.523712:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.523731:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b0c74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f46b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.523763:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b0c19 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f433 expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.523771:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.523773:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.523776:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b0c74 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1818624->1949695] (req 1818624->1949695) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f46b expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.523809:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b0c19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f433 expref: 13 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.523821:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b0c19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f433 expref: 13 pid: 3134 timeout: 978 lvb_type: 1 00000100:00100000:0.0:1746143819.523833:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627225856:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143819.523952:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd79000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143819.525783:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.532403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.539268:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.548792:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.646241:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.653678:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.657718:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.658851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.658878:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.658982:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.659157:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.660832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.660846:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624310400 00000100:00100000:0.0:1746143819.660849:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624310400 00000100:00100000:0.0:1746143819.660864:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15084 00000100:00100000:0.0:1746143819.660874:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624310400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143819.660879:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.660886:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73b0cf2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f4aa expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.660895:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.660897:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143819.660901:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73b0cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f4aa expref: 36 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.661037:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30c00/0x87925e4cb73b0cf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f4aa expref: 36 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143819.661047:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30c00, rc 0) 00000100:00100000:0.0:1746143819.673354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.688690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.689026:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963624310656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15416us (15683us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143819.689034:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6385 00002000:00100000:0.0:1746143819.689044:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880095c30a80 x1830963624310656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:215/0 lens 488/440 e 0 to 0 dl 1746143830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.689053:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963624310656 ext(0->1048575) 00002000:00010000:0.0:1746143819.689058:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c30a80 00000100:00100000:0.0:1746143819.694123:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.697870:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.700515:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624311296 00000100:00100000:0.0:1746143819.700518:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624311296 00002000:00100000:0.0:1746143819.700553:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1818624->1949695) req@ffff88012e35a300 x1830963624311296/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:215/0 lens 488/0 e 0 to 0 dl 1746143830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.700561:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a300 with x1830963624311296 ext(1818624->1949695) 00010000:00010000:0.0:1746143819.700566:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b0c74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f46b expref: 21 pid: 9586 timeout: 978 lvb_type: 0 00010000:00010000:0.0:1746143819.700574:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b0c74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1818624->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f46b expref: 21 pid: 9586 timeout: 978 lvb_type: 0 00002000:00010000:0.0:1746143819.700580:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e35a300 00000100:00100000:0.0:1746143819.700603:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2424 00000100:00100000:0.0:1746143819.700608:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963624311296:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143819.704481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.704704:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.705188:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.710985:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.711043:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.721426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.721482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.727395:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.727435:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.727468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.727494:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624313344 00000100:00100000:0.0:1746143819.727504:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624313344 00002000:00100000:0.0:1746143819.727561:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095c31f80 x1830963624313344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:215/0 lens 488/0 e 0 to 0 dl 1746143830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.727572:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31f80 with x1830963624313344 ext(1048576->2097151) 00002000:00010000:0.0:1746143819.727578:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31f80 00000100:00100000:0.0:1746143819.727596:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624313472 00000100:00100000:0.0:1746143819.727599:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624313472 00002000:00100000:0.0:1746143819.727610:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095e33b80 x1830963624313472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:215/0 lens 488/0 e 0 to 0 dl 1746143830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.727617:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33b80 with x1830963624313472 ext(1048576->2097151) 00002000:00010000:0.0:1746143819.727620:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33b80 00000100:00100000:0.0:1746143819.727628:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624313728 00000100:00100000:0.0:1746143819.727630:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624313728 00002000:00100000:0.0:1746143819.727640:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095e32a00 x1830963624313728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:215/0 lens 488/0 e 0 to 0 dl 1746143830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.727646:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963624313728 ext(1048576->2097151) 00002000:00010000:0.0:1746143819.727649:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32a00 00000100:00100000:0.0:1746143819.727679:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6388 00000100:00100000:0.0:1746143819.727687:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963624313344:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143819.734292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.734316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.734338:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.746706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.750810:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.756717:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.757270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.757325:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.757374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.758015:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6393 00000100:00100000:0.0:1746143819.758023:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624315392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143819.768569:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.768632:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.775823:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963624315136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17689us (18447us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143819.775830:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6394 00002000:00100000:0.0:1746143819.775836:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095e33480 x1830963624315136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:215/0 lens 488/440 e 0 to 0 dl 1746143830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.775843:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963624315136 ext(1048576->2097151) 00002000:00010000:0.0:1746143819.775847:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:0.0:1746143819.787729:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.793431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.793542:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.803574:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.809383:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.813451:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.814285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.820665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.823151:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.830563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.830983:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.839823:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009320dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624317696:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8946us (9267us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143819.839836:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6398 00002000:00100000:0.0:1746143819.839848:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88009320dc00 x1830963624317696/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:215/0 lens 488/440 e 0 to 0 dl 1746143830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143819.839857:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009320dc00 with x1830963624317696 ext(2097152->3145727) 00002000:00010000:0.0:1746143819.839863:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009320dc00 00000100:00100000:0.0:1746143819.846989:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.855413:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.873305:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.890027:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.890087:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.892749:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6401 00000100:00100000:0.0:1746143819.892760:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624318848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143819.938979:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.965898:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.972873:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.982902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.997044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.997091:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143819.997129:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624320384 00000100:00100000:0.0:1746143819.997138:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624320384 00000100:00100000:0.0:1746143819.997196:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13602 00000100:00100000:0.0:1746143819.997204:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+266:1838:x1830963624320384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143819.997234:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143819.997256:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b0dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f536 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.997340:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997353:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997363:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997375:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997379:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997384:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997482:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997490:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997509:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143819.997518:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143819.997598:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997604:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997609:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997614:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143819.997618:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997623:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997634:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143819.997636:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143819.997640:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997644:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c400/0x87925e4cb73b0de7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997664:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997668:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997679:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997682:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997686:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143819.997688:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997693:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997699:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143819.997701:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143819.997704:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997708:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b0dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997715:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997720:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997724:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997728:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143819.997730:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997741:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997747:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b45fd00) 00010000:00010000:0.0:1746143819.997749:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143819.997750:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997754:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b0de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143819.997787:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b0dd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f536 expref: 268 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.997794:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b0dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f536 expref: 268 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143819.997800:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ca00, rc 0) 00000100:00100000:0.0:1746143819.997847:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+267:1838:x1830963624320384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 643us (754us total) trans 8589944506 rc 301/301 00000100:00100000:0.0:1746143819.997854:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13602 00000100:00100000:0.0:1746143820.008033:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143820.008608:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143820.039820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.045673:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624321408 00000100:00100000:0.0:1746143820.045690:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624321408 00000100:00100000:0.0:1746143820.045758:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15100 00000100:00100000:0.0:1746143820.045768:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:1835:x1830963624321408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143820.045801:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143820.045823:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b0dfc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f53d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.045854:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.045862:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73b0df5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3637248->4194303] (req 3637248->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f52f expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.045868:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143820.045872:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b0dfc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f53d expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.045949:0:13436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e521200/0x87925e4cb73b0df5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3637248->4194303] (req 3637248->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f52f expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.045965:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b0dfc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f53d expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.045977:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ca00, rc 0) 00000100:00100000:0.0:1746143820.049016:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:1835:x1830963624321408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1141us (4853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.049030:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15100 00000100:00100000:0.0:1746143820.052422:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.056567:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.068815:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143820.070965:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143820.072211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.083710:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.088345:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624322816 00000100:00100000:0.0:1746143820.088357:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624322816 00002000:00100000:0.0:1746143820.088404:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3604480->3608575) req@ffff880096e55f80 x1830963624322816/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:216/0 lens 488/0 e 0 to 0 dl 1746143831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143820.088414:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55f80 with x1830963624322816 ext(3604480->3608575) 00002000:00010000:0.0:1746143820.088420:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e55f80 00000100:00100000:0.0:1746143820.088450:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6404 00000100:00100000:0.0:1746143820.088458:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624322816:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143820.088616:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624322816:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 157us (479us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143820.088624:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6404 00002000:00100000:0.0:1746143820.088631:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3604480->3608575) req@ffff880096e55f80 x1830963624322816/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:216/0 lens 488/4536 e 0 to 0 dl 1746143831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143820.088637:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55f80 with x1830963624322816 ext(3604480->3608575) 00002000:00010000:0.0:1746143820.088640:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e55f80 00000100:00100000:0.0:1746143820.092682:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.093924:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.112770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.118125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.134025:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.140688:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.152556:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.153592:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.160843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.163435:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.165890:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.171786:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.177252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.180212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.182370:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.192340:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.196125:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.196166:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.196466:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15105 00000100:00100000:0.0:1746143820.196521:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624326144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143820.196551:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143820.196567:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c528000/0x87925e4cb73b0e49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f567 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143820.196617:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627230464:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143820.197289:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143820.200121:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627230464:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143820.200151:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c528000/0x87925e4cb73b0e49 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f567 expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143820.200163:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c528000/0x87925e4cb73b0e49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f567 expref: 24 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143820.200188:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c528000, rc 0) 00000100:00100000:0.0:1746143820.200228:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624326144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3752us (4109us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143820.200236:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15105 00000100:00100000:0.0:1746143820.212458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.212965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.217351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.218881:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.226554:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.237075:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.246559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.266010:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.266967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.268940:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.282471:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.285137:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.289590:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.289616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.289644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.289683:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.289705:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624328832 00000100:00100000:0.0:1746143820.289711:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624328832 00002000:00100000:0.0:1746143820.289743:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880136acb100 x1830963624328832/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:216/0 lens 488/0 e 0 to 0 dl 1746143831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143820.289751:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963624328832 ext(2097152->4194303) 00010000:00010000:0.0:1746143820.289758:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4400/0x87925e4cb73b0e88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f591 expref: 27 pid: 13436 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.289770:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4400/0x87925e4cb73b0e88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f591 expref: 27 pid: 13436 timeout: 979 lvb_type: 0 00002000:00010000:0.0:1746143820.289776:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143820.289803:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624328960 00000100:00100000:0.0:1746143820.289806:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624328960 00002000:00100000:0.0:1746143820.289820:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880136aca300 x1830963624328960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:216/0 lens 488/0 e 0 to 0 dl 1746143831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143820.289825:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136aca300 with x1830963624328960 ext(3145728->4194303) 00002000:00010000:0.0:1746143820.289828:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136aca300 00000100:00100000:0.0:1746143820.289839:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2434 00000100:00100000:0.0:1746143820.289845:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963624328832:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143820.290855:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6411 00000100:00100000:0.0:1746143820.290862:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963624328960:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143820.312472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.316634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.317454:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.324271:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.327491:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624330240 00000100:00100000:0.0:1746143820.327497:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624330240 00002000:00100000:0.0:1746143820.327524:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2662400->2666495) req@ffff8801373b9180 x1830963624330240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:216/0 lens 488/0 e 0 to 0 dl 1746143831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143820.327540:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963624330240 ext(2662400->2666495) 00002000:00010000:0.0:1746143820.327545:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b9180 00000100:00100000:0.0:1746143820.327571:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6415 00000100:00100000:0.0:1746143820.327578:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624330240:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143820.327669:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624330240:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 92us (973us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143820.327683:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6415 00002000:00100000:0.0:1746143820.327688:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2662400->2666495) req@ffff8801373b9180 x1830963624330240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:216/0 lens 488/4536 e 0 to 0 dl 1746143831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143820.327694:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963624330240 ext(2662400->2666495) 00002000:00010000:0.0:1746143820.327697:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373b9180 00000100:00100000:0.0:1746143820.328513:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.338960:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.338987:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.339016:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.342804:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.343856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.344972:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624331264 00000100:00100000:0.0:1746143820.344976:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624331264 00010000:00010000:0.0:1746143820.344991:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73b0e81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f58a expref: 26 pid: 13436 timeout: 979 lvb_type: 0 00000100:00100000:0.0:1746143820.345009:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7160 00000100:00100000:0.0:1746143820.345014:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624331264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143820.345021:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143820.345032:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73b0e81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f58a expref: 26 pid: 13436 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.345041:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73b0e81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f58a expref: 26 pid: 13436 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.345066:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32600/0x87925e4cb73b0e81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f58a expref: 26 pid: 13436 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.345079:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.345080:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.345083:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b0edc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3186687] (req 3145728->3186687) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5c9 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.345090:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b0edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3186687] (req 3145728->3186687) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5c9 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.345113:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b0edc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3186687] (req 3145728->3186687) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5c9 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143820.345123:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627232128:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143820.345177:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143820.350354:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627232128:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143820.350370:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143820.350420:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624331264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5404us (5942us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.350429:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7160 00000100:00100000:0.0:1746143820.350967:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624331904 00000100:00100000:0.0:1746143820.350970:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624331904 00010000:00010000:0.0:1746143820.350986:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091381800/0x87925e4cb73b0e8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f598 expref: 29 pid: 9587 timeout: 979 lvb_type: 0 00000100:00100000:0.0:1746143820.351015:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7161 00000100:00100000:0.0:1746143820.351021:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963624331904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143820.351031:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143820.351046:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091381800/0x87925e4cb73b0e8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f598 expref: 29 pid: 9587 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.351056:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091381800/0x87925e4cb73b0e8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f598 expref: 29 pid: 9587 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.351075:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091381800/0x87925e4cb73b0e8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2662400->3145727] (req 2662400->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f598 expref: 29 pid: 9587 timeout: 979 lvb_type: 0 00010000:00010000:0.0:1746143820.351087:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.351088:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.351094:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73b0ece lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5bb expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.351101:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73b0ece lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5bb expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.351125:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73b0ece lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5bb expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143820.351135:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627232256:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143820.351182:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143820.354340:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.360084:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.364664:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15119 00000100:00100000:0.0:1746143820.364673:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624332672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143820.364689:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143820.364704:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091381000/0x87925e4cb73b0eea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f5de expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.364723:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.364725:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.364732:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091381000/0x87925e4cb73b0eea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5de expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143820.364745:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091381000/0x87925e4cb73b0eea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f5de expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143820.364754:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381000, rc 0) 00000100:00100000:0.0:1746143820.364792:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624332672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 120us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.365006:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15119 00000100:00100000:0.0:1746143820.367999:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.371831:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.373678:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.375448:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.385647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.398272:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.398320:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.401951:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6420 00000100:00100000:0.0:1746143820.401970:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963624333952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143820.424801:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.445082:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.481306:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.484763:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.488735:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.496953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.501988:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.503696:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.503735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.508752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.513431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.517966:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.517996:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.518029:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143820.519348:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143820.521371:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.525280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.575903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.583817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.592995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.595956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.610964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.620522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.620568:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.622569:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143820.624615:0:9587:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143820 -> 1746143821 00002000:00010000:0.0:1746143820.624618:0:9587:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143819 -> 1746143820 00002000:00010000:0.0:1746143820.624626:0:9587:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143820 -> 1746143821 00000100:00100000:0.0:1746143820.624637:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627234048:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143820.624658:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b0f84 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f624 expref: 28 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143820.624668:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b0f84 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f624 expref: 28 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143820.625627:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f400, rc 0) 00000100:00100000:0.0:1746143820.625673:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624338560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5006us (5155us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143820.625680:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15127 00000100:00100000:0.0:1746143820.626073:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627234176:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143820.626090:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143820.626231:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963624338816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3452us (3664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.626239:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7170 00000100:00100000:0.0:1746143820.635187:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.635232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.640640:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.652200:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.655939:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.666291:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.672737:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.676163:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.676208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.679898:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624340736 00000100:00100000:0.0:1746143820.679904:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624340736 00000100:00100000:0.0:1746143820.679951:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13610 00000100:00100000:0.0:1746143820.679957:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:1868:x1830963624340736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143820.679974:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143820.679984:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73b0fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f640 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.680323:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680331:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680338:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680347:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680352:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680357:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680421:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801321a4200/0x87925e4cb73b0fbc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680427:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801321a4200/0x87925e4cb73b0fbc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680433:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801321a4200/0x87925e4cb73b0fbc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143820.680447:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143820.680478:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680483:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680488:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680493:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680498:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7d200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143820.680502:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680507:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680514:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143820.680516:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143820.680519:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680532:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b0fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680543:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680547:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680558:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680562:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7ca00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143820.680565:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680569:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680575:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b11700) 00010000:00010000:0.0:1746143820.680577:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143820.680579:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680583:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ca00/0x87925e4cb73b0fb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143820.680607:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c800/0x87925e4cb73b0fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f640 expref: 275 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.680615:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801321a4200/0x87925e4cb73b0fbc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f640 expref: 274 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.680620:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143820.680622:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143820.680623:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801321a4200, rc 0) 00000100:00100000:0.0:1746143820.680651:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+274:1868:x1830963624340736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 694us (833us total) trans 8589944524 rc 0/0 00000100:00100000:0.0:1746143820.680656:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13610 00000100:00100000:0.0:1746143820.685579:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.685855:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.685883:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.685907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.687677:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.693196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.695954:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627235456:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.695976:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.695990:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3773:1830963627235968:0@lo:400:kworker.0 00000100:00080000:0.0:1746143820.697499:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746143820.697502:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746143820.697504:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143820.697505:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143820.697520:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.697549:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627236480:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.697568:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.697581:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746143820.697586:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963627235584:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.697718:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.697732:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963627236096:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.697748:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.697759:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627236608:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.697773:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.697794:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627235968 00000100:00100000:0.0:1746143820.697797:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627235968 00000100:00100000:0.0:1746143820.697816:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627235584 00000100:00100000:0.0:1746143820.697818:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627235584 00000100:00100000:0.0:1746143820.697835:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627236096 00000100:00100000:0.0:1746143820.697838:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627236096 00000100:00100000:0.0:1746143820.697847:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1746143820.697852:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3773:x1830963627235968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.697877:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3773:x1830963627235968:12345-0@lo:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.697882:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1746143820.697890:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1746143820.697894:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963627235584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.697928:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963627235584:12345-0@lo:400:kworker.0 Request processed in 17us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.697933:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1746143820.697997:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1746143820.698001:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963627236096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.698023:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963627236096:12345-0@lo:400:kworker.0 Request processed in 22us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.698028:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:0.0:1746143820.698040:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746143820.698042:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143820.698060:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963627235584:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.698067:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963627236096:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.699693:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627235456:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.699704:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3773:1830963627235968:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.699713:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627236480:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.699745:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627236608:0@lo:400:kworker.0 00000100:00100000:0.0:1746143820.708738:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.709321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.712498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.713110:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.720556:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.720591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.720627:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.729437:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.750067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.752926:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.757735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.759807:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.762348:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.772388:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.774873:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.790763:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.790852:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.813498:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.821488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.838586:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.840475:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624346752 00000100:00100000:0.0:1746143820.840481:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624346752 00000100:00100000:0.0:1746143820.840541:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13611 00000100:00100000:0.0:1746143820.840548:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:1872:x1830963624346752:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143820.840565:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143820.840584:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3800/0x87925e4cb73b1017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f694 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.840665:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840677:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840690:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840702:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840708:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840713:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840803:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b102c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840812:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b102c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840818:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b102c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143820.840825:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143820.840880:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840886:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840898:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840903:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840909:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096f6d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143820.840952:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840959:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840970:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143820.840973:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143820.840977:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.840981:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b101e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841009:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841015:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841019:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841023:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143820.841025:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841037:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841043:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e624800) 00010000:00010000:0.0:1746143820.841045:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143820.841047:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841051:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408d400/0x87925e4cb73b1025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143820.841087:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3800/0x87925e4cb73b1017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f694 expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.841097:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b102c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f694 expref: 25 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.841103:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143820.841105:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143820.841107:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c600, rc 0) 00000100:00100000:0.0:1746143820.841151:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:1872:x1830963624346752:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 603us (728us total) trans 8589944526 rc 0/0 00000100:00100000:0.0:1746143820.841157:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13611 00000100:00100000:0.0:1746143820.844240:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.869898:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.871016:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143820.871030:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627238016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143820.871078:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143820.871295:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627238016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143820.884709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.939310:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.952219:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.954067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.954875:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.954960:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.954980:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624348288 00000100:00100000:0.0:1746143820.954983:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624348288 00000100:00100000:0.0:1746143820.955020:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5157 00000100:00100000:0.0:1746143820.955026:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:1879:x1830963624348288:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143820.955159:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:1879:x1830963624348288:12345-192.168.202.3@tcp:35:cat.0 Request processed in 133us (198us total) trans 8589944530 rc 0/0 00000100:00100000:0.0:1746143820.955164:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5157 00000100:00100000:0.0:1746143820.956582:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.958274:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.961329:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.966981:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.967099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.967122:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624349056 00000100:00100000:0.0:1746143820.967130:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624349056 00010000:00010000:0.0:1746143820.967166:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b1010 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f68d expref: 33 pid: 9586 timeout: 980 lvb_type: 1 00000100:00100000:0.0:1746143820.967203:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624349184 00000100:00100000:0.0:1746143820.967206:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624349184 00010000:00010000:0.0:1746143820.967217:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b0fe6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f663 expref: 41 pid: 12327 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143820.967252:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7181 00000100:00100000:0.0:1746143820.967260:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963624349056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143820.967275:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143820.967297:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b1010 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f68d expref: 33 pid: 9586 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143820.967308:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b1010 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f68d expref: 33 pid: 9586 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143820.967335:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143820.967377:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963624349056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.967384:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7181 00000100:00100000:0.0:1746143820.967399:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7182 00000100:00100000:0.0:1746143820.967403:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963624349184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143820.967409:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143820.967415:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b0fe6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f663 expref: 41 pid: 12327 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143820.967423:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b0fe6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f663 expref: 41 pid: 12327 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143820.967434:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.967436:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.967448:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b108e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6b7 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.967456:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b108e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6b7 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.967487:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b108e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6b7 expref: 41 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143820.967500:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627238784:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143820.967567:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143820.968965:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.969751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.970018:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15145 00000100:00100000:0.0:1746143820.970027:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+34:1872:x1830963624349440:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143820.970035:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143820.970044:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b109c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f6c5 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.970059:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b1002 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f67f expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.970067:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73b1009 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f686 expref: 39 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.970072:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.970074:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.970085:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b109c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->2621439] (req 2097152->2621439) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6c5 expref: 35 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.970100:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73b1009 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f686 expref: 39 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.970107:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c47c200/0x87925e4cb73b1009 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f686 expref: 39 pid: 9587 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143820.970115:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094196d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627239040:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143820.970761:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b1002 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f67f expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.970777:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b1002 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f67f expref: 35 pid: 9587 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143820.970788:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627239168:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143820.970835:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143820.971609:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627238784:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143820.971626:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143820.971668:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963624349184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4262us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143820.971677:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7182 00000100:00100000:0.0:1746143820.972754:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.978692:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.978746:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.979649:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7184 00000100:00100000:0.0:1746143820.979665:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963624349952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143820.979681:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143820.979703:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b1002 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f67f expref: 34 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143820.979716:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b1002 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f67f expref: 34 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143820.979737:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b1002 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f67f expref: 34 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143820.979759:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.979761:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143820.979766:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b109c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2621439) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6c5 expref: 33 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.979773:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b109c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2621439) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6c5 expref: 33 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143820.979801:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b109c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2621439) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6c5 expref: 33 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143820.979812:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627239296:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143820.980745:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143820.980833:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.980886:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.986464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.989300:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.995505:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143820.995579:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.000611:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.002089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.022741:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.025439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143821.025931:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143821.030112:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963624352000:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4109us (4665us total) trans 17179873701 rc 0/0 00000100:00100000:0.0:1746143821.030123:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2444 00002000:00100000:0.0:1746143821.030134:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1253375) req@ffff880095c6a300 x1830963624352000/t17179873701(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:217/0 lens 488/448 e 0 to 0 dl 1746143832 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143821.030142:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963624352000 ext(1048576->1253375) 00010000:00010000:0.0:1746143821.030151:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b10a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6cc expref: 45 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.030164:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b10a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6cc expref: 45 pid: 12328 timeout: 980 lvb_type: 0 00002000:00010000:0.0:1746143821.030171:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c6a300 00000100:00100000:0.0:1746143821.033448:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.039368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.052705:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.057107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.061870:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963624352640:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4343us (4763us total) trans 17179873702 rc 0/0 00000100:00100000:0.0:1746143821.061885:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2445 00002000:00100000:0.0:1746143821.061894:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2998272->3145727) req@ffff880095c68000 x1830963624352640/t17179873702(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:217/0 lens 488/448 e 0 to 0 dl 1746143832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143821.061902:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963624352640 ext(2998272->3145727) 00010000:00010000:0.0:1746143821.061976:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73b105d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2998272->3178495] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6a2 expref: 32 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.061990:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73b105d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2998272->3178495] (req 2998272->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6a2 expref: 32 pid: 9587 timeout: 980 lvb_type: 0 00002000:00010000:0.0:1746143821.061996:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c68000 00000100:00100000:0.0:1746143821.062979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143821.063380:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143821.063753:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.068579:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.068820:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.068851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.068878:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.068894:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624353280 00000100:00100000:0.0:1746143821.068900:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624353280 00000100:00100000:0.0:1746143821.068953:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624353408 00000100:00100000:0.0:1746143821.068955:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624353408 00000100:00100000:0.0:1746143821.068965:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624353536 00000100:00100000:0.0:1746143821.068967:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624353536 00000100:00100000:0.0:1746143821.068977:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15149 00000100:00100000:0.0:1746143821.068982:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963624353280:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143821.068996:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.069015:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b10db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f6e8 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.069039:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.069040:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.069047:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b10db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6e8 expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143821.069061:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b10db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6e8 expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143821.069071:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53c00, rc 0) 00000100:00100000:0.0:1746143821.069097:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963624353280:12345-192.168.202.3@tcp:101:cat.0 Request processed in 114us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.069102:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15149 00000100:00100000:0.0:1746143821.069114:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15151 00000100:00100000:0.0:1746143821.069118:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963624353536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143821.069124:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.069129:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b10e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f6f6 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.069137:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.069139:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.069143:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b10e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6f6 expref: 47 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143821.069151:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b10e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6f6 expref: 47 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143821.069166:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53800, rc 0) 00000100:00100000:0.0:1746143821.069182:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963624353536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.069187:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15151 00000100:00100000:0.0:1746143821.091428:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.092234:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.092279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.101119:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.111860:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.120894:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.130037:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143821.130792:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143821.132655:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.133384:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.133401:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624355968 00000100:00100000:0.0:1746143821.133404:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624355968 00000100:00100000:0.0:1746143821.133617:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 897 00000100:00100000:0.0:1746143821.133623:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2011:x1830963624355968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.133630:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.133640:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b1121 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f719 expref: 30 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.133658:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.133661:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.133680:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624355968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.133693:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 897 00000100:00100000:0.0:1746143821.134021:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.138584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.155046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.160647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.167391:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.170192:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.178128:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.179217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.179238:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.192812:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.194054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.194070:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624358144 00000100:00100000:0.0:1746143821.194073:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624358144 00010000:00010000:0.0:1746143821.194088:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b10b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6da expref: 30 pid: 12328 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.194117:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7193 00000100:00100000:0.0:1746143821.194123:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963624358144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.194131:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.194139:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b10b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6da expref: 30 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.194148:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b10b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6da expref: 30 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.194160:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b10b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6da expref: 30 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.194178:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.194193:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963624358144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.194199:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7193 00000100:00100000:0.0:1746143821.197673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.204074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.208182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.216178:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.246249:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.250745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.263696:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.267967:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.295600:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.298342:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6455 00000100:00100000:0.0:1746143821.317030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.323703:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.327076:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.330323:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.336588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.336778:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.336824:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.340571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.346162:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.346905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.355690:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.355725:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.355777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.356140:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 900 00000100:00100000:0.0:1746143821.356147:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+283:2010:x1830963624362240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.356157:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.356172:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b11ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f758 expref: 283 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.356187:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.356191:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.356209:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+282:2010:x1830963624362240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.356214:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 900 00000100:00100000:0.0:1746143821.361964:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.362219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.372573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.378899:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.378982:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.390142:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.394093:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.394141:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.398272:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963624363776:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3952us (4181us total) trans 17179873704 rc 0/0 00000100:00100000:0.0:1746143821.398282:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2449 00002000:00100000:0.0:1746143821.398292:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3727360->4194303) req@ffff8800972e9180 x1830963624363776/t17179873704(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:217/0 lens 488/448 e 0 to 0 dl 1746143832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143821.398299:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9180 with x1830963624363776 ext(3727360->4194303) 00010000:00010000:0.0:1746143821.398314:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b116e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f743 expref: 33 pid: 12327 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.398326:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b116e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3727360->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f743 expref: 33 pid: 12327 timeout: 980 lvb_type: 0 00002000:00010000:0.0:1746143821.398330:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972e9180 00000100:00100000:0.0:1746143821.403626:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.409232:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.415900:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.416221:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.419791:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.436398:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627243008:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143821.436426:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.436468:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2010:x1830963624365056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4918us (5181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.436478:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7201 00000100:00100000:0.0:1746143821.441805:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.447354:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.448856:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624366208 00000100:00100000:0.0:1746143821.448861:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624366208 00000100:00100000:0.0:1746143821.448897:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 901 00000100:00100000:0.0:1746143821.448903:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963624366208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.448929:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.448947:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b11fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f782 expref: 285 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.448984:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.448987:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.449010:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963624366208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 107us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.449016:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 901 00000100:00100000:0.0:1746143821.454723:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.464669:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.467280:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.488733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.488817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.497048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.523514:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.539472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143821.539704:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143821.543789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.546071:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.550212:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.550299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.550619:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.550807:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.556321:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.559311:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.562569:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.564898:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.569669:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624370560 00000100:00100000:0.0:1746143821.569678:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624370560 00000100:00100000:0.0:1746143821.569746:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13623 00000100:00100000:0.0:1746143821.569754:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:1905:x1830963624370560:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143821.569774:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.569793:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73b1286 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f7dd expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.569900:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086600/0x87925e4cb73b128d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143821.569950:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082086600/0x87925e4cb73b128d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143821.569962:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082086600/0x87925e4cb73b128d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143821.570300:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000100:00100000:0.0:1746143821.573264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.573612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.574205:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.574280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.574309:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.574330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.585285:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624372480 00000100:00100000:0.0:1746143821.585290:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624372480 00010000:00010000:0.0:1746143821.585323:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7cc00/0x87925e4cb73b125c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7c1 expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00000100:00100000:0.0:1746143821.585352:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7207 00000100:00100000:0.0:1746143821.585357:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2010:x1830963624372480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.585367:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.585386:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d7cc00/0x87925e4cb73b125c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7c1 expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.585397:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d7cc00/0x87925e4cb73b125c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7c1 expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.585419:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7cc00/0x87925e4cb73b125c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7c1 expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.585446:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.585655:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963624372480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 297us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.585661:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7207 00000100:00100000:0.0:1746143821.585708:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624372736 00000100:00100000:0.0:1746143821.585712:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624372736 00010000:00010000:0.0:1746143821.585721:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73b1247 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7ba expref: 16 pid: 12327 timeout: 980 lvb_type: 1 00000100:00100000:0.0:1746143821.585736:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7208 00000100:00100000:0.0:1746143821.585740:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963624372736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.585864:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.585873:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73b1247 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7ba expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.585881:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73b1247 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7ba expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.585896:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7fa00/0x87925e4cb73b1247 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f7ba expref: 17 pid: 12327 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.585904:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.585941:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963624372736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 199us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.585947:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7208 00000100:00100000:0.0:1746143821.585975:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.586341:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7213 00000100:00100000:0.0:1746143821.586348:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2011:x1830963624373120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.586356:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.586364:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3800/0x87925e4cb73b10aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6d3 expref: 32 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.586372:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d3800/0x87925e4cb73b10aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6d3 expref: 32 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.586383:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3800/0x87925e4cb73b10aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6d3 expref: 32 pid: 12328 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.586391:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.586393:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.586395:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73b12a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.586484:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ace00/0x87925e4cb73b12a9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.586500:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.586524:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624373120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 168us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.586530:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7213 00000100:00100000:0.0:1746143821.586571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.586581:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624373504 00000100:00100000:0.0:1746143821.586584:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624373504 00010000:00010000:0.0:1746143821.586594:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b1095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6be expref: 36 pid: 9587 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.586608:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7217 00000100:00100000:0.0:1746143821.586612:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963624373504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.586617:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.586626:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b1095 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6be expref: 36 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.586634:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b1095 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6be expref: 36 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.586647:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b1095 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f6be expref: 36 pid: 9587 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.586655:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.586670:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2009:x1830963624373504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.586679:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7217 00000100:00100000:0.0:1746143821.586789:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.586822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.586842:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7219 00000100:00100000:0.0:1746143821.586847:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963624371584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.586854:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.586861:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b0ccf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f487 expref: 48 pid: 9586 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.586869:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b0ccf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f487 expref: 48 pid: 9586 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.586880:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b0ccf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f487 expref: 48 pid: 9586 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.586887:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.586889:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.586891:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73b129b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.586897:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7c600/0x87925e4cb73b129b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.586925:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.586943:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963624371584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 96us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.586949:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7219 00000100:00100000:0.0:1746143821.586983:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.586992:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624372096 00000100:00100000:0.0:1746143821.586994:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624372096 00010000:00010000:0.0:1746143821.587003:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1152 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f727 expref: 45 pid: 12327 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.587015:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7221 00000100:00100000:0.0:1746143821.587019:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624372096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.587025:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.587031:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1152 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f727 expref: 45 pid: 12327 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587038:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1152 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f727 expref: 45 pid: 12327 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587047:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1152 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f727 expref: 45 pid: 12327 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587054:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.587067:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963624372096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.587072:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7221 00000100:00100000:0.0:1746143821.587091:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624373376 00000100:00100000:0.0:1746143821.587093:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624373376 00010000:00010000:0.0:1746143821.587100:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4e00/0x87925e4cb73b0d54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f4e9 expref: 35 pid: 13436 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.587110:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624373632 00000100:00100000:0.0:1746143821.587113:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624373632 00010000:00010000:0.0:1746143821.587121:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b121d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f79e expref: 44 pid: 9585 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.587133:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7223 00000100:00100000:0.0:1746143821.587136:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963624373632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.587141:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.587147:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b121d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f79e expref: 45 pid: 9585 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587155:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b121d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f79e expref: 45 pid: 9585 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587164:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b121d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f79e expref: 45 pid: 9585 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587172:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.587184:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963624373632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.587189:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7223 00000100:00100000:0.0:1746143821.587196:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624373888 00000100:00100000:0.0:1746143821.587198:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624373888 00010000:00010000:0.0:1746143821.587205:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b1216 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f797 expref: 35 pid: 9585 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.587218:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7225 00000100:00100000:0.0:1746143821.587222:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2011:x1830963624373888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.587230:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.587236:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b1216 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f797 expref: 34 pid: 9585 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587244:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b1216 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f797 expref: 34 pid: 9585 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587254:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b1216 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f797 expref: 34 pid: 9585 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.587262:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.587263:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.587266:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b12b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.587272:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b12b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.587284:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.587292:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2011:x1830963624373888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.587296:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7225 00000100:00100000:0.0:1746143821.590257:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.592718:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.593626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.593654:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.593670:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624374656 00000100:00100000:0.0:1746143821.593673:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624374656 00010000:00010000:0.0:1746143821.593692:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c600/0x87925e4cb73b102c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f694 expref: 34 pid: 14991 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.593853:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624374528 00000100:00100000:0.0:1746143821.593856:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624374528 00010000:00010000:0.0:1746143821.594013:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b0c6d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f464 expref: 33 pid: 10936 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.594028:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7227 00000100:00100000:0.0:1746143821.594033:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963624374528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.594039:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.594042:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b0c6d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f464 expref: 33 pid: 10936 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.594049:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b0c6d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f464 expref: 33 pid: 10936 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.594059:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b0c6d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f464 expref: 33 pid: 10936 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.594067:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.594070:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7cc00/0x87925e4cb73b12c5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143821.594075:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.594087:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963624374528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.594093:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7227 00000100:00100000:0.0:1746143821.595262:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.600359:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627247232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.600389:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.600407:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627247744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.600425:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.600441:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627248256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.600455:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.600464:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627248768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.600479:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143821.600503:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143821.600507:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143821.600530:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627248896 00000100:00100000:0.0:1746143821.600534:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627248896 00000100:00100000:0.0:1746143821.600558:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15185 00000100:00100000:0.0:1746143821.600564:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:3771:x1830963627247488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143821.600667:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143821.600670:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.600672:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143821.600674:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.600676:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143821.600710:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3771:x1830963627247488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (307us total) trans 21474840989 rc 0/0 00000100:00100000:0.0:1746143821.600715:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15185 00000100:00100000:0.0:1746143821.600729:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15189 00000100:00100000:0.0:1746143821.600733:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3773:x1830963627248768:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143821.600768:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136336680/2, rc 0, transno 17179873706 00000100:00100000:0.0:1746143821.600789:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627247232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143821.600797:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136336d80/2, rc 0, transno 17179873708 00000100:00100000:0.0:1746143821.600800:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627248256:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143821.600846:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143821.600849:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.600851:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143821.600853:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.600854:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143821.600890:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3773:x1830963627248768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (410us total) trans 17179873710 rc 0/0 00000100:00100000:0.0:1746143821.600898:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15189 00000100:00100000:0.0:1746143821.600932:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627248512 00000100:00100000:0.0:1746143821.600935:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627248512 00000100:00100000:0.0:1746143821.600949:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627247616 00000100:00100000:0.0:1746143821.600951:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627247616 00000100:00100000:0.0:1746143821.600958:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15192 00000100:00100000:0.0:1746143821.600962:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3771:x1830963627248512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.601023:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3771:x1830963627248512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (160us total) trans 17179873711 rc 0/0 00000100:00100000:0.0:1746143821.601029:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15192 00000004:00080000:0.0:1746143821.601050:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb5500/2, rc 0, transno 21474840993 00000100:00100000:0.0:1746143821.601053:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627247744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143821.601060:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136337b80/2, rc 0, transno 17179873710 00000100:00100000:0.0:1746143821.601063:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627248768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.601124:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3771:x1830963627246976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 568us (769us total) trans 21474840990 rc 0/0 00000100:00100000:0.0:1746143821.601129:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15183 00000100:00100000:0.0:1746143821.601140:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627249024 00000100:00100000:0.0:1746143821.601142:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627249024 00000100:00100000:0.0:1746143821.601153:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15198 00000100:00100000:0.0:1746143821.601157:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3772:x1830963627249024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.601213:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3772:x1830963627249024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (76us total) trans 17179873714 rc 0/0 00000100:00100000:0.0:1746143821.601218:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15198 00000100:00100000:0.0:1746143821.601255:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3774:x1830963627247360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 708us (876us total) trans 21474840991 rc 0/0 00000100:00100000:0.0:1746143821.601260:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15182 00000100:00100000:0.0:1746143821.606373:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.610530:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.610562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.610583:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.610607:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.610619:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.610705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.615059:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.615507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.615544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.615608:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.615621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.615642:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.616005:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15210 00000100:00100000:0.0:1746143821.616010:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963624376576:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143821.616040:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963624376576:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.616047:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15210 00000100:00100000:0.0:1746143821.618851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.618888:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.618969:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.618983:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.618994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.619015:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.623206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.626671:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.634114:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624377984 00000100:00100000:0.0:1746143821.634122:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624377984 00000100:00100000:0.0:1746143821.634182:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6468 00000100:00100000:0.0:1746143821.634188:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963624377984:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143821.634457:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130e29a00/0x87925e4cb73b130b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.634470:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.634471:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.634476:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e29a00/0x87925e4cb73b130b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.634487:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e29a00/0x87925e4cb73b130b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143821.650171:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.650202:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.651343:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.664565:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963624379520:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 12842us (13153us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143821.664574:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6474 00000100:00100000:0.0:1746143821.672638:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.675221:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.678045:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.680460:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.682316:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.684129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.685818:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.687383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.689792:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.693603:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.695806:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.695943:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7234 00000100:00100000:0.0:1746143821.695952:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2009:x1830963624381312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.695963:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.695984:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d85200/0x87925e4cb73b12e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f80e expref: 16 pid: 3135 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.695995:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d85200/0x87925e4cb73b12e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f80e expref: 16 pid: 3135 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.696015:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d85200/0x87925e4cb73b12e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f80e expref: 16 pid: 3135 timeout: 980 lvb_type: 1 00010000:00010000:0.0:1746143821.696029:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.696031:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.696038:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b1366 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f838 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.696046:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b1366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f838 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.696070:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b1366 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f838 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143821.696080:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cf8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627250304:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143821.696134:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143821.697556:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.699278:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.700950:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.700965:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.700991:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.701008:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624382208 00000100:00100000:0.0:1746143821.701011:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624382208 00000100:00100000:0.0:1746143821.701041:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15225 00000100:00100000:0.0:1746143821.701047:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2009:x1830963624381696:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143821.701165:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143821.701168:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143819 -> 1746143821 00002000:00010000:0.0:1746143821.701171:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143819 -> 1746143821 00002000:00010000:0.0:1746143821.701173:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143819 -> 1746143822 00002000:00010000:0.0:1746143821.701175:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:0.0:1746143821.701196:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963624381696:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 149us (247us total) trans 17179873716 rc 0/0 00000100:00100000:0.0:1746143821.701206:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15225 00000100:00100000:0.0:1746143821.701235:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.701243:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624381824 00000100:00100000:0.0:1746143821.701245:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624381824 00000100:00100000:0.0:1746143821.701259:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15228 00000100:00100000:0.0:1746143821.701263:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2009:x1830963624381824:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143821.701303:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143821.701305:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143819 -> 1746143821 00002000:00010000:0.0:1746143821.701307:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143819 -> 1746143821 00002000:00010000:0.0:1746143821.701309:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143819 -> 1746143822 00002000:00010000:0.0:1746143821.701311:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143821.701326:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963624381824:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 62us (90us total) trans 21474840999 rc 0/0 00000100:00100000:0.0:1746143821.701331:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15228 00000100:00100000:0.0:1746143821.701571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.704371:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.706244:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.711243:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627252224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.713045:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.713067:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627252736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.713087:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.713175:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143821.713180:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627252864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.713332:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.713351:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627252864 00000100:00100000:0.0:1746143821.713354:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627252864 00000100:00100000:0.0:1746143821.713528:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15247 00000100:00100000:0.0:1746143821.713534:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3771:x1830963627252864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.713658:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+87:3771:x1830963627252864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (458us total) trans 17179873726 rc 0/0 00000100:00100000:0.0:1746143821.713663:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15247 00000004:00080000:0.0:1746143821.713681:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093416300/2, rc 0, transno 17179873726 00000100:00100000:0.0:1746143821.713684:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627252864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143821.713691:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093cf9880/2, rc 0, transno 17179873725 00000100:00100000:0.0:1746143821.713693:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627252224:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143821.713699:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129dc2d80/2, rc 0, transno 17179873727 00000100:00100000:0.0:1746143821.713701:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627252736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.717626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.720745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.734767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.737706:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.741535:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.741587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.745510:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624384256 00000100:00100000:0.0:1746143821.745522:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624384256 00010000:00010000:0.0:1746143821.745537:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73b1397 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f84d expref: 11 pid: 7244 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.745562:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7238 00000100:00100000:0.0:1746143821.745566:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624384256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143821.745573:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143821.745578:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73b1397 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f84d expref: 11 pid: 7244 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.745586:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73b1397 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f84d expref: 11 pid: 7244 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.745598:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369a00/0x87925e4cb73b1397 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f84d expref: 11 pid: 7244 timeout: 980 lvb_type: 0 00010000:00010000:0.0:1746143821.745672:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.745676:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73b13c1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143821.745683:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73b13c1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143821.745688:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d800/0x87925e4cb73b13c1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143821.745705:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143821.745725:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624384256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 158us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.745730:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7238 00000100:00100000:0.0:1746143821.748593:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624384512 00000100:00100000:0.0:1746143821.748597:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624384512 00000100:00100000:0.0:1746143821.748654:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13632 00000100:00100000:0.0:1746143821.748660:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:1915:x1830963624384512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143821.748670:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.748679:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b13eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f870 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.748731:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b13eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f870 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.748741:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b13eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f870 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.748757:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.748759:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143821.748762:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db400, rc 0) 00000100:00100000:0.0:1746143821.748780:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:1915:x1830963624384512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 121us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.748786:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13632 00000100:00100000:0.0:1746143821.749217:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.751037:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.754155:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624385536 00000100:00100000:0.0:1746143821.754159:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624385536 00000100:00100000:0.0:1746143821.754201:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13635 00000100:00100000:0.0:1746143821.754207:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:1910:x1830963624385536:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143821.754219:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.754222:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746143821.754243:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24000/0x87925e4cb73b1415 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f87e expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754261:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b13eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f870 expref: 11 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754270:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.754274:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143821.754282:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b141c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f885 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754320:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143821.754331:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b13cf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f85b expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754339:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b137b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f846 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754344:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143821.754371:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b137b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f846 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754381:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b137b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f846 expref: 7 pid: 7244 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.754392:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627253376:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143821.754867:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b13cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f85b expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.754876:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b13cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f85b expref: 262 pid: 7244 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.754884:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627253504:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143821.754927:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143821.755388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143821.759392:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b137b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f846 expref: 7 pid: 7244 timeout: 980 lvb_type: 0 00000100:00100000:0.0:1746143821.759407:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627253376:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143821.759417:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627253504:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143821.759444:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143821.763235:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143821.765340:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143821.765350:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:0.0:1746143821.765581:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3093, 88 off260024 00000004:00080000:0.0:1746143821.765586:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880989673090ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.765610:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3104, 88 off260640 00000004:00080000:0.0:1746143821.765613:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880989701231ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.765633:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3105, 88 off260728 00000004:00080000:0.0:1746143821.765636:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880989723670ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.765642:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3094, 88 off260112 00000004:00080000:0.0:1746143821.765645:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880989732604ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.765651:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3095, 88 off260200 00000004:00080000:0.0:1746143821.765653:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880989740559ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.765658:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3106, 88 off260816 00000004:00080000:0.0:1746143821.765662:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880989749841ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.765880:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3107, 88 off260904 00000004:00080000:0.0:1746143821.765885:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880989972774ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.765903:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3108, 88 off260992 00000004:00080000:0.0:1746143821.765905:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880989993204ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.766066:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3096, 88 off260288 00000004:00080000:0.0:1746143821.766070:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880990158157ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.766083:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3109, 88 off261080 00000004:00080000:0.0:1746143821.766086:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880990173477ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.766094:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3097, 88 off260376 00000004:00080000:0.0:1746143821.766096:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880990183944ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.766103:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3110, 88 off261168 00000004:00080000:0.0:1746143821.766105:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880990193057ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143821.766111:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3098, 88 off260464 00000004:00080000:0.0:1746143821.766114:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880990201699ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.766120:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3099, 88 off260552 00000004:00080000:0.0:1746143821.766123:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880990211009ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.766129:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3100, 88 off260640 00000004:00080000:0.0:1746143821.766131:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880990218875ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.766136:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3101, 88 off260728 00000004:00080000:0.0:1746143821.766139:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 880990226537ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143821.766144:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3111, 88 off261256 00000004:00080000:0.0:1746143821.766146:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 880990233690ns, next at 850789974850ns, rc = 0 00000100:00100000:0.0:1746143821.773393:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143821.774174:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944556 is committed 00000004:00080000:0.0:1746143821.774181:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2326 committed 00000004:00080000:0.0:1746143821.774203:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2319 committed 00000004:00080000:0.0:1746143821.774211:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2318 committed 00000004:00080000:0.0:1746143821.774213:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2317 committed 00000004:00080000:0.0:1746143821.774214:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2316 committed 00000004:00080000:0.0:1746143821.774218:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2325 committed 00000004:00080000:0.0:1746143821.774220:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2315 committed 00000004:00080000:0.0:1746143821.774222:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2324 committed 00000004:00080000:0.0:1746143821.774224:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2314 committed 00000004:00080000:0.0:1746143821.774226:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2323 committed 00000004:00080000:0.0:1746143821.774228:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2322 committed 00000004:00080000:0.0:1746143821.774230:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2321 committed 00000004:00080000:0.0:1746143821.774235:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2313 committed 00000004:00080000:0.0:1746143821.774237:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2312 committed 00000004:00080000:0.0:1746143821.774239:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2320 committed 00000004:00080000:0.0:1746143821.774242:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2319 committed 00000004:00080000:0.0:1746143821.774244:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2311 committed 00000001:00080000:0.0:1746143821.774250:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944555 is committed 00000001:00080000:0.0:1746143821.774265:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944551 is committed 00010000:00010000:0.0:1746143821.774331:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f885 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.774342:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.774345:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143821.774370:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b141c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f885 expref: 10 pid: 7244 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143821.774386:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b1423 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f885 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143821.774418:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.774453:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.774474:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.774494:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.774526:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143821.774533:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.774556:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.775469:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.775492:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.775535:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627255040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.775558:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.775574:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627255552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143821.775593:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143821.775621:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627255040 00000100:00100000:0.0:1746143821.775625:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627255040 00000100:00100000:0.0:1746143821.775646:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627255552 00000100:00100000:0.0:1746143821.775649:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627255552 00000100:00100000:0.0:1746143821.775660:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746143821.775666:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963627254528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.775748:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963627254528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1252us total) trans 21474841010 rc 0/0 00000100:00100000:0.0:1746143821.775754:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15252 00000100:00100000:0.0:1746143821.775768:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15254 00000100:00100000:0.0:1746143821.775772:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963627254656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143821.775834:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3771:x1830963627254656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (340us total) trans 21474841012 rc 0/0 00000100:00100000:0.0:1746143821.775840:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15254 00000100:00100000:0.0:1746143821.775851:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15256 00000100:00100000:0.0:1746143821.775857:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+87:3771:x1830963627255552:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143821.775889:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136335180/2, rc 0, transno 21474841011 00000100:00100000:0.0:1746143821.775895:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143821.775904:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334e00/2, rc 0, transno 21474841012 00000100:00100000:0.0:1746143821.775906:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143821.775939:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0b480/2, rc 0, transno 21474841009 00000100:00100000:0.0:1746143821.775943:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143821.775950:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136335500/2, rc 0, transno 21474841010 00000100:00100000:0.0:1746143821.775953:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627254528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143821.775962:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457c380/2, rc 0, transno 17179873728 00000100:00100000:0.0:1746143821.775990:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627255040:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143821.776050:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143821.776053:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.776055:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143821.776057:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.776059:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143821.776084:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+88:3771:x1830963627255552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (489us total) trans 17179873729 rc 0/0 00000100:00100000:0.0:1746143821.776089:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15256 00000004:00080000:0.0:1746143821.776111:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c3a300/2, rc 0, transno 17179873729 00000100:00100000:0.0:1746143821.776115:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627255552:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143821.776140:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143821.776143:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143821.776146:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db600, rc 0) 00000100:00100000:0.0:1746143821.776183:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:1910:x1830963624385536:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 21974us (22081us total) trans 8589944556 rc 0/0 00000100:00100000:0.0:1746143821.776190:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13635 00000100:00100000:0.0:1746143821.778253:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15260 00000100:00100000:0.0:1746143821.778260:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3774:x1830963627254400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143821.778338:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143821.778341:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.778343:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143821.778345:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143821.778347:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143821.778374:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+83:3774:x1830963627254400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (367us total) trans 21474841013 rc 0/0 00000100:00100000:0.0:1746143821.778502:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15260 00000100:00100000:0.0:1746143821.779445:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.783891:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.786557:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.786950:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.789547:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.789609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.790365:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.793939:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624387712 00000100:00100000:0.0:1746143821.793943:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624387712 00002000:00100000:0.0:1746143821.794265:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092ef1500 x1830963624387712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:217/0 lens 488/0 e 0 to 0 dl 1746143832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143821.794527:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1500 with x1830963624387712 ext(1048576->2097151) 00002000:00010000:0.0:1746143821.794532:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef1500 00000100:00100000:0.0:1746143821.794626:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6479 00000100:00100000:0.0:1746143821.794633:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963624387712:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143821.797829:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2010:x1830963624387200:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7099us (8218us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143821.797837:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6478 00002000:00100000:0.0:1746143821.797848:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094195880 x1830963624387200/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:217/0 lens 488/440 e 0 to 0 dl 1746143832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143821.797857:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963624387200 ext(1048576->2097151) 00002000:00010000:0.0:1746143821.797862:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094195880 00000100:00100000:0.0:1746143821.798098:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624388096 00000100:00100000:0.0:1746143821.798104:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624388096 00000100:00100000:0.0:1746143821.798687:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15271 00000100:00100000:0.0:1746143821.798696:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+48:1911:x1830963624388096:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143821.798712:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.798729:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73b1454 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f8b6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.798758:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d200/0x87925e4cb73b135f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f831 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.798766:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143821.798768:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143821.798771:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73b1454 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->1474559] (req 1048576->1474559) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8b6 expref: 49 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.798798:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d200/0x87925e4cb73b135f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f831 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.798811:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d200/0x87925e4cb73b135f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f831 expref: 15 pid: 12327 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143821.798823:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094195c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627256704:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143821.798893:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143821.799795:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.801560:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.802693:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.802869:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963624387712:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8237us (9392us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143821.802876:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6479 00002000:00100000:0.0:1746143821.802881:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092ef1500 x1830963624387712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:217/0 lens 488/440 e 0 to 0 dl 1746143832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143821.802888:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1500 with x1830963624387712 ext(1048576->2097151) 00002000:00010000:0.0:1746143821.802890:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef1500 00000100:00100000:0.0:1746143821.806230:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624388736 00000100:00100000:0.0:1746143821.806240:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624388736 00000100:00100000:0.0:1746143821.806295:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15272 00000100:00100000:0.0:1746143821.806303:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+34:1915:x1830963624388736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143821.806321:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.806338:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b145b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f8bd expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.806369:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73b144d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8af expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.806377:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143821.806379:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143821.806383:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b145b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8bd expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.806415:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73b144d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8af expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.806427:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634800/0x87925e4cb73b144d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2039808->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8af expref: 43 pid: 13430 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143821.806440:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009320e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627256960:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143821.806540:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143821.809006:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.810382:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.810414:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.814201:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.814282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.815210:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624390016 00000100:00100000:0.0:1746143821.815214:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624390016 00000100:00100000:0.0:1746143821.815247:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5169 00000100:00100000:0.0:1746143821.815253:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+261:1911:x1830963624390016:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143821.815436:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:1911:x1830963624390016:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 182us (247us total) trans 8589944557 rc 0/0 00000100:00100000:0.0:1746143821.815442:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5169 00000100:00100000:0.0:1746143821.823780:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.827764:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.836114:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.838320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.840714:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.844954:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.848777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.850792:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.861956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.861998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.862510:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.873212:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.876822:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.880226:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.883608:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.886000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.889351:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.895095:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.906293:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.906347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.906593:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15281 00000100:00100000:0.0:1746143821.906601:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+33:1915:x1830963624393600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143821.906609:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143821.906620:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338b4c00/0x87925e4cb73b149a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f8fc expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.906632:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.906633:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143821.906639:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b4c00/0x87925e4cb73b149a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8fc expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.906652:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338b4c00/0x87925e4cb73b149a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8fc expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143821.906697:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b4c00, rc 0) 00000100:00100000:0.0:1746143821.906715:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+34:1915:x1830963624393600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 115us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143821.906720:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15281 00000100:00100000:0.0:1746143821.912441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.912506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.914025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.914054:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.932549:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.936656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.945459:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143821.948699:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.028432:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.035462:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.042549:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.122387:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143822.123278:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143822.125332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.126091:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.128152:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.128938:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.134610:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.134724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143822.135080:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143822.139260:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.139306:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.139331:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624397696 00000100:00100000:0.0:1746143822.139337:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624397696 00010000:00010000:0.0:1746143822.139369:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b1431 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f893 expref: 38 pid: 9585 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143822.139391:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624397824 00000100:00100000:0.0:1746143822.139393:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624397824 00010000:00010000:0.0:1746143822.139400:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b142a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f88c expref: 47 pid: 1945 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143822.139418:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7251 00000100:00100000:0.0:1746143822.139424:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+37:2011:x1830963624397696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.139439:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143822.139458:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b1431 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f893 expref: 37 pid: 9585 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.139466:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b1431 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f893 expref: 37 pid: 9585 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.139849:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b1431 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f893 expref: 37 pid: 9585 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.141404:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143822.144534:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.144608:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.146774:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.151239:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.157687:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143822.166365:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841017 is committed 00000001:00080000:0.0:1746143822.166378:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841016 is committed 00000001:00080000:0.0:1746143822.166455:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841000 is committed 00000001:00080000:0.0:1746143822.166485:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474840987 is committed 00000100:00100000:0.0:1746143822.167482:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.169429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.173140:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.175127:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.175161:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.175177:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.175201:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624399104 00000100:00100000:0.0:1746143822.175210:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624399104 00000100:00100000:0.0:1746143822.175255:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624399744 00000100:00100000:0.0:1746143822.175257:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624399744 00010000:00010000:0.0:1746143822.175270:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b14f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f91f expref: 10 pid: 13430 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143822.175291:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7254 00000100:00100000:0.0:1746143822.175299:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093727800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624399744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.175314:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143822.175331:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143821 -> 1746143822 00010000:00010000:0.0:1746143822.175338:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b14f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f91f expref: 10 pid: 13430 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.175355:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b14f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f91f expref: 11 pid: 13430 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.175379:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e520c00/0x87925e4cb73b14f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1441791) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f91f expref: 11 pid: 13430 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.175397:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143822.175399:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143822.175406:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b14fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f926 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143822.175414:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b14fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f926 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143822.175444:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b14fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f926 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143822.175453:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093724700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627259776:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143822.179852:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.187542:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.189287:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.194108:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143822.201552:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143822.201782:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624401280 00000100:00100000:0.0:1746143822.201787:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624401280 00002000:00100000:0.0:1746143822.201819:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88011e30b480 x1830963624401280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:218/0 lens 488/0 e 0 to 0 dl 1746143833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143822.201828:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b480 with x1830963624401280 ext(0->1048575) 00002000:00010000:0.0:1746143822.201833:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30b480 00000100:00100000:0.0:1746143822.201904:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6501 00000100:00100000:0.0:1746143822.201925:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963624401280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143822.202859:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624401792 00000100:00100000:0.0:1746143822.202862:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624401792 00002000:00100000:0.0:1746143822.202877:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1413120->2097151) req@ffff880096e56d80 x1830963624401792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:218/0 lens 488/0 e 0 to 0 dl 1746143833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143822.202884:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56d80 with x1830963624401792 ext(1413120->2097151) 00002000:00010000:0.0:1746143822.202887:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e56d80 00000100:00100000:0.0:1746143822.202907:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6503 00000100:00100000:0.0:1746143822.202925:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963624401792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143822.221185:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.228713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.233465:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.234660:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.235188:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15293 00000100:00100000:0.0:1746143822.235195:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963624402432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143822.235206:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143822.235215:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73b157a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840f96c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143822.235259:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143822.235261:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143822.235266:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73b157a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f96c expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143822.235276:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f400/0x87925e4cb73b157a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f96c expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143822.235282:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f400, rc 0) 00000100:00100000:0.0:1746143822.235300:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963624402432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143822.235304:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15293 00000100:00100000:0.0:1746143822.238803:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.238853:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.253639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.273485:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.307759:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.310304:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.334682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.334729:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.334757:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.334804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143822.335081:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143822.353886:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.357462:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.357882:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.357961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.363368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.363402:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.368625:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.375295:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624406016 00000100:00100000:0.0:1746143822.375302:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624406016 00010000:00010000:0.0:1746143822.375329:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b1469 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8cb expref: 8 pid: 12327 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143822.375350:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7259 00000100:00100000:0.0:1746143822.375356:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624406016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.375369:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143822.375389:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b1469 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8cb expref: 8 pid: 12327 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.375399:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b1469 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8cb expref: 8 pid: 12327 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.375422:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b1469 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8cb expref: 8 pid: 12327 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.375447:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143822.375469:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624406016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143822.375475:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7259 00000100:00100000:0.0:1746143822.376856:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.377013:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.377983:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.381644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.381682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.383262:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.386991:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.393457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.397667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.398719:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624407936 00000100:00100000:0.0:1746143822.398723:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624407936 00010000:00010000:0.0:1746143822.398738:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b1485 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8e7 expref: 24 pid: 9839 timeout: 981 lvb_type: 0 00000100:00100000:0.0:1746143822.398755:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7262 00000100:00100000:0.0:1746143822.398760:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624407936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.398767:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143822.398775:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b1485 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8e7 expref: 24 pid: 9839 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.398785:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b1485 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8e7 expref: 24 pid: 9839 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.398798:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3ba00/0x87925e4cb73b1485 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f8e7 expref: 24 pid: 9839 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.398811:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143822.398813:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143822.398819:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b15ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3567616->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f99d expref: 6 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143822.398826:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b15ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3567616->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f99d expref: 6 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143822.398860:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b15ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3567616->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f99d expref: 6 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143822.398872:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627262208:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143822.398941:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143822.404767:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.409475:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.412004:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.415141:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.420529:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.426862:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.446110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.455316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.496247:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.499559:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.499600:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.499647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.499674:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.508328:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.511781:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.521255:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.530790:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.530840:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.548673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.554671:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143822.554937:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143822.554955:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.555188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.555208:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.555228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.555238:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.555264:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.555280:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624412416 00000100:00100000:0.0:1746143822.555283:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624412416 00002000:00100000:0.0:1746143822.555303:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1466367) req@ffff8800962c7100 x1830963624412416/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:218/0 lens 488/0 e 0 to 0 dl 1746143833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143822.555312:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800962c7100 with x1830963624412416 ext(1048576->1466367) 00010000:00010000:0.0:1746143822.555317:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b15f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f996 expref: 24 pid: 13436 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.555327:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b15f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f996 expref: 24 pid: 13436 timeout: 981 lvb_type: 0 00002000:00010000:0.0:1746143822.555333:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800962c7100 00000100:00100000:0.0:1746143822.555346:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2464 00000100:00100000:0.0:1746143822.555350:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800962c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963624412416:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143822.563037:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.567573:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.567900:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.570849:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.575236:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.575288:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.575344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.575359:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.575443:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.577665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.585783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.586246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.586493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.588965:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143822.589846:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143821 -> 1746143823 00002000:00010000:0.0:1746143822.589849:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143821 -> 1746143823 00002000:00010000:0.0:1746143822.589851:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143822 -> 1746143823 00000100:00100000:0.0:1746143822.589865:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627264256:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143822.589888:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73b1717 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fa37 expref: 27 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143822.589899:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7de00/0x87925e4cb73b1717 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fa37 expref: 27 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143822.590378:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7de00, rc 0) 00000100:00100000:0.0:1746143822.590411:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963624415872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3871us (3917us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143822.590416:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15313 00000100:00100000:0.0:1746143822.596139:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.596186:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.618354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.621859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.621902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.622052:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.626904:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.629297:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.633060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.634536:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.636716:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624418560 00000100:00100000:0.0:1746143822.636727:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624418560 00010000:00010000:0.0:1746143822.636753:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73b16ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9ff expref: 9 pid: 1945 timeout: 981 lvb_type: 1 00000100:00100000:0.0:1746143822.636786:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7272 00000100:00100000:0.0:1746143822.636793:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624418560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.636804:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143822.636823:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73b16ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9ff expref: 9 pid: 1945 timeout: 981 lvb_type: 1 00010000:00010000:0.0:1746143822.636832:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73b16ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9ff expref: 9 pid: 1945 timeout: 981 lvb_type: 1 00010000:00010000:0.0:1746143822.636849:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73b16ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9ff expref: 9 pid: 1945 timeout: 981 lvb_type: 1 00010000:00010000:0.0:1746143822.636861:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143822.636877:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624418560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143822.636883:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7272 00000100:00100000:0.0:1746143822.638490:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.638686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.639224:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7274 00000100:00100000:0.0:1746143822.639231:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624418816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.639238:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143822.639251:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b1606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9a4 expref: 27 pid: 13436 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.639262:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b1606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9a4 expref: 27 pid: 13436 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.639276:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b1606 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9a4 expref: 27 pid: 13436 timeout: 981 lvb_type: 0 00010000:00010000:0.0:1746143822.639287:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143822.639330:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624418816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143822.639336:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7274 00000100:00100000:0.0:1746143822.642425:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.642466:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.646092:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.650108:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.650166:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.666714:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.671856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.674438:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.676856:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627265664:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143822.676876:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143822.676944:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624420224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3722us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143822.676953:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7276 00000100:00100000:0.0:1746143822.679651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.685651:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.713119:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.718502:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624421376 00000100:00100000:0.0:1746143822.718522:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624421376 00000100:00100000:0.0:1746143822.718601:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 911 00000100:00100000:0.0:1746143822.718608:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963624421376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143822.718621:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143822.718643:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d400/0x87925e4cb73b176b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fa68 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143822.718770:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143822.718774:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143822.718810:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624421376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 203us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143822.718816:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 911 00000100:00100000:0.0:1746143822.720004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.723496:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.724433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.725677:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.727873:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.731275:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.733699:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.760554:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.764608:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.764655:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.764700:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.776076:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624423552 00000100:00100000:0.0:1746143822.776084:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624423552 00002000:00100000:0.0:1746143822.776118:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88011e30b800 x1830963624423552/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:218/0 lens 504/0 e 0 to 0 dl 1746143833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143822.776127:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b800 with x1830963624423552 ext(1048576->2097151) 00002000:00010000:0.0:1746143822.776132:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e30b800 00000100:00100000:0.0:1746143822.776160:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6530 00000100:00100000:0.0:1746143822.776167:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624423552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143822.794092:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.794136:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.800376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.803865:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.803966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.808456:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.808492:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.808780:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.809976:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.818390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.824558:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.832745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.833255:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.839243:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624425600 00000100:00100000:0.0:1746143822.839250:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624425600 00002000:00100000:0.0:1746143822.839291:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3457023) req@ffff88011e30b100 x1830963624425600/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:218/0 lens 488/0 e 0 to 0 dl 1746143833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143822.839306:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b100 with x1830963624425600 ext(3145728->3457023) 00010000:00010000:0.0:1746143822.839314:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b174f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fa61 expref: 27 pid: 13436 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143822.839325:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b174f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3457023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fa61 expref: 27 pid: 13436 timeout: 982 lvb_type: 0 00002000:00010000:0.0:1746143822.839332:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e30b100 00000100:00100000:0.0:1746143822.839351:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2468 00000100:00100000:0.0:1746143822.839358:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624425600:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143822.844631:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.848583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.850734:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.862392:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.862442:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.870985:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.871014:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.885776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.885820:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.900034:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.911262:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.911307:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624427776 00000100:00100000:0.0:1746143822.911314:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624427776 00000100:00100000:0.0:1746143822.911362:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13655 00000100:00100000:0.0:1746143822.911369:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+277:1973:x1830963624427776:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143822.911389:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143822.911404:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801338b5800/0x87925e4cb73b181a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fad8 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143822.917186:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624428288 00000100:00100000:0.0:1746143822.917196:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624428288 00000100:00100000:0.0:1746143822.917239:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5185 00000100:00100000:0.0:1746143822.917246:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:1973:x1830963624428288:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143822.917416:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:1973:x1830963624428288:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 170us (648us total) trans 8589944589 rc 0/0 00000100:00100000:0.0:1746143822.917422:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5185 00000100:00100000:0.0:1746143822.924238:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624428032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12094us (12889us total) trans 0 rc 614400/614400 00000100:00100000:0.0:1746143822.924251:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6537 00002000:00100000:0.0:1746143822.924265:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88009391c000 x1830963624428032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:218/0 lens 488/440 e 0 to 0 dl 1746143833 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143822.924275:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963624428032 ext(4194304->4808703) 00002000:00010000:0.0:1746143822.924281:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391c000 00000100:00100000:0.0:1746143822.925713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.931201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.932415:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.939446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.939853:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.939894:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.943965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.949014:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.949071:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.954828:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.955974:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.956594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.957785:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143822.961403:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.019901:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.023613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.026669:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.028723:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.032031:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.038123:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.038164:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.038190:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624432000 00000100:00100000:0.0:1746143823.038197:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624432000 00010000:00010000:0.0:1746143823.038232:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b1645 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9c7 expref: 15 pid: 9839 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143823.038264:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624431872 00000100:00100000:0.0:1746143823.038266:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624431872 00010000:00010000:0.0:1746143823.038274:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b1699 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9f1 expref: 8 pid: 1945 timeout: 982 lvb_type: 1 00000100:00100000:0.0:1746143823.038286:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7289 00000100:00100000:0.0:1746143823.038292:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624432000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143823.038305:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143823.038328:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b1645 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9c7 expref: 15 pid: 9839 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.038343:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b1645 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840f9c7 expref: 15 pid: 9839 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.038367:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143823.038401:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624432000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.038407:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7289 00000100:00100000:0.0:1746143823.039568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.047193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.056867:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.087987:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.090576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.090644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.094904:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.102724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.105862:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.113807:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.163409:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.170733:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.172313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.173142:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.174409:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.180451:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.180485:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.180520:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.180544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.180559:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624435584 00000100:00100000:0.0:1746143823.180562:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624435584 00000100:00100000:0.0:1746143823.180821:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15341 00000100:00100000:0.0:1746143823.180829:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2010:x1830963624435840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.180988:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.180996:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73b1916 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fb4f expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143823.181017:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ecd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627270656:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143823.181641:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143823.188944:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.191198:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.191392:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.192508:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6545 00000100:00100000:0.0:1746143823.192516:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ecd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963624436480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143823.193780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.201949:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ecda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963624436736:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7117us (8164us total) trans 21474841024 rc 0/0 00000100:00100000:0.0:1746143823.201960:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2470 00002000:00100000:0.0:1746143823.201968:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1937408->2097151) req@ffff88012ecda300 x1830963624436736/t21474841024(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:219/0 lens 488/448 e 0 to 0 dl 1746143834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.201977:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ecda300 with x1830963624436736 ext(1937408->2097151) 00010000:00010000:0.0:1746143823.201985:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73b1875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fafb expref: 15 pid: 13430 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.201997:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73b1875 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fafb expref: 15 pid: 13430 timeout: 982 lvb_type: 0 00002000:00010000:0.0:1746143823.202004:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ecda300 00000100:00100000:0.0:1746143823.205616:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.205724:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.210463:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.212602:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.217997:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.222777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.225133:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.226834:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.242226:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.242262:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.242297:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.242311:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.242331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.242364:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624438272 00000100:00100000:0.0:1746143823.242367:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624438272 00000100:00100000:0.0:1746143823.250541:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.252682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.256368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.257041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.261709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.261945:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.277217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.277843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.279488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.280817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.282551:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.284650:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.285896:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.291951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.291995:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.292036:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.295422:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627272832:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143823.295447:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143823.295481:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009635fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624441344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3008us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.295491:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7300 00000100:00100000:0.0:1746143823.296549:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.299227:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.300289:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.301834:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624442368 00000100:00100000:0.0:1746143823.301840:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624442368 00002000:00100000:0.0:1746143823.301868:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c68700 x1830963624442368/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:219/0 lens 488/0 e 0 to 0 dl 1746143834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.301876:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68700 with x1830963624442368 ext(2097152->4194303) 00002000:00010000:0.0:1746143823.301880:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68700 00000100:00100000:0.0:1746143823.301907:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6554 00000100:00100000:0.0:1746143823.301939:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624442368:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143823.305946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.306000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.314644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.314980:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.315148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.315168:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624443776 00000100:00100000:0.0:1746143823.315171:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624443776 00000100:00100000:0.0:1746143823.315192:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5191 00000100:00100000:0.0:1746143823.315199:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+283:8585:x1830963624443776:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143823.315373:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+284:8585:x1830963624443776:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 174us (225us total) trans 8589944600 rc 0/0 00000100:00100000:0.0:1746143823.315379:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5191 00000100:00100000:0.0:1746143823.323093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.331468:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.331640:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.331666:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.331763:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.331868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.332110:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15361 00000100:00100000:0.0:1746143823.332116:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624444544:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143823.332185:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.332203:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b19cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fbe2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.332226:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.332227:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.332236:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b19cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbe2 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.332250:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b19cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbe2 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.332263:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00000100:00100000:0.0:1746143823.332310:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624444544:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 195us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.332315:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15361 00000100:00100000:0.0:1746143823.339326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.344227:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.348584:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.350177:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624445952 00000100:00100000:0.0:1746143823.350181:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624445952 00010000:00010000:0.0:1746143823.350197:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73b19be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbbf expref: 11 pid: 10936 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143823.350348:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7303 00000100:00100000:0.0:1746143823.350360:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624445952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143823.350369:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143823.350374:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73b19be lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbbf expref: 11 pid: 10936 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.350384:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73b19be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbbf expref: 11 pid: 10936 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.350396:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73b19be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbbf expref: 11 pid: 10936 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.350409:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143823.350412:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73b1a19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143823.350420:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73b1a19 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143823.350426:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d400/0x87925e4cb73b1a19 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143823.350446:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143823.350461:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624445952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.350528:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7303 00000100:00100000:0.0:1746143823.356247:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.359071:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.363951:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624447104 00000100:00100000:0.0:1746143823.363955:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624447104 00000100:00100000:0.0:1746143823.363984:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15367 00000100:00100000:0.0:1746143823.363989:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624447104:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.363997:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.364004:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521200/0x87925e4cb73b1a43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fc13 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.364016:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.364021:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521200/0x87925e4cb73b1a43 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc13 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.364029:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521200/0x87925e4cb73b1a43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc13 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.364040:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521200, rc 0) 00000100:00100000:0.0:1746143823.364065:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624447104:12345-192.168.202.3@tcp:101:cat.0 Request processed in 75us (202us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143823.364070:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15367 00000100:00100000:0.0:1746143823.367437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.367472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.372314:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624447616 00000100:00100000:0.0:1746143823.372321:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624447616 00000100:00100000:0.0:1746143823.372351:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624447744 00000100:00100000:0.0:1746143823.372352:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624447744 00000100:00100000:0.0:1746143823.372508:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15368 00000100:00100000:0.0:1746143823.372514:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963624447616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.372527:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.372539:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b1a4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fc1a expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143823.372577:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096942a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627274240:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143823.372619:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143823.374523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.384907:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.384966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.402350:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.403185:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.404909:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.416097:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.479321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.482609:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.485076:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.485148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.485244:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15371 00000100:00100000:0.0:1746143823.485252:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624449792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.485263:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.485272:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73b1a9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fc3d expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143823.485304:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096942680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627275008:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143823.485364:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143823.485781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.485815:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.487116:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.487190:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096942680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627275008:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143823.487209:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73b1a9e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc3d expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.487219:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520200/0x87925e4cb73b1a9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc3d expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.487229:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520200, rc 0) 00000100:00100000:0.0:1746143823.487255:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624449792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2004us (2183us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143823.487259:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15371 00000100:00100000:0.0:1746143823.490481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.495252:0:9589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627275904 00000100:00100000:0.0:1746143823.495259:0:9589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627275904 00000100:00100000:0.0:1746143823.495321:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1746143823.495328:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627275904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143823.495712:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1171262656 pending 2895872 free 3910172672 avail 3678650368 00000100:00100000:0.0:1746143823.496001:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627275904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 673us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.496008:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1746143823.501099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.501336:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.501372:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.520587:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.523070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.523085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.523184:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.523422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.523645:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.525176:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.529549:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.530110:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.530956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531487:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531533:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531545:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531836:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531860:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.531870:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624453760 00000100:00100000:0.0:1746143823.531873:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624453760 00002000:00100000:0.0:1746143823.531886:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1282048->1368063) req@ffff88011e309180 x1830963624453760/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:219/0 lens 488/0 e 0 to 0 dl 1746143834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.531893:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309180 with x1830963624453760 ext(1282048->1368063) 00010000:00010000:0.0:1746143823.531897:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b199b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbb1 expref: 10 pid: 1945 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.531904:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b199b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbb1 expref: 10 pid: 1945 timeout: 982 lvb_type: 0 00002000:00010000:0.0:1746143823.531909:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e309180 00000100:00100000:0.0:1746143823.531934:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624454016 00000100:00100000:0.0:1746143823.531936:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624454016 00002000:00100000:0.0:1746143823.531945:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3239935) req@ffff88011e308e00 x1830963624454016/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:219/0 lens 488/0 e 0 to 0 dl 1746143834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.531951:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308e00 with x1830963624454016 ext(3145728->3239935) 00010000:00010000:0.0:1746143823.531955:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b1a58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc28 expref: 32 pid: 13436 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.532297:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b1a58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3239935) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc28 expref: 30 pid: 13436 timeout: 982 lvb_type: 0 00002000:00010000:0.0:1746143823.532303:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e308e00 00000100:00100000:0.0:1746143823.532478:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2477 00000100:00100000:0.0:1746143823.532484:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624454016:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143823.532560:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.533473:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.533484:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.534884:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.535892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.535906:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.535952:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.535965:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624454528 00000100:00100000:0.0:1746143823.535968:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624454528 00000100:00100000:0.0:1746143823.535982:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624454784 00000100:00100000:0.0:1746143823.535984:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624454784 00000100:00100000:0.0:1746143823.535992:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624454912 00000100:00100000:0.0:1746143823.535993:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624454912 00000100:00100000:0.0:1746143823.536001:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624455040 00000100:00100000:0.0:1746143823.536003:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624455040 00000100:00100000:0.0:1746143823.536014:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15384 00000100:00100000:0.0:1746143823.536019:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963624454528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.536026:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.536033:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b1b2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fc7c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143823.536043:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a4f, atime: 0x68140a4f, ctime: 0x68140a4f, blocks: 0x808 00010000:00010000:0.0:1746143823.536052:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.536053:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.536056:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b1b2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc7c expref: 18 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.536064:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b1b2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc7c expref: 18 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.536075:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717600, rc 0) 00000100:00100000:0.0:1746143823.536093:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624454528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 74us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.536097:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15384 00000100:00100000:0.0:1746143823.536106:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15385 00000100:00100000:0.0:1746143823.536109:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624454784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.536114:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.536120:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b1b31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fc8a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143823.536146:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627277568:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143823.537954:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143823.538483:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627277568:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143823.538512:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b1b31 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc8a expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.538522:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b1b31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc8a expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.538532:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717e00, rc 0) 00000100:00100000:0.0:1746143823.538548:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963624454784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2438us (2657us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143823.538553:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15385 00000100:00100000:0.0:1746143823.539291:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.543889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.543935:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.544051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.544081:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.544646:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.544659:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624455936 00000100:00100000:0.0:1746143823.544662:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624455936 00010000:00010000:0.0:1746143823.544674:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b199b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbb1 expref: 12 pid: 1945 timeout: 982 lvb_type: 0 00000100:00100000:0.0:1746143823.544687:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7324 00000100:00100000:0.0:1746143823.544691:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2011:x1830963624455936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143823.544697:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143823.544704:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b199b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbb1 expref: 12 pid: 1945 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.544712:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b199b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbb1 expref: 12 pid: 1945 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.544722:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b199b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fbb1 expref: 12 pid: 1945 timeout: 982 lvb_type: 0 00010000:00010000:0.0:1746143823.544731:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.544732:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.544734:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634600/0x87925e4cb73b1b07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.544743:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634600/0x87925e4cb73b1b07 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.544756:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143823.544769:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963624455936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.544775:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7324 00000100:00100000:0.0:1746143823.547308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.548456:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.555874:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.561597:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.569966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.570010:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.585160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.590845:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.596003:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.601725:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.607972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.608006:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.613223:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.618096:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.618137:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.621511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.621590:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.623154:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143823.623434:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143823 -> 1746143824 00002000:00010000:0.0:1746143823.623438:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143823 -> 1746143824 00002000:00010000:0.0:1746143823.623440:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143823 -> 1746143824 00000100:00100000:0.0:1746143823.623457:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627278336:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143823.623481:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e1d5800/0x87925e4cb73b1baf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fcd0 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.623490:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e1d5800/0x87925e4cb73b1baf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fcd0 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.623515:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e1d5800, rc 0) 00000100:00100000:0.0:1746143823.623533:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963624459776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1259us (1943us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143823.623539:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15393 00000100:00100000:0.0:1746143823.623643:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624460032 00000100:00100000:0.0:1746143823.623646:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624460032 00000100:00100000:0.0:1746143823.623663:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15395 00000100:00100000:0.0:1746143823.623668:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624460032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143823.623675:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.623684:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b1bbd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fcde expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.623695:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.623696:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.623700:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b1bbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fcde expref: 33 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.623710:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b1bbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fcde expref: 33 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.623718:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96c00, rc 0) 00000100:00100000:0.0:1746143823.623744:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624460032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.623749:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15395 00000100:00100000:0.0:1746143823.624519:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.624606:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.628158:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.633688:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.642194:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.645329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.648541:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.651266:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.651661:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.653851:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.657839:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.660352:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.660443:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.661383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.661425:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624462976 00000100:00100000:0.0:1746143823.661428:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624462976 00002000:00100000:0.0:1746143823.661447:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c69c00 x1830963624462976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:219/0 lens 488/0 e 0 to 0 dl 1746143834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.661453:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963624462976 ext(1048576->2097151) 00002000:00010000:0.0:1746143823.661457:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69c00 00000100:00100000:0.0:1746143823.661474:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6576 00000100:00100000:0.0:1746143823.661480:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624462976:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143823.691190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.691246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.691573:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6577 00000100:00100000:0.0:1746143823.691583:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624463232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143823.723258:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.727662:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624463744:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4035us (4403us total) trans 0 rc 614400/614400 00000100:00100000:0.0:1746143823.727675:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6579 00002000:00100000:0.0:1746143823.727687:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff880095c69880 x1830963624463744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:219/0 lens 488/440 e 0 to 0 dl 1746143834 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.727696:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963624463744 ext(4194304->4808703) 00002000:00010000:0.0:1746143823.727703:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:0.0:1746143823.734104:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.739019:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.753802:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.756387:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624465152 00000100:00100000:0.0:1746143823.756397:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624465152 00002000:00100000:0.0:1746143823.756437:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880093f79180 x1830963624465152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:219/0 lens 488/0 e 0 to 0 dl 1746143834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143823.756446:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f79180 with x1830963624465152 ext(1048576->2097151) 00002000:00010000:0.0:1746143823.756451:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f79180 00000100:00100000:0.0:1746143823.756479:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6581 00000100:00100000:0.0:1746143823.756486:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963624465152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143823.809857:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.815703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.838543:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.840956:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624466816 00000100:00100000:0.0:1746143823.840962:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624466816 00000100:00100000:0.0:1746143823.840988:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5201 00000100:00100000:0.0:1746143823.840993:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b494450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+38:2035:x1830963624466816:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143823.841100:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b494450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+39:2035:x1830963624466816:12345-192.168.202.3@tcp:35:cat.0 Request processed in 106us (225us total) trans 8589944620 rc 0/0 00000100:00100000:0.0:1746143823.841106:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5201 00000100:00100000:0.0:1746143823.848828:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624466944 00000100:00100000:0.0:1746143823.848838:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624466944 00000100:00100000:0.0:1746143823.858742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.864838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.864889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.869406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.876273:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.876329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.878798:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.879431:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.881098:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.888239:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15406 00000100:00100000:0.0:1746143823.888246:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624469376:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143823.888252:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.888259:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b1c81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fd5c expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.888272:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.888273:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.888276:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b1c81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd5c expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.888284:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b1c81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd5c expref: 10 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.888293:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084c00, rc 0) 00000100:00100000:0.0:1746143823.888431:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624469376:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 185us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.888436:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15406 00000100:00100000:0.0:1746143823.888471:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.888483:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624468992 00000100:00100000:0.0:1746143823.888485:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624468992 00000100:00100000:0.0:1746143823.888510:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15408 00000100:00100000:0.0:1746143823.888514:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624468992:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143823.888520:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.888527:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73b1ca4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fd47 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.888537:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.888538:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.888542:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73b1ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd47 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.888550:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73b1ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd47 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.888556:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085e00, rc 0) 00000100:00100000:0.0:1746143823.888570:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624468992:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 56us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.888574:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15408 00000100:00100000:0.0:1746143823.888582:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624469248 00000100:00100000:0.0:1746143823.888584:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624469248 00000100:00100000:0.0:1746143823.888595:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15409 00000100:00100000:0.0:1746143823.888598:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624469248:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143823.888603:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143823.888609:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73b1cab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fd55 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.888617:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.888619:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.888622:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73b1cab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd55 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.888629:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085c00/0x87925e4cb73b1cab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd55 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143823.888635:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085c00, rc 0) 00000100:00100000:0.0:1746143823.888651:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624469248:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143823.888655:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15409 00000100:00100000:0.0:1746143823.892030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.895449:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.895635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.898652:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.903433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.927625:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.931829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.939326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.942736:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.950239:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.958485:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.958564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.958721:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7339 00000100:00100000:0.0:1746143823.958731:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2011:x1830963624471936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143823.958833:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143823.958844:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73b1b69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fca6 expref: 12 pid: 9587 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143823.958857:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73b1b69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fca6 expref: 12 pid: 9587 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143823.958869:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800972eda00/0x87925e4cb73b1b69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fca6 expref: 12 pid: 9587 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143823.958881:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.958883:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143823.958889:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b1cea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd7f expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.958902:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b1cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd7f expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143823.958952:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b1cea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3596287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd7f expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143823.958962:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627281280:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143823.959010:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143823.962695:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.971063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.971301:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.973901:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.982042:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.989084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143823.999151:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.007596:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.018269:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.018945:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.018992:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.041405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.047541:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.047586:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.047614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.048153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.053787:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.055731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.055792:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624475904 00000100:00100000:0.0:1746143824.055799:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624475904 00000100:00100000:0.0:1746143824.055847:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13683 00000100:00100000:0.0:1746143824.055854:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2052:x1830963624475904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143824.055871:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.055888:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b1d84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fdcc expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056013:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73b1d8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143824.056027:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73b1d06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd86 expref: 293 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056033:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1d37 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd9b expref: 40 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056038:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b1d61 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fda9 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056045:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73b1d8b lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143824.056071:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b1d61 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fda9 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056080:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b1d61 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fda9 expref: 18 pid: 14991 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143824.056091:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627282432:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.056151:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1d37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd9b expref: 40 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056159:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b1d37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd9b expref: 40 pid: 14991 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143824.056166:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627282560:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.056191:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73b1d06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd86 expref: 293 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.056198:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73b1d06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd86 expref: 293 pid: 14991 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143824.056206:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627282688:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143824.056226:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338a50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143824.059019:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.060094:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143824.062582:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7e600/0x87925e4cb73b1d06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fd86 expref: 293 pid: 14991 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143824.062608:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627282688:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.063218:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73b1d8b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143824.063330:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73b1d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143824.063335:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73b1d8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143824.063350:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143824.063419:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b1d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdcc expref: 19 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.063430:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428600/0x87925e4cb73b1d8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdcc expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.063437:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143824.063439:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143824.063441:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428600, rc 0) 00000100:00100000:0.0:1746143824.064378:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2052:x1830963624475904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8522us (8614us total) trans 8589944630 rc 0/0 00000100:00100000:0.0:1746143824.064384:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13683 00000100:00100000:0.0:1746143824.069367:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624477568 00000100:00100000:0.0:1746143824.069373:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624477568 00000100:00100000:0.0:1746143824.069407:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624477696 00000100:00100000:0.0:1746143824.069410:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624477696 00000100:00100000:0.0:1746143824.069420:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624477824 00000100:00100000:0.0:1746143824.069421:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624477824 00000100:00100000:0.0:1746143824.069434:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15419 00000100:00100000:0.0:1746143824.069439:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624477568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.069451:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.069461:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b1dca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fde1 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.069475:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.069476:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.069481:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b1dca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fde1 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.069504:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b1dca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fde1 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.069512:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429000, rc 0) 00000100:00100000:0.0:1746143824.069535:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624477568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.069542:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15419 00000100:00100000:0.0:1746143824.069554:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15421 00000100:00100000:0.0:1746143824.069558:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624477824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.069565:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.069573:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429e00/0x87925e4cb73b1dd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fdef expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.069583:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.069585:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.069588:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429e00/0x87925e4cb73b1dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdef expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.069597:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429e00/0x87925e4cb73b1dd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdef expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.069603:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429e00, rc 0) 00000100:00100000:0.0:1746143824.069619:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963624477824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.069623:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15421 00000100:00100000:0.0:1746143824.088222:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.089775:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.092487:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624478720 00000100:00100000:0.0:1746143824.092503:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624478720 00000100:00100000:0.0:1746143824.092547:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15423 00000100:00100000:0.0:1746143824.092554:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624478720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143824.092571:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.092586:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b1de6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fdfd expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.092605:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.092607:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.092616:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b1de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdfd expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.092631:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b1de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdfd expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.092642:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:0.0:1746143824.092676:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624478720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.092682:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15423 00000100:00100000:0.0:1746143824.097027:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.097859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.104141:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624479488 00000100:00100000:0.0:1746143824.104155:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624479488 00000100:00100000:0.0:1746143824.104235:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5207 00000100:00100000:0.0:1746143824.104244:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b494050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2052:x1830963624479488:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1746143824.104510:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b494050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2052:x1830963624479488:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 266us (1830us total) trans 8589944633 rc 0/0 00000100:00100000:0.0:1746143824.104517:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5207 00000100:00100000:0.0:1746143824.107407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.109232:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.111992:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.121757:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.129447:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.129556:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.133572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.142951:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624481408 00000100:00100000:0.0:1746143824.142961:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624481408 00000100:00100000:0.0:1746143824.143029:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5208 00000100:00100000:0.0:1746143824.143036:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+295:2047:x1830963624481408:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143824.143275:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+296:2047:x1830963624481408:12345-192.168.202.3@tcp:35:cat.0 Request processed in 238us (441us total) trans 8589944634 rc 0/0 00000100:00100000:0.0:1746143824.143283:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5208 00000100:00100000:0.0:1746143824.154344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.164306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.164333:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.167379:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.167393:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624481920 00000100:00100000:0.0:1746143824.167395:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624481920 00010000:00010000:0.0:1746143824.167408:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b1b23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc83 expref: 22 pid: 9585 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746143824.167431:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7351 00000100:00100000:0.0:1746143824.167436:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624481920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143824.167442:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143824.167449:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b1b23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc83 expref: 22 pid: 9585 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746143824.167457:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b1b23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc83 expref: 22 pid: 9585 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746143824.167468:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b1b23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fc83 expref: 22 pid: 9585 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746143824.167483:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.167485:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.167499:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1e33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe27 expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.167507:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe27 expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.167534:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1e33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1130496->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe27 expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143824.167544:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627284224:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143824.167587:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143824.173552:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.181716:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.181825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.187411:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.191667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.200618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.208199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.215136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.295674:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.312633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.319751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.319901:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963624484096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6941us (7271us total) trans 0 rc 471040/471040 00000100:00100000:0.0:1746143824.319933:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6599 00002000:00100000:0.0:1746143824.319943:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880090e5ad80 x1830963624484096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:220/0 lens 504/440 e 0 to 0 dl 1746143835 ref 1 fl Complete:/200/0 rc 471040/471040 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.319952:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963624484096 ext(1048576->2097151) 00002000:00010000:0.0:1746143824.319956:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:0.0:1746143824.334736:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.335605:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.335624:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624484736 00000100:00100000:0.0:1746143824.335626:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624484736 00002000:00100000:0.0:1746143824.335652:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e58000 x1830963624484736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:220/0 lens 488/0 e 0 to 0 dl 1746143835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.335660:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58000 with x1830963624484736 ext(2097152->4194303) 00002000:00010000:0.0:1746143824.335664:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58000 00000100:00100000:0.0:1746143824.335692:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6600 00000100:00100000:0.0:1746143824.335697:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963624484736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143824.341947:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.342744:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.342783:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.342814:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7353 00000100:00100000:0.0:1746143824.342820:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624484864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143824.342828:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143824.342837:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b1de6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdfd expref: 9 pid: 13430 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746143824.342846:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b1de6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdfd expref: 9 pid: 13430 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746143824.343435:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b1de6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fdfd expref: 9 pid: 13430 timeout: 983 lvb_type: 1 00010000:00010000:0.0:1746143824.343698:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.343700:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.343707:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73b1e87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2990079) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe51 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.343714:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73b1e87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2723840->2990079) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe51 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143824.347133:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.348573:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963624484736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12873us (12967us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143824.348580:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6600 00002000:00100000:0.0:1746143824.348585:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e58000 x1830963624484736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:220/0 lens 488/440 e 0 to 0 dl 1746143835 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.348592:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58000 with x1830963624484736 ext(2097152->4194303) 00002000:00010000:0.0:1746143824.348595:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58000 00000100:00100000:0.0:1746143824.348610:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6601 00000100:00100000:0.0:1746143824.348616:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963624485376:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143824.348706:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963624485376:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 90us (1574us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143824.348712:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6601 00002000:00100000:0.0:1746143824.348716:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2723840->2727935) req@ffff880094197800 x1830963624485376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746143835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.348722:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963624485376 ext(2723840->2727935) 00002000:00010000:0.0:1746143824.348724:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197800 00000100:00100000:0.0:1746143824.353767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.354304:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.360252:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624486144 00000100:00100000:0.0:1746143824.360260:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624486144 00000100:00100000:0.0:1746143824.360310:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5211 00000100:00100000:0.0:1746143824.360317:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+45:2067:x1830963624486144:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143824.361003:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+46:2067:x1830963624486144:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 685us (823us total) trans 8589944639 rc 0/0 00000100:00100000:0.0:1746143824.361009:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5211 00000100:00100000:0.0:1746143824.370115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.376316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.395591:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.408003:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.412972:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.413005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.413077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.420994:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.424050:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.424104:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.425472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.437758:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.444900:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.452796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.452832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.452855:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.453218:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.460368:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.465047:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.480199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.485812:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.500057:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.517356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.523329:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.528470:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.528523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.530546:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.530959:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627287168:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.530973:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b1f13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143824.531564:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624490624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8102us (8234us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143824.531571:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6608 00002000:00100000:0.0:1746143824.531578:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012457d180 x1830963624490624/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:220/0 lens 488/440 e 0 to 0 dl 1746143835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.531586:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d180 with x1830963624490624 ext(1048576->2097151) 00002000:00010000:0.0:1746143824.531589:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d180 00000100:00100000:0.0:1746143824.531859:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624491264 00000100:00100000:0.0:1746143824.531863:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624491264 00000100:00100000:0.0:1746143824.531887:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5212 00000100:00100000:0.0:1746143824.531892:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+300:30523:x1830963624491264:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143824.532054:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+301:30523:x1830963624491264:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 161us (402us total) trans 8589944642 rc 0/0 00000100:00100000:0.0:1746143824.532059:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5212 00000100:00100000:0.0:1746143824.534199:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143824.535647:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b1f13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535658:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b1f13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143824.535706:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:0.0:1746143824.535709:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143824.535728:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b1f13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535741:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b1f13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535750:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535759:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535766:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535771:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535838:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082ea1200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143824.535842:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535850:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535858:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143824.535861:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143824.535863:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535868:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b1efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535877:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535882:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535887:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535891:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143824.535894:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535898:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535903:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65500) 00010000:00010000:0.0:1746143824.535905:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143824.535907:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535928:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b1f05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143824.535955:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b1ef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe9e expref: 20 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.535965:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b1f13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe9e expref: 19 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.535970:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143824.535972:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143824.535974:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27000, rc 0) 00000100:00100000:0.0:1746143824.536008:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2078:x1830963624490880:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7380us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.536014:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13692 00000100:00100000:0.0:1746143824.546012:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.549547:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.553258:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.561498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.567886:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.570889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.574747:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.577512:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.577566:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.577685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.577819:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.578136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.579933:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15450 00000100:00100000:0.0:1746143824.579939:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624494336:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143824.579953:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.579961:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b1e8e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe58 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.579968:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b1f28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fec1 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.579973:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73b1ed4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe82 expref: 23 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.579977:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.579978:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.579980:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.579991:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73b1ed4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe82 expref: 23 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.580002:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082086a00/0x87925e4cb73b1ed4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe82 expref: 23 pid: 12328 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746143824.580009:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627289472:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.580032:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b1f28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fec1 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.580038:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b1f28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fec1 expref: 12 pid: 9587 timeout: 983 lvb_type: 1 00000100:00100000:0.0:1746143824.580044:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627289600:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.580056:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b1e8e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe58 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.580061:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b1e8e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fe58 expref: 38 pid: 9839 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143824.580067:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627289728:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143824.580076:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143824.587407:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587509:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587537:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587558:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587567:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587578:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587586:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587595:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587603:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587611:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587630:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.587652:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.589008:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.589375:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143824.589866:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589873:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589884:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589890:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589896:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589905:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7c400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143824.589907:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589929:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589938:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.589944:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c400/0x87925e4cb73b1f98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143824.589982:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963624494336:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 10043us (10364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.589988:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15450 00000100:00100000:0.0:1746143824.590873:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.592856:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624497280 00000100:00100000:0.0:1746143824.592861:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624497280 00010000:00010000:0.0:1746143824.592880:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b1f67 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fed6 expref: 22 pid: 14991 timeout: 983 lvb_type: 0 00000100:00100000:0.0:1746143824.592926:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7385 00000100:00100000:0.0:1746143824.592932:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+22:2011:x1830963624497280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143824.592942:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143824.592947:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b1f67 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fed6 expref: 22 pid: 14991 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143824.593156:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b1f67 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fed6 expref: 23 pid: 14991 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143824.593179:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b1f67 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fed6 expref: 23 pid: 14991 timeout: 983 lvb_type: 0 00010000:00010000:0.0:1746143824.593206:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143824.593208:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143824.594965:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.597055:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.666209:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.688958:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.691137:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.697883:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.704048:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.704084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.704109:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.704130:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624499072 00000100:00100000:0.0:1746143824.704137:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624499072 00000100:00100000:0.0:1746143824.704169:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624499328 00000100:00100000:0.0:1746143824.704171:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624499328 00000100:00100000:0.0:1746143824.704197:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624499584 00000100:00100000:0.0:1746143824.704199:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624499584 00000100:00100000:0.0:1746143824.704216:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15452 00000100:00100000:0.0:1746143824.704223:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963624499072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.704238:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.704253:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124578200/0x87925e4cb73b1fde lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840fef2 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143824.704272:0:13430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a4e, atime: 0x68140a4d, ctime: 0x68140a4e, blocks: 0x748 00010000:00010000:0.0:1746143824.704287:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.704288:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.704294:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880124578200/0x87925e4cb73b1fde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fef2 expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.704307:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124578200/0x87925e4cb73b1fde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840fef2 expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.704315:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124578200, rc 0) 00000100:00100000:0.0:1746143824.704347:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963624499072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 125us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.704352:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15452 00000100:00100000:0.0:1746143824.704366:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15454 00000100:00100000:0.0:1746143824.704371:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963624499584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.704376:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.704382:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b1fec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ff0e expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143824.704459:0:13430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4804992, mtime: 0x68140a50, atime: 0x68140a50, ctime: 0x68140a50, blocks: 0x14b8 00010000:00010000:0.0:1746143824.704469:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.704471:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.704475:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b1fec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff0e expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.704499:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b1fec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff0e expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.704506:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87000, rc 0) 00000100:00100000:0.0:1746143824.704523:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963624499584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 152us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.704528:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15454 00000100:00100000:0.0:1746143824.705202:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.705214:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624499456 00000100:00100000:0.0:1746143824.705216:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624499456 00000100:00100000:0.0:1746143824.705231:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15456 00000100:00100000:0.0:1746143824.705236:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963624499456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.705242:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.705249:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ff07 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143824.705259:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a50, atime: 0x68140a50, ctime: 0x68140a50, blocks: 0x808 00010000:00010000:0.0:1746143824.705268:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.705269:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.705273:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff07 expref: 38 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.705281:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff07 expref: 38 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.705293:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fa00, rc 0) 00000100:00100000:0.0:1746143824.705311:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963624499456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 75us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.705316:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15456 00000100:00100000:0.0:1746143824.711573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.712274:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.712294:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624500096 00000100:00100000:0.0:1746143824.712299:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624500096 00002000:00100000:0.0:1746143824.712335:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880090e78380 x1830963624500096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:220/0 lens 488/0 e 0 to 0 dl 1746143835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.712343:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78380 with x1830963624500096 ext(0->1048575) 00002000:00010000:0.0:1746143824.712347:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e78380 00000100:00100000:0.0:1746143824.713334:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.713366:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.713398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.713412:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624500352 00000100:00100000:0.0:1746143824.713416:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624500352 00002000:00100000:0.0:1746143824.713436:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880135b08a80 x1830963624500352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:220/0 lens 488/0 e 0 to 0 dl 1746143835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.713444:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08a80 with x1830963624500352 ext(1048576->2097151) 00002000:00010000:0.0:1746143824.713448:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08a80 00000100:00100000:0.0:1746143824.713475:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624500864 00000100:00100000:0.0:1746143824.713477:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624500864 00002000:00100000:0.0:1746143824.713498:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880135b09500 x1830963624500864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:220/0 lens 488/0 e 0 to 0 dl 1746143835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.713510:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09500 with x1830963624500864 ext(1048576->2097151) 00002000:00010000:0.0:1746143824.713513:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09500 00000100:00100000:0.0:1746143824.713525:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6616 00000100:00100000:0.0:1746143824.713530:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624500608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143824.715686:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.715721:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624500992 00000100:00100000:0.0:1746143824.715728:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624500992 00000100:00100000:0.0:1746143824.715781:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 924 00000100:00100000:0.0:1746143824.715789:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+50:2008:x1830963624500992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143824.715803:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143824.715827:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b2016 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff15 expref: 50 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.715846:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143824.715851:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143824.715897:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+49:2008:x1830963624500992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.715903:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 924 00000100:00100000:0.0:1746143824.718571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.720430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.720449:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.720464:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624501248 00000100:00100000:0.0:1746143824.720473:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624501248 00000100:00100000:0.0:1746143824.720528:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624501504 00000100:00100000:0.0:1746143824.720530:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624501504 00000100:00100000:0.0:1746143824.720557:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624501760 00000100:00100000:0.0:1746143824.720559:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624501760 00000100:00100000:0.0:1746143824.720572:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15457 00000100:00100000:0.0:1746143824.720579:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624501248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.720598:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.720616:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b2024 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ff23 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.720638:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.720640:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.720648:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b2024 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff23 expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.720663:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b2024 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff23 expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.720674:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3400, rc 0) 00000100:00100000:0.0:1746143824.720715:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963624501248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 136us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.720720:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15457 00000100:00100000:0.0:1746143824.720734:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15458 00000100:00100000:0.0:1746143824.720737:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624501504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.720743:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.720751:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b202b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ff31 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.720762:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.720763:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.720767:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b202b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff31 expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.720775:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b202b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff31 expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.720781:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:0.0:1746143824.720794:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624501504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.720798:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15458 00000100:00100000:0.0:1746143824.720807:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15459 00000100:00100000:0.0:1746143824.720811:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624501760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143824.720816:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.720821:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097338000/0x87925e4cb73b2032 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ff3f expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143824.720858:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627289984:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143824.720928:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143824.720958:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.720968:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624501120 00000100:00100000:0.0:1746143824.720971:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624501120 00000100:00100000:0.0:1746143824.743584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.745295:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.745391:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.746095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.746250:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.746271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.746406:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6623 00000100:00100000:0.0:1746143824.746416:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963624503296:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143824.751957:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.771728:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.776474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.776892:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.787820:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.787875:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.788710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.793299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.793335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.802179:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.803782:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.804876:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.815198:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624506496 00000100:00100000:0.0:1746143824.815202:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624506496 00002000:00100000:0.0:1746143824.815222:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3842048->3846143) req@ffff880093f78000 x1830963624506496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:220/0 lens 488/0 e 0 to 0 dl 1746143835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.815230:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f78000 with x1830963624506496 ext(3842048->3846143) 00002000:00010000:0.0:1746143824.815234:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f78000 00000100:00100000:0.0:1746143824.815256:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6628 00000100:00100000:0.0:1746143824.815262:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624506496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143824.815363:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624506496:12345-192.168.202.3@tcp:3:cat.0 Request processed in 100us (262us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143824.815370:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6628 00002000:00100000:0.0:1746143824.815376:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3842048->3846143) req@ffff880093f78000 x1830963624506496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:220/0 lens 488/4536 e 0 to 0 dl 1746143835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143824.815384:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f78000 with x1830963624506496 ext(3842048->3846143) 00002000:00010000:0.0:1746143824.815387:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f78000 00000100:00100000:0.0:1746143824.828523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.828572:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.831222:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.833940:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.833978:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.846874:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.852324:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.853504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.869783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.872751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.883566:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.894278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.896644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.899793:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.903098:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.903131:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.903152:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.903168:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.903194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.903217:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624509952 00000100:00100000:0.0:1746143824.903225:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624509952 00000100:00100000:0.0:1746143824.903263:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624510336 00000100:00100000:0.0:1746143824.903265:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624510336 00000100:00100000:0.0:1746143824.903298:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624510208 00000100:00100000:0.0:1746143824.903300:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624510208 00000100:00100000:0.0:1746143824.903330:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15471 00000100:00100000:0.0:1746143824.903336:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624510080:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143824.903345:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.903358:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b209b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ff7e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.903378:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.903380:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.903390:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b209b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff7e expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.903403:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b209b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff7e expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.903413:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f200, rc 0) 00000100:00100000:0.0:1746143824.903452:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963624510080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.903464:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15471 00000100:00100000:0.0:1746143824.903530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.905826:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.908907:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.912156:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.914615:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143824.915139:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143824.915376:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+25:2011:x1830963624511232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 422us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.915383:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7393 00000100:00100000:0.0:1746143824.917465:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.920430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.920462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.920499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.920809:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.921083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.921386:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624511872 00000100:00100000:0.0:1746143824.921390:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624511872 00000100:00100000:0.0:1746143824.921409:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15477 00000100:00100000:0.0:1746143824.921414:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624512000:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143824.921430:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73b2104 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.921441:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff07 expref: 37 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.921447:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73b2094 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff8c expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.921454:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b202b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff31 expref: 15 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.921460:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.921461:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.921463:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73b2104 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.921477:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b202b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff31 expref: 15 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.922211:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b202b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff31 expref: 15 pid: 13430 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.922220:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627292288:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.922245:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73b2094 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff8c expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.922252:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73b2094 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff8c expref: 11 pid: 3135 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.922259:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627293440:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.922277:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff07 expref: 37 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.922284:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff07 expref: 37 pid: 1945 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.922290:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627293568:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143824.922303:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143824.922348:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.924753:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627292672:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143824.924763:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627292800:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143824.924770:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627292928:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143824.924799:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143824.929043:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.929066:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624512640 00000100:00100000:0.0:1746143824.929073:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624512640 00010000:00010000:0.0:1746143824.929107:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b20a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff85 expref: 13 pid: 1947 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.929145:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7394 00000100:00100000:0.0:1746143824.929152:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624512640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143824.929165:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143824.929185:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b20a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff85 expref: 13 pid: 1947 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746143824.929195:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b20a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff85 expref: 13 pid: 1947 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746143824.929452:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e1d4200/0x87925e4cb73b20a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff85 expref: 13 pid: 1947 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746143824.929479:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143824.929537:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624512640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 385us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.929543:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7394 00000100:00100000:0.0:1746143824.929605:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624513408 00000100:00100000:0.0:1746143824.929607:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624513408 00010000:00010000:0.0:1746143824.929620:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b2055 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff4d expref: 41 pid: 13430 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143824.930574:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624512512 00000100:00100000:0.0:1746143824.930577:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624512512 00010000:00010000:0.0:1746143824.930591:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b2024 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff23 expref: 26 pid: 13430 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.930604:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624513152 00000100:00100000:0.0:1746143824.930605:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624513152 00010000:00010000:0.0:1746143824.930613:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73b1fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff00 expref: 42 pid: 3135 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.930621:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624512896 00000100:00100000:0.0:1746143824.930622:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624512896 00010000:00010000:0.0:1746143824.930628:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b2040 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff2a expref: 27 pid: 12328 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.930634:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624513024 00000100:00100000:0.0:1746143824.930635:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624513024 00010000:00010000:0.0:1746143824.930643:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55cc00/0x87925e4cb73b2094 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff8c expref: 13 pid: 3135 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.930650:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624513536 00000100:00100000:0.0:1746143824.930651:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624513536 00010000:00010000:0.0:1746143824.930657:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b1ffa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff07 expref: 38 pid: 1945 timeout: 984 lvb_type: 1 00000100:00100000:0.0:1746143824.930785:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7397 00000100:00100000:0.0:1746143824.930791:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963624513152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143824.930797:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143824.931325:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73b1fe5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff00 expref: 40 pid: 3135 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746143824.931339:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73b1fe5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff00 expref: 40 pid: 3135 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746143824.931358:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084600/0x87925e4cb73b1fe5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ff00 expref: 40 pid: 3135 timeout: 984 lvb_type: 1 00010000:00010000:0.0:1746143824.931372:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.931373:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.931377:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097369e00/0x87925e4cb73b2112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.931385:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097369e00/0x87925e4cb73b2112 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.931411:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143824.932989:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963624513152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2194us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.932997:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7397 00010000:00010000:0.0:1746143824.933070:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933078:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933096:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933102:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933108:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933113:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a45800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143824.933116:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933122:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933132:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143824.933138:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b210b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143824.933175:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624512256:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 11495us (12365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.933181:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15478 00000100:00100000:0.0:1746143824.933661:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.933697:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.935139:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.937749:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.937782:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.937807:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.938188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.938212:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.940181:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143824.942382:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944657 is committed 00000004:00080000:0.0:1746143824.942389:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2334 committed 00000004:00080000:0.0:1746143824.942586:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2328 committed 00000004:00080000:0.0:1746143824.942604:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2327 committed 00000004:00080000:0.0:1746143824.942606:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2326 committed 00000004:00080000:0.0:1746143824.942607:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2325 committed 00000004:00080000:0.0:1746143824.942609:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2333 committed 00000004:00080000:0.0:1746143824.942610:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2324 committed 00000004:00080000:0.0:1746143824.942611:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2332 committed 00000004:00080000:0.0:1746143824.942613:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2323 committed 00000004:00080000:0.0:1746143824.942615:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2331 committed 00000004:00080000:0.0:1746143824.942616:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2330 committed 00000004:00080000:0.0:1746143824.942618:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2329 committed 00000004:00080000:0.0:1746143824.942620:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2322 committed 00000004:00080000:0.0:1746143824.942621:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2321 committed 00000004:00080000:0.0:1746143824.942623:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2328 committed 00000004:00080000:0.0:1746143824.942624:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2327 committed 00000004:00080000:0.0:1746143824.942626:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2320 committed 00000001:00080000:0.0:1746143824.942631:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944656 is committed 00000001:00080000:0.0:1746143824.942642:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944652 is committed 00000100:00100000:0.0:1746143824.943243:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627295360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.943909:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143824.943937:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627295616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.943953:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143824.944332:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627296128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.944545:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627295616 00000100:00100000:0.0:1746143824.944548:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627295616 00000100:00100000:0.0:1746143824.944568:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15485 00000100:00100000:0.0:1746143824.944572:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3774:x1830963627295104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.944631:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3774:x1830963627295104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (721us total) trans 17179873754 rc 0/0 00000100:00100000:0.0:1746143824.944637:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15485 00000100:00100000:0.0:1746143824.944648:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15487 00000100:00100000:0.0:1746143824.944652:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963627294848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.944699:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963627294848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (368us total) trans 17179873756 rc 0/0 00000100:00100000:0.0:1746143824.944705:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15487 00000100:00100000:0.0:1746143824.944713:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627295744 00000100:00100000:0.0:1746143824.944716:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627295744 00000100:00100000:0.0:1746143824.944735:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15488 00000100:00100000:0.0:1746143824.944739:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3771:x1830963627295232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.944785:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963627295232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (291us total) trans 17179873757 rc 0/0 00000100:00100000:0.0:1746143824.944790:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15488 00000100:00100000:0.0:1746143824.944798:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15490 00000100:00100000:0.0:1746143824.944802:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3771:x1830963627296256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143824.944841:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143824.944844:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143824.944846:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143824.944848:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143824.944850:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143824.944862:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627296256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (142us total) trans 21474841037 rc 0/0 00000100:00100000:0.0:1746143824.944866:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15490 00000100:00100000:0.0:1746143824.944873:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15491 00000100:00100000:0.0:1746143824.944876:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3771:x1830963627296768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.944931:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627296768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (193us total) trans 21474841038 rc 0/0 00000100:00100000:0.0:1746143824.944936:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15491 00000100:00100000:0.0:1746143824.944952:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143824.944963:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627295872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.944976:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143824.944984:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627296384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.944995:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143824.945013:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627296384 00000100:00100000:0.0:1746143824.945016:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627296384 00000100:00100000:0.0:1746143824.945592:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15493 00000100:00100000:0.0:1746143824.945598:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627295872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.946131:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963627295872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (679us total) trans 21474841039 rc 0/0 00000100:00100000:0.0:1746143824.946138:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15493 00000004:00080000:0.0:1746143824.946164:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1db480/2, rc 0, transno 17179873759 00000100:00100000:0.0:1746143824.946168:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627295360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143824.946176:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f79880/2, rc 0, transno 21474841039 00000100:00100000:0.0:1746143824.946178:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627295872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143824.946183:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33100/2, rc 0, transno 21474841040 00000100:00100000:0.0:1746143824.946186:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627296384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.946251:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143824.946270:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627296640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.946291:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143824.946310:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9f80/2, rc 0, transno 17179873754 00000100:00100000:0.0:1746143824.946314:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627295104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143824.946321:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1da680/2, rc 0, transno 17179873755 00000100:00100000:0.0:1746143824.946323:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627295616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.946334:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627296128 00000100:00100000:0.0:1746143824.946338:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627296128 00000100:00100000:0.0:1746143824.946352:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627296640 00000100:00100000:0.0:1746143824.946354:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627296640 00000100:00100000:0.0:1746143824.946363:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15495 00000100:00100000:0.0:1746143824.946367:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3774:x1830963627296128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.946427:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963627296128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (175us total) trans 21474841041 rc 0/0 00000100:00100000:0.0:1746143824.946432:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15495 00000100:00100000:0.0:1746143824.946441:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15496 00000100:00100000:0.0:1746143824.946445:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3774:x1830963627296640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143824.946503:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963627296640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (210us total) trans 21474841042 rc 0/0 00000100:00100000:0.0:1746143824.946508:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15496 00000004:00080000:0.0:1746143824.946526:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f78e00/2, rc 0, transno 21474841041 00000100:00100000:0.0:1746143824.946529:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627296128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143824.946535:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33800/2, rc 0, transno 21474841042 00000100:00100000:0.0:1746143824.946537:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627296640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143824.947004:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59180/2, rc 0, transno 17179873760 00000100:00100000:0.0:1746143824.947008:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627296896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143824.948691:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.950722:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.953564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.953598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.953719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.954063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.954658:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.954668:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624516352 00000100:00100000:0.0:1746143824.954670:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624516352 00000100:00100000:0.0:1746143824.954994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.955005:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624516608 00000100:00100000:0.0:1746143824.955007:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624516608 00000100:00100000:0.0:1746143824.955021:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15502 00000100:00100000:0.0:1746143824.955026:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624516608:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143824.955031:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143824.955040:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73b2158 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424840ffe0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143824.955051:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4804992, mtime: 0x68140a51, atime: 0x68140a50, ctime: 0x68140a51, blocks: 0x14b8 00010000:00010000:0.0:1746143824.955532:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.955533:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143824.955539:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73b2158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ffe0 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.955548:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb3800/0x87925e4cb73b2158 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840ffe0 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143824.955555:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb3800, rc 0) 00000100:00100000:0.0:1746143824.955571:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624516608:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 545us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.955576:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15502 00000100:00100000:0.0:1746143824.959457:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.959506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.959536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.959561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.959575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.959642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.959671:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15505 00000100:00100000:0.0:1746143824.959676:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624517120:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143824.959770:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624517120:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.959776:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15505 00000100:00100000:0.0:1746143824.959795:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15509 00000100:00100000:0.0:1746143824.959800:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624517504:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143824.959828:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624517504:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.959833:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15509 00000100:00100000:0.0:1746143824.963336:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.963495:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.963524:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.963550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.963561:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.963588:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.963624:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15511 00000100:00100000:0.0:1746143824.963630:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624517888:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143824.963724:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624517888:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.963730:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15511 00000100:00100000:0.0:1746143824.963747:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15513 00000100:00100000:0.0:1746143824.963750:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624517760:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143824.963778:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624517760:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.963782:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15513 00000100:00100000:0.0:1746143824.963790:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15514 00000100:00100000:0.0:1746143824.963794:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624518016:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143824.963820:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624518016:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143824.963827:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15514 00000100:00100000:0.0:1746143824.967220:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.969946:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.976851:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.977472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.982106:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.982682:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.983776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143824.983804:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.006028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.008359:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624520704 00000100:00100000:0.0:1746143825.008367:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624520704 00000100:00100000:0.0:1746143825.008411:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15518 00000100:00100000:0.0:1746143825.008417:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624520704:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143825.008541:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143825.008544:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143822 -> 1746143825 00002000:00010000:0.0:1746143825.008546:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143821 -> 1746143825 00002000:00010000:0.0:1746143825.008548:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143822 -> 1746143825 00002000:00010000:0.0:1746143825.008549:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:0.0:1746143825.008590:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624520704:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 173us (282us total) trans 17179873762 rc 0/0 00000100:00100000:0.0:1746143825.008597:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15518 00000100:00100000:0.0:1746143825.009357:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.009381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.009437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.009766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.009787:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.011352:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.013603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143825.017792:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944659 is committed 00000004:00080000:0.0:1746143825.017805:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2342 committed 00000004:00080000:0.0:1746143825.018067:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2337 committed 00000004:00080000:0.0:1746143825.018073:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2336 committed 00000004:00080000:0.0:1746143825.018075:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2335 committed 00000004:00080000:0.0:1746143825.018077:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2334 committed 00000004:00080000:0.0:1746143825.018079:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2341 committed 00000004:00080000:0.0:1746143825.018081:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2333 committed 00000004:00080000:0.0:1746143825.018082:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2340 committed 00000004:00080000:0.0:1746143825.018084:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2332 committed 00000004:00080000:0.0:1746143825.018085:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2339 committed 00000004:00080000:0.0:1746143825.018218:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2338 committed 00000004:00080000:0.0:1746143825.018221:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2337 committed 00000004:00080000:0.0:1746143825.018223:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2331 committed 00000004:00080000:0.0:1746143825.018224:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2330 committed 00000004:00080000:0.0:1746143825.018225:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2336 committed 00000004:00080000:0.0:1746143825.018227:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2335 committed 00000004:00080000:0.0:1746143825.018230:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2329 committed 00000100:00100000:0.0:1746143825.018260:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627297152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.018318:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627297408 00000100:00100000:0.0:1746143825.018324:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627297408 00000100:00100000:0.0:1746143825.018354:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627297280 00000100:00100000:0.0:1746143825.018356:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627297280 00000100:00100000:0.0:1746143825.018370:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627297664 00000100:00100000:0.0:1746143825.018372:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627297664 00000100:00100000:0.0:1746143825.018383:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15525 00000100:00100000:0.0:1746143825.018387:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627297280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143825.018498:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143825.018501:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.018503:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.018506:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.018507:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143825.018534:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963627297280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (202us total) trans 21474841048 rc 0/0 00000100:00100000:0.0:1746143825.018540:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15525 00000100:00100000:0.0:1746143825.020227:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.020254:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627297792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143825.020272:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.020283:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627298304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.020294:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.020370:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627298816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.020384:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.020411:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15538 00000100:00100000:0.0:1746143825.020417:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627297792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143825.020462:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143825.020465:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.020466:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.020468:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.020470:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143825.020500:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627297792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (226us total) trans 21474841055 rc 0/0 00000100:00100000:0.0:1746143825.020505:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15538 00000004:00080000:0.0:1746143825.020811:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5b800/2, rc 0, transno 17179873771 00000100:00100000:0.0:1746143825.020814:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627297152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.020821:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30700/2, rc 0, transno 21474841055 00000100:00100000:0.0:1746143825.020824:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627297792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143825.020829:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5a300/2, rc 0, transno 17179873772 00000100:00100000:0.0:1746143825.020832:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627298304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.021042:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58e00/2, rc 0, transno 17179873773 00000100:00100000:0.0:1746143825.021045:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627298816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.022892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.038664:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.047280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.058863:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.060955:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.061005:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143825.064842:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944663 is committed 00000004:00080000:0.0:1746143825.064850:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2350 committed 00000004:00080000:0.0:1746143825.064866:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2346 committed 00000004:00080000:0.0:1746143825.064876:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2345 committed 00000004:00080000:0.0:1746143825.064878:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2344 committed 00000004:00080000:0.0:1746143825.064879:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2343 committed 00000004:00080000:0.0:1746143825.064881:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2349 committed 00000004:00080000:0.0:1746143825.064882:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2342 committed 00000004:00080000:0.0:1746143825.064883:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2348 committed 00000004:00080000:0.0:1746143825.064884:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2341 committed 00000004:00080000:0.0:1746143825.064885:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2347 committed 00000004:00080000:0.0:1746143825.064887:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2346 committed 00000004:00080000:0.0:1746143825.064888:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2345 committed 00000004:00080000:0.0:1746143825.064889:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2340 committed 00000004:00080000:0.0:1746143825.064891:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2339 committed 00000004:00080000:0.0:1746143825.064892:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2344 committed 00000004:00080000:0.0:1746143825.064893:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2343 committed 00000004:00080000:0.0:1746143825.064894:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2338 committed 00000001:00080000:0.0:1746143825.064903:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944661 is committed 00000001:00080000:0.0:1746143825.064906:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944660 is committed 00000100:00100000:0.0:1746143825.065269:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627299584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.067214:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.067233:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627300096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143825.067262:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.067280:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627300608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143825.067293:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.067303:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627301120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143825.067317:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.067338:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15551 00000100:00100000:0.0:1746143825.067343:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627300096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143825.067382:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143825.067385:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.067386:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.067387:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143825 -> 1746143825 00002000:00010000:0.0:1746143825.067389:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143825.067408:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627300096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (145us total) trans 21474841061 rc 0/0 00000100:00100000:0.0:1746143825.067413:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15551 00000004:00080000:0.0:1746143825.067530:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb6d80/2, rc 0, transno 21474841061 00000100:00100000:0.0:1746143825.067534:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627300096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143825.067539:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4700/2, rc 0, transno 21474841062 00000100:00100000:0.0:1746143825.067542:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627300608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143825.067547:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb5500/2, rc 0, transno 21474841063 00000100:00100000:0.0:1746143825.067549:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627301120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143825.067740:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.068081:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627300736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.068098:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.068119:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627301248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.068132:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143825.068501:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9500/2, rc 0, transno 17179873774 00000100:00100000:0.0:1746143825.068508:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627299840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.068516:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7aa00/2, rc 0, transno 17179873775 00000100:00100000:0.0:1746143825.068519:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627300352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.068526:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4380/2, rc 0, transno 21474841057 00000100:00100000:0.0:1746143825.068529:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627300864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143825.068535:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb7b80/2, rc 0, transno 21474841058 00000100:00100000:0.0:1746143825.068537:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627301376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143825.068546:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1da300/2, rc 0, transno 17179873776 00000100:00100000:0.0:1746143825.068662:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627299712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.068679:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627301632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.068699:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.068936:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15555 00000100:00100000:0.0:1746143825.068941:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627300736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.069182:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3772:x1830963627300736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (1083us total) trans 17179873781 rc 0/0 00000100:00100000:0.0:1746143825.069187:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15555 00000004:00080000:0.0:1746143825.069204:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b100/2, rc 0, transno 17179873780 00000100:00100000:0.0:1746143825.069207:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627301632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.069213:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d8380/2, rc 0, transno 17179873779 00000100:00100000:0.0:1746143825.069215:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627299584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.069225:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b800/2, rc 0, transno 17179873781 00000100:00100000:0.0:1746143825.069228:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627300736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.069233:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79f80/2, rc 0, transno 17179873778 00000100:00100000:0.0:1746143825.069235:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627301248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143825.069433:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7ad80/2, rc 0, transno 17179873782 00000100:00100000:0.0:1746143825.069436:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627300224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143825.074123:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.077154:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.079354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.082122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.083668:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.084843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.086797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.092088:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.097147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.101426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.101476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.101529:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.102342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.102355:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624525696 00000100:00100000:0.0:1746143825.102357:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624525696 00000100:00100000:0.0:1746143825.103499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.106125:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.106522:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.106545:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.106565:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624526336 00000100:00100000:0.0:1746143825.106570:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624526336 00000100:00100000:0.0:1746143825.106873:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15566 00000100:00100000:0.0:1746143825.106880:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624526336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.106898:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.106939:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b2285 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410057 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.106960:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.106962:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.106971:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b2285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410057 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.106985:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b2285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410057 expref: 15 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.107111:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26200, rc 0) 00000100:00100000:0.0:1746143825.107151:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624526336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 271us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.107156:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15566 00000100:00100000:0.0:1746143825.107170:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15567 00000100:00100000:0.0:1746143825.107175:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963624526592:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.107182:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.107191:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b228c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410065 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.107204:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.107206:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.107210:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b228c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410065 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.107220:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b228c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410065 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.107226:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27a00, rc 0) 00000100:00100000:0.0:1746143825.107239:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963624526592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.107253:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15567 00000100:00100000:0.0:1746143825.107374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.107387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.107441:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15570 00000100:00100000:0.0:1746143825.107446:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963624526720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.107453:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.107460:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26400/0x87925e4cb73b22a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841006c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143825.107482:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627302784:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143825.107513:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.110701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.115533:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624527872 00000100:00100000:0.0:1746143825.115543:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624527872 00002000:00100000:0.0:1746143825.115589:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092144a80 x1830963624527872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:221/0 lens 488/0 e 0 to 0 dl 1746143836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.115599:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144a80 with x1830963624527872 ext(1048576->2097151) 00002000:00010000:0.0:1746143825.115604:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092144a80 00000100:00100000:0.0:1746143825.115626:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6647 00000100:00100000:0.0:1746143825.115633:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624527872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143825.116974:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624528256 00000100:00100000:0.0:1746143825.116979:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624528256 00002000:00100000:0.0:1746143825.116997:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1937407) req@ffff88009719ea00 x1830963624528256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:221/0 lens 488/0 e 0 to 0 dl 1746143836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.117003:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ea00 with x1830963624528256 ext(1048576->1937407) 00002000:00010000:0.0:1746143825.117007:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ea00 00000100:00100000:0.0:1746143825.117020:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6650 00000100:00100000:0.0:1746143825.117025:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963624528256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143825.122541:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.126819:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.133008:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.133183:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624528256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16156us (16403us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746143825.133190:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6650 00002000:00100000:0.0:1746143825.133196:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1937407) req@ffff88009719ea00 x1830963624528256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:221/0 lens 488/440 e 0 to 0 dl 1746143836 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.133203:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ea00 with x1830963624528256 ext(1048576->1937407) 00002000:00010000:0.0:1746143825.133207:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ea00 00000100:00100000:0.0:1746143825.145814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.151302:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963624529408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5235us (5498us total) trans 0 rc 667648/667648 00000100:00100000:0.0:1746143825.151312:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6654 00002000:00100000:0.0:1746143825.151322:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2478080->3145727) req@ffff880129dc0a80 x1830963624529408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:221/0 lens 488/440 e 0 to 0 dl 1746143836 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.151331:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0a80 with x1830963624529408 ext(2478080->3145727) 00002000:00010000:0.0:1746143825.151335:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0a80 00000100:00100000:0.0:1746143825.154384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.154457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.156498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.161017:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.162278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.171067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.171103:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.175968:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.177240:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.183827:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.186269:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.193374:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.199367:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.206892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.208515:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624532736 00000100:00100000:0.0:1746143825.208518:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624532736 00002000:00100000:0.0:1746143825.208534:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009719f480 x1830963624532736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:221/0 lens 488/0 e 0 to 0 dl 1746143836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.208540:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f480 with x1830963624532736 ext(2097152->4194303) 00002000:00010000:0.0:1746143825.208544:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719f480 00000100:00100000:0.0:1746143825.208565:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6660 00000100:00100000:0.0:1746143825.208569:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624532736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143825.209991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.210008:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624533120 00000100:00100000:0.0:1746143825.210011:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624533120 00010000:00010000:0.0:1746143825.210023:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b222a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841001f expref: 264 pid: 7244 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143825.210042:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7427 00000100:00100000:0.0:1746143825.210047:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963624533120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143825.210053:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143825.210057:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b222a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841001f expref: 264 pid: 7244 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143825.210584:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b222a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841001f expref: 264 pid: 7244 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143825.210597:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b222a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841001f expref: 264 pid: 7244 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143825.213198:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143825.213208:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b22d9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143825.213219:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b22d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143825.213227:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b22d9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143825.213473:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143825.214322:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963624533120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4267us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.214334:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7427 00000100:00100000:0.0:1746143825.216831:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.229402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.238719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.245978:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624534400 00000100:00100000:0.0:1746143825.245986:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624534400 00000100:00100000:0.0:1746143825.246031:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5225 00000100:00100000:0.0:1746143825.246038:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2111:x1830963624534400:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143825.246344:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2111:x1830963624534400:12345-192.168.202.3@tcp:35:cat.0 Request processed in 305us (455us total) trans 8589944671 rc 0/0 00000100:00100000:0.0:1746143825.246351:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5225 00000100:00100000:0.0:1746143825.249058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.253626:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.253660:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.253694:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.255693:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.260631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.263302:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.271828:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.276277:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.278120:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.280228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.285310:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.364744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.364804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.365590:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13718 00000100:00100000:0.0:1746143825.365598:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+267:2126:x1830963624537088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.365608:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.365616:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b6800/0x87925e4cb73b2342 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484100ce expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.365679:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b2349 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.365685:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b2349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.365692:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b2349 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.365699:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7e00/0x87925e4cb73b2350 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.365704:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7e00/0x87925e4cb73b2350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.365709:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913b7e00/0x87925e4cb73b2350 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143825.374046:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624537472 00000100:00100000:0.0:1746143825.374051:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624537472 00000100:00100000:0.0:1746143825.374074:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15581 00000100:00100000:0.0:1746143825.374079:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963624537472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.374088:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.374097:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b236c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484100dc expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143825.374123:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627305216:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143825.374369:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.384295:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624537600 00000100:00100000:0.0:1746143825.384303:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624537600 00000100:00100000:0.0:1746143825.384346:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15582 00000100:00100000:0.0:1746143825.384353:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2127:x1830963624537600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.384367:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.384381:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b2373 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484100e3 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.384403:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b2311 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->364543) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b9 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.384410:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143825.384411:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143825.384414:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b2373 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484100e3 expref: 16 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.384439:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b2311 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->364543) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b9 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.384449:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b2311 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 245760->364543) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b9 expref: 40 pid: 13436 timeout: 984 lvb_type: 0 00000100:00100000:0.0:1746143825.384459:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627305344:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143825.384549:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.387100:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627305344:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143825.387128:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b2373 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484100e3 expref: 16 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.387143:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7400, rc 0) 00000100:00100000:0.0:1746143825.387173:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2127:x1830963624537600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2821us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.387180:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15582 00000100:00100000:0.0:1746143825.394599:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963624537984:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7637us (7982us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143825.394607:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6667 00002000:00100000:0.0:1746143825.394612:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719ed80 x1830963624537984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:221/0 lens 488/440 e 0 to 0 dl 1746143836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.394620:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ed80 with x1830963624537984 ext(1048576->2097151) 00002000:00010000:0.0:1746143825.394624:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ed80 00000100:00100000:0.0:1746143825.402070:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.404627:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.409639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.409674:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.409710:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.415476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.419057:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.429621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.436799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.436856:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.455859:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.456368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.459498:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.466324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.468807:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.482773:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.488566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.539850:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.550344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.550404:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.557280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.566041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.567328:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.569029:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.573249:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.645294:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.653202:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.653258:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.656302:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.664026:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.671037:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.671807:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143825.671822:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627306880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143825.671861:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.672443:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627306880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143825.674409:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624544256:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3102us (3375us total) trans 17179873787 rc 0/0 00000100:00100000:0.0:1746143825.674423:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2502 00002000:00100000:0.0:1746143825.674434:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2224128->2326527) req@ffff880093cfa300 x1830963624544256/t17179873787(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:221/0 lens 488/448 e 0 to 0 dl 1746143836 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.674442:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa300 with x1830963624544256 ext(2224128->2326527) 00010000:00010000:0.0:1746143825.674452:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d75400/0x87925e4cb73b23f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410114 expref: 20 pid: 13436 timeout: 984 lvb_type: 0 00010000:00010000:0.0:1746143825.674465:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d75400/0x87925e4cb73b23f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410114 expref: 20 pid: 13436 timeout: 984 lvb_type: 0 00002000:00010000:0.0:1746143825.674471:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cfa300 00000100:00100000:0.0:1746143825.680112:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.689475:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624544896 00000100:00100000:0.0:1746143825.689489:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624544896 00000100:00100000:0.0:1746143825.693888:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.693961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.693993:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.694026:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.694405:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15590 00000100:00100000:0.0:1746143825.694410:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2010:x1830963624545536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.694420:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.694433:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085e00/0x87925e4cb73b2453 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841013e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143825.694474:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cf8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627307136:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143825.695604:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.695766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.698532:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.698782:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.703082:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963627307392:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703364:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.703404:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627307904:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703425:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.703472:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627307904 00000100:00100000:0.0:1746143825.703475:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627307904 00000100:00100000:0.0:1746143825.703520:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627307776 00000100:00100000:0.0:1746143825.703522:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627307776 00000100:00100000:0.0:1746143825.703539:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1746143825.703544:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627307904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703573:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627307904:12345-0@lo:400:kworker.0 Request processed in 29us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.703578:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:0.0:1746143825.703587:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1746143825.703591:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627307776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703613:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627307776:12345-0@lo:400:kworker.0 Request processed in 21us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.703616:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1746143825.703628:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3774:1830963627308160:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703646:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.703666:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963627308416:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703682:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143825.703839:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627307904:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703846:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963627307392:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703865:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1746143825.703871:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963627308416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703894:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963627308416:12345-0@lo:400:kworker.0 Request processed in 24us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.703898:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1746143825.703936:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3774:1830963627308160:0@lo:400:kworker.0 00000100:00100000:0.0:1746143825.703953:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963627308416:0@lo:400:kworker.0 00000100:00080000:0.0:1746143825.704132:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143825.716152:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.716208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.716499:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15592 00000100:00100000:0.0:1746143825.716507:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963624546432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.716516:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.716527:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b2468 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841014c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143825.716555:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627308800:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143825.716655:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.724881:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.728635:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.728691:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.728712:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.745784:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.750219:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.750783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.752836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.753821:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.756507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.757603:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.767709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.771386:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.771428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.775824:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.780878:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.780956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.783598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.787983:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624550656 00000100:00100000:0.0:1746143825.787992:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624550656 00010000:00010000:0.0:1746143825.788029:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b23ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841011b expref: 43 pid: 13436 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143825.788055:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7444 00000100:00100000:0.0:1746143825.788061:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963624550656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143825.788076:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143825.788095:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b23ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841011b expref: 44 pid: 13436 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143825.788107:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b23ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2424832->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841011b expref: 44 pid: 13436 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143825.788134:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b23ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2424832->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841011b expref: 45 pid: 13436 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143825.788160:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.788161:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.788166:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b24c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841018b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.788423:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b24c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841018b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.788455:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b24c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841018b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143825.788466:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627310208:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143825.788610:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.794554:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.794586:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.794599:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.794613:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.795677:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.795692:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624551552 00000100:00100000:0.0:1746143825.795695:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624551552 00000100:00100000:0.0:1746143825.796430:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624551680 00000100:00100000:0.0:1746143825.796434:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624551680 00000100:00100000:0.0:1746143825.796456:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15608 00000100:00100000:0.0:1746143825.796460:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963624551680:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143825.796474:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e59f000/0x87925e4cb73b2525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.796493:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73b24ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101a7 expref: 42 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.796500:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b24c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841018b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.796505:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.796506:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.796508:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e59f000/0x87925e4cb73b2525 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.796523:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b24c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841018b expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.796530:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b24c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841018b expref: 27 pid: 3135 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143825.796537:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627311104:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143825.796730:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73b24ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484101a7 expref: 42 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.796738:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73b24ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484101a7 expref: 42 pid: 9585 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143825.796751:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627311616:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143825.796761:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.796791:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.796848:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.797770:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624552448 00000100:00100000:0.0:1746143825.797773:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624552448 00002000:00100000:0.0:1746143825.797967:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800939a7100 x1830963624552448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:221/0 lens 488/0 e 0 to 0 dl 1746143836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.797976:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7100 with x1830963624552448 ext(3145728->4194303) 00010000:00010000:0.0:1746143825.797982:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e1d5800/0x87925e4cb73b246f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410153 expref: 20 pid: 12328 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143825.797991:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e1d5800/0x87925e4cb73b246f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410153 expref: 20 pid: 12328 timeout: 985 lvb_type: 0 00002000:00010000:0.0:1746143825.797998:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a7100 00000100:00100000:0.0:1746143825.798010:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2507 00000100:00100000:0.0:1746143825.798016:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624552448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143825.811340:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.811376:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.811405:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.811428:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624552576 00000100:00100000:0.0:1746143825.811435:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624552576 00010000:00010000:0.0:1746143825.811469:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b23ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100ff expref: 46 pid: 13436 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143825.811508:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624552704 00000100:00100000:0.0:1746143825.811510:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624552704 00010000:00010000:0.0:1746143825.811521:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b2269 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841003b expref: 43 pid: 12328 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143825.811533:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624552960 00000100:00100000:0.0:1746143825.811534:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624552960 00010000:00010000:0.0:1746143825.811544:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d2200/0x87925e4cb73b24a0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410168 expref: 17 pid: 3135 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143825.811558:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7445 00000100:00100000:0.0:1746143825.811565:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963624552576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143825.811579:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143825.811601:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b23ab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100ff expref: 46 pid: 13436 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.811612:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b23ab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100ff expref: 46 pid: 13436 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.811640:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143825.811943:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963624552576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 378us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.811948:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7445 00000100:00100000:0.0:1746143825.812040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.812933:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624552448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14916us (15319us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143825.812944:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2507 00002000:00100000:0.0:1746143825.812952:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800939a7100 x1830963624552448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:221/0 lens 488/440 e 0 to 0 dl 1746143836 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143825.812960:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7100 with x1830963624552448 ext(3145728->4194303) 00010000:00010000:0.0:1746143825.812967:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011e1d5800/0x87925e4cb73b246f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410153 expref: 20 pid: 12328 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143825.812975:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011e1d5800/0x87925e4cb73b246f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410153 expref: 20 pid: 12328 timeout: 985 lvb_type: 0 00002000:00010000:0.0:1746143825.812980:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800939a7100 00000100:00100000:0.0:1746143825.814153:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7452 00000100:00100000:0.0:1746143825.814159:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624553472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143825.814168:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143825.814178:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b24a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410176 expref: 13 pid: 12328 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.814186:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b24a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410176 expref: 13 pid: 12328 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.814197:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143825.814217:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624553472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.814225:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7452 00000100:00100000:0.0:1746143825.814245:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627311104:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143825.814254:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624553728 00000100:00100000:0.0:1746143825.814256:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624553728 00010000:00010000:0.0:1746143825.814266:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3a00/0x87925e4cb73b2492 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410161 expref: 44 pid: 3135 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143825.814422:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627311616:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143825.814439:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e59f000/0x87925e4cb73b2525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143825.814464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.814678:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.814701:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.814716:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.814958:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.814967:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624554368 00000100:00100000:0.0:1746143825.814969:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624554368 00010000:00010000:0.0:1746143825.814979:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b229a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841005e expref: 31 pid: 3134 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143825.814999:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7459 00000100:00100000:0.0:1746143825.815003:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963624554368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143825.815009:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143825.815017:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b229a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841005e expref: 31 pid: 3134 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.815025:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b229a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841005e expref: 31 pid: 3134 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.815040:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b229a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841005e expref: 31 pid: 3134 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143825.815272:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.815274:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.815278:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.815285:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2510 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.815298:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143825.815311:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963624554368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 308us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.815317:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7459 00000100:00100000:0.0:1746143825.818951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.819134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.824038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.824164:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.827725:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.829046:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.831428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.831468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.844494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.849139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.863883:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627312768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143825.864012:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624556672 00000100:00100000:0.0:1746143825.864016:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624556672 00000100:00100000:0.0:1746143825.864039:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624556928 00000100:00100000:0.0:1746143825.864041:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624556928 00000100:00100000:0.0:1746143825.864059:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15611 00000100:00100000:0.0:1746143825.864064:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963624556672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.864074:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.864092:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28400/0x87925e4cb73b2564 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484101ca expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143825.864114:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a51, atime: 0x68140a51, ctime: 0x68140a51, blocks: 0x748 00010000:00010000:0.0:1746143825.864131:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.864133:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.864141:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28400/0x87925e4cb73b2564 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101ca expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.864155:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28400/0x87925e4cb73b2564 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101ca expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.864164:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28400, rc 0) 00000100:00100000:0.0:1746143825.864196:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963624556672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.864201:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15611 00000100:00100000:0.0:1746143825.864214:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15612 00000100:00100000:0.0:1746143825.864218:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624556928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143825.864224:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.864234:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b256b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484101d8 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143825.864724:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a51, atime: 0x68140a51, ctime: 0x68140a51, blocks: 0x808 00010000:00010000:0.0:1746143825.864734:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.864736:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.864740:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b256b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101d8 expref: 28 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.864750:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b256b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101d8 expref: 28 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143825.864757:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e29a00, rc 0) 00000100:00100000:0.0:1746143825.865500:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624556928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1278us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.865506:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15612 00000100:00100000:0.0:1746143825.873409:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.883066:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624557440 00000100:00100000:0.0:1746143825.883075:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624557440 00000100:00100000:0.0:1746143825.883130:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15615 00000100:00100000:0.0:1746143825.883139:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2147:x1830963624557440:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143825.883157:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.883176:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73b2580 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484101e6 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.883206:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b2556 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101bc expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.883214:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.883217:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143825.883221:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73b2580 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2383872->3039231] (req 2383872->3039231) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101e6 expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.883253:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b2556 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484101bc expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.883265:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b2556 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484101bc expref: 21 pid: 9839 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143825.883277:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627313024:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143825.883361:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143825.885312:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.886223:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627313024:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143825.886249:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73b2580 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2383872->3039231] (req 2383872->3039231) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101e6 expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.886264:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:0.0:1746143825.886316:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2147:x1830963624557440:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3178us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143825.886323:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15615 00000100:00100000:0.0:1746143825.887428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.889274:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.893997:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.897221:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.929754:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.929805:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624558848 00000100:00100000:0.0:1746143825.929815:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624558848 00000100:00100000:0.0:1746143825.929879:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13730 00000100:00100000:0.0:1746143825.929887:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2153:x1830963624558848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143825.929927:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143825.929947:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73b2587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484101ed expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.931663:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931678:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931688:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931701:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931707:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931712:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931813:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b259c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931822:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b259c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931828:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b259c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143825.931840:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143825.931910:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931929:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931934:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931939:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931943:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143825.931947:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931953:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931963:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143825.931966:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143825.931970:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.931975:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b258e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932001:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932006:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932015:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932019:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143825.932021:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932025:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932031:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14000) 00010000:00010000:0.0:1746143825.932033:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143825.932037:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932041:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b2595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143825.932079:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e24de00/0x87925e4cb73b2587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101ed expref: 276 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.932091:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b259c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484101ed expref: 275 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143825.932097:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143825.932099:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143825.932102:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4a00, rc 0) 00000100:00100000:0.0:1746143825.932172:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+275:2153:x1830963624558848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2285us (2428us total) trans 8589944694 rc 0/0 00000100:00100000:0.0:1746143825.932180:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13730 00000100:00100000:0.0:1746143825.941596:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.943433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.945267:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.948156:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143825.951442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.002553:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.006214:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143826.007051:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143826.023326:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.025578:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.038076:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.041473:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.041525:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.041571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.045017:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624562688 00000100:00100000:0.0:1746143826.045020:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624562688 00000100:00100000:0.0:1746143826.045040:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15621 00000100:00100000:0.0:1746143826.045044:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963624562432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143826.045052:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143826.045068:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1e00/0x87925e4cb73b2621 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841022c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143826.045119:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627313920:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143826.045540:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114b40 going to sleep for 11 seconds 00002000:00010000:0.0:1746143826.048973:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143825 -> 1746143826 00000100:00100000:0.0:1746143826.048994:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627313920:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143826.049016:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1e00/0x87925e4cb73b2621 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841022c expref: 46 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.049026:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1e00/0x87925e4cb73b2621 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841022c expref: 46 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.049043:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1e00, rc 0) 00000100:00100000:0.0:1746143826.049061:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963624562432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4016us (4250us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143826.049066:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15621 00000100:00100000:0.0:1746143826.060648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.060691:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.060721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.061093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.074727:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.087248:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.092558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.095014:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.095106:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.095170:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.105137:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.105155:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624565504 00000100:00100000:0.0:1746143826.105160:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624565504 00010000:00010000:0.0:1746143826.105178:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b256b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484101d8 expref: 30 pid: 9839 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143826.105670:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624565632 00000100:00100000:0.0:1746143826.105673:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624565632 00010000:00010000:0.0:1746143826.105685:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b2628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410225 expref: 44 pid: 9839 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143826.105699:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7469 00000100:00100000:0.0:1746143826.105703:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963624565632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143826.105710:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143826.105717:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b2628 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410225 expref: 44 pid: 9839 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143826.105727:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b2628 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410225 expref: 44 pid: 9839 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143826.105737:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b2628 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410225 expref: 44 pid: 9839 timeout: 985 lvb_type: 1 00010000:00010000:0.0:1746143826.105760:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143826.105776:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963624565632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143826.105782:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7469 00000100:00100000:0.0:1746143826.108074:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.112431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.112465:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.112621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.113329:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.114384:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.115582:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.123755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.129448:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.133816:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.133851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.142223:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.144859:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.149232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.149272:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.157324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.157375:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.163162:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.163356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.181037:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.191718:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.280377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.290994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.294703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.299601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.303813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.325083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.325975:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624572032 00000100:00100000:0.0:1746143826.325979:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624572032 00002000:00100000:0.0:1746143826.325998:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009c4d5c00 x1830963624572032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:222/0 lens 488/0 e 0 to 0 dl 1746143837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143826.326005:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5c00 with x1830963624572032 ext(2097152->4194303) 00002000:00010000:0.0:1746143826.326008:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5c00 00000100:00100000:0.0:1746143826.326019:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6709 00000100:00100000:0.0:1746143826.326024:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624572032:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143826.344216:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624572032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18188us (18310us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143826.344226:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6709 00002000:00100000:0.0:1746143826.344236:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009c4d5c00 x1830963624572032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:222/0 lens 488/440 e 0 to 0 dl 1746143837 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143826.344245:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5c00 with x1830963624572032 ext(2097152->4194303) 00002000:00010000:0.0:1746143826.344249:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5c00 00000100:00100000:0.0:1746143826.346672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.347445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.352205:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.352256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.357666:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.402019:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.407041:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.411326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.411352:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624574080 00000100:00100000:0.0:1746143826.411359:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624574080 00002000:00100000:0.0:1746143826.411399:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1212416->1216511) req@ffff880091d4c000 x1830963624574080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:222/0 lens 488/0 e 0 to 0 dl 1746143837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143826.411545:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c000 with x1830963624574080 ext(1212416->1216511) 00002000:00010000:0.0:1746143826.411551:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4c000 00000100:00100000:0.0:1746143826.411715:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6710 00000100:00100000:0.0:1746143826.411722:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624574080:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143826.412227:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624574080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 504us (900us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143826.412234:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6710 00002000:00100000:0.0:1746143826.412240:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1212416->1216511) req@ffff880091d4c000 x1830963624574080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:222/0 lens 488/4536 e 0 to 0 dl 1746143837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143826.412247:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c000 with x1830963624574080 ext(1212416->1216511) 00002000:00010000:0.0:1746143826.412249:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4c000 00000100:00100000:0.0:1746143826.416026:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.418320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.423116:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.429491:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.449034:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.492418:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.496581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.497213:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.500062:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.507577:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.512994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.513046:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.519758:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.553419:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.560796:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.564228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.572288:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.575210:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.575228:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624577536 00000100:00100000:0.0:1746143826.575232:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624577536 00000100:00100000:0.0:1746143826.578184:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15645 00000100:00100000:0.0:1746143826.578191:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963624577536:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143826.578197:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143826.578205:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ac00/0x87925e4cb73b27b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484102e9 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143826.578233:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627318016:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143826.578271:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114900 going to sleep for 11 seconds 00002000:00010000:0.0:1746143826.581733:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143825 -> 1746143826 00002000:00010000:0.0:1746143826.581737:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143825 -> 1746143826 00002000:00010000:0.0:1746143826.581738:0:1947:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143825 -> 1746143826 00000100:00100000:0.0:1746143826.581749:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627318016:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143826.581772:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ac00/0x87925e4cb73b27b0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484102e9 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.581783:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ac00/0x87925e4cb73b27b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484102e9 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.581803:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ac00, rc 0) 00000100:00100000:0.0:1746143826.581830:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963624577536:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3639us (7686us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143826.581836:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15645 00000100:00100000:0.0:1746143826.581854:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624578176 00000100:00100000:0.0:1746143826.581860:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624578176 00000100:00100000:0.0:1746143826.582658:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15647 00000100:00100000:0.0:1746143826.582665:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963624578176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143826.582674:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143826.582684:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ba00/0x87925e4cb73b27cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841030c expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143826.582715:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627318272:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143826.582750:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143826.590295:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.596818:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.597403:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.597440:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.602117:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.602164:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.602231:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.608005:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.609642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.612921:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.621814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.622690:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.622710:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.622735:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.624739:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15653 00000100:00100000:0.0:1746143826.624746:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963624580352:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143826.624753:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143826.624760:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b283c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841034b expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143826.624784:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627319424:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143826.624818:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143826.629253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143826.629421:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143826 -> 1746143827 00000100:00100000:0.0:1746143826.629441:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627319424:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143826.629488:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b283c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841034b expref: 15 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.629500:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b283c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841034b expref: 15 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.629514:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133566800, rc 0) 00000100:00100000:0.0:1746143826.629556:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963624580352:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4809us (6818us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143826.629562:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15653 00000100:00100000:0.0:1746143826.643734:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.650187:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.680969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.681010:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624581888 00000100:00100000:0.0:1746143826.681018:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624581888 00000100:00100000:0.0:1746143826.683541:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624582144 00000100:00100000:0.0:1746143826.683550:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624582144 00000100:00100000:0.0:1746143826.683586:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13746 00000100:00100000:0.0:1746143826.683592:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+284:2194:x1830963624582144:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143826.683610:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143826.683625:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b2874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841036e expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.683686:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b287b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683699:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b287b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683707:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b287b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683714:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b2882 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683718:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b2882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683722:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b2882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683789:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b2889 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683798:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b284a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410359 expref: 13 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.683803:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b2889 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143826.683826:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b284a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410359 expref: 13 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.683833:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b284a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410359 expref: 13 pid: 7245 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143826.683843:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627319680:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143826.683909:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143826.684027:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143826.684993:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.685028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.685049:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624582272 00000100:00100000:0.0:1746143826.685052:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624582272 00000100:00100000:0.0:1746143826.685069:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624582400 00000100:00100000:0.0:1746143826.685071:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624582400 00000100:00100000:0.0:1746143826.685082:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15655 00000100:00100000:0.0:1746143826.685086:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963624582272:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143826.685106:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092a45c00/0x87925e4cb73b2897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685122:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b280b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410328 expref: 47 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685128:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b282e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410344 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.685133:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189c200/0x87925e4cb73b2827 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841033d expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685138:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143826.685139:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143826.685141:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a45c00/0x87925e4cb73b2897 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685155:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189c200/0x87925e4cb73b2827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841033d expref: 23 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685166:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189c200/0x87925e4cb73b2827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841033d expref: 23 pid: 9585 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143826.685174:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627319808:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143826.685223:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b282e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410344 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.685230:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b282e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410344 expref: 14 pid: 1947 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143826.685236:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627319936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143826.685252:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b280b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410328 expref: 47 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685258:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b280b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410328 expref: 47 pid: 9585 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143826.685264:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627320064:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143826.685273:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143826.685290:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15656 00000100:00100000:0.0:1746143826.685294:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624582400:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143826.685309:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b289e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685320:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143826.685324:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b5c00/0x87925e4cb73b2858 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410360 expref: 45 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685328:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143826.685330:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b289e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685347:0:3134:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b5c00/0x87925e4cb73b2858 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410360 expref: 45 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.685409:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b289e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143826.686033:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627319552:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143826.686048:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801338b5c00/0x87925e4cb73b2858 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410360 expref: 45 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.686058:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b5c00, rc 0) 00000100:00100000:0.0:1746143826.686078:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2187:x1830963624581632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3191us (5404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143826.686084:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15654 00000100:00100000:0.0:1746143826.686586:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.698178:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.698215:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.698390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.699515:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624583168 00000100:00100000:0.0:1746143826.699520:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624583168 00002000:00100000:0.0:1746143826.699539:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1486847) req@ffff880092b47b80 x1830963624583168/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:222/0 lens 488/0 e 0 to 0 dl 1746143837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143826.699548:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b47b80 with x1830963624583168 ext(1048576->1486847) 00010000:00010000:0.0:1746143826.699554:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567200/0x87925e4cb73b2755 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484102cd expref: 30 pid: 13436 timeout: 985 lvb_type: 0 00010000:00010000:0.0:1746143826.699562:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567200/0x87925e4cb73b2755 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484102cd expref: 30 pid: 13436 timeout: 985 lvb_type: 0 00002000:00010000:0.0:1746143826.699567:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b47b80 00000100:00100000:0.0:1746143826.699582:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2513 00000100:00100000:0.0:1746143826.699588:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624583168:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143826.699697:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.699774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.700448:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624582656 00000100:00100000:0.0:1746143826.700452:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624582656 00000100:00100000:0.0:1746143826.700482:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624582912 00000100:00100000:0.0:1746143826.700484:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624582912 00000100:00100000:0.0:1746143826.700499:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15660 00000100:00100000:0.0:1746143826.700504:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963624582656:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143826.700519:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b28c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.700529:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049800/0x87925e4cb73b2636 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841023a expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.700540:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa400/0x87925e4cb73b2786 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484102f7 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.700546:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b2660 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410248 expref: 46 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.700551:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143826.700552:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143826.700554:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b28c8 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.700571:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b2660 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410248 expref: 46 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.700578:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b2660 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410248 expref: 46 pid: 9585 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143826.700587:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627320832:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143826.700623:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa400/0x87925e4cb73b2786 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484102f7 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143826.700629:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5aa400/0x87925e4cb73b2786 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484102f7 expref: 15 pid: 9586 timeout: 985 lvb_type: 1 00000100:00100000:0.0:1746143826.700636:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627320960:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143826.700656:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049800/0x87925e4cb73b2636 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841023a expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.700663:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049800/0x87925e4cb73b2636 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841023a expref: 22 pid: 1947 timeout: 985 lvb_type: 0 00000100:00100000:0.0:1746143826.700670:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627321088:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143826.700683:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143826.706136:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.707712:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.708194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.708217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.723254:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.723862:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.723969:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.728184:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.728202:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.728229:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.729784:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.733699:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.737093:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.750264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.759321:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.764547:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.769005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.774500:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.778155:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.779752:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.780706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.782466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.783030:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.785665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.786784:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.792700:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.792727:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800291:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800322:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800344:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800357:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800389:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.800661:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15671 00000100:00100000:0.0:1746143826.800666:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2190:x1830963624589312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143826.800672:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143826.800679:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484103bb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.800689:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143826.800690:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143826.800694:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484103bb expref: 22 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.800703:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484103bb expref: 22 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143826.800714:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3b400, rc 0) 00000100:00100000:0.0:1746143826.800730:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2190:x1830963624589312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143826.800737:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15671 00000100:00100000:0.0:1746143826.803882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.806614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.807506:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.812838:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.817490:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.820044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.825445:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.825494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.825525:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.825540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.825563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.825583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.848007:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.853311:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.853360:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.871148:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.874645:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.880587:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.880636:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.882499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.887513:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963624593664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4857us (5010us total) trans 0 rc 614400/614400 00000100:00100000:0.0:1746143826.887526:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6731 00002000:00100000:0.0:1746143826.887535:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88012e35b480 x1830963624593664/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:222/0 lens 488/440 e 0 to 0 dl 1746143837 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143826.887543:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b480 with x1830963624593664 ext(4194304->4808703) 00002000:00010000:0.0:1746143826.887548:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35b480 00000100:00100000:0.0:1746143826.889420:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.889465:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.894011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.899445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.902275:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.909298:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.945276:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.959591:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143826.987040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.000407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006452:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006491:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006546:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.006611:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624595712 00000100:00100000:0.0:1746143827.006618:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624595712 00000100:00100000:0.0:1746143827.006646:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624595840 00000100:00100000:0.0:1746143827.006647:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624595840 00000100:00100000:0.0:1746143827.006657:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624595968 00000100:00100000:0.0:1746143827.006659:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624595968 00000100:00100000:0.0:1746143827.006666:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624596096 00000100:00100000:0.0:1746143827.006667:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624596096 00000100:00100000:0.0:1746143827.006674:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624596224 00000100:00100000:0.0:1746143827.006676:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624596224 00000100:00100000:0.0:1746143827.006683:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624596352 00000100:00100000:0.0:1746143827.006684:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624596352 00000100:00100000:0.0:1746143827.006695:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15686 00000100:00100000:0.0:1746143827.006934:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963624595712:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143827.006949:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.006961:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b29e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410439 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.006979:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.006980:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.006987:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b29e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410439 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.006999:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b29e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410439 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.007009:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:0.0:1746143827.007042:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963624595712:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 112us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.007837:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15686 00000100:00100000:0.0:1746143827.013070:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.017761:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.017819:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143827.020131:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b2a11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143827.020140:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b2a11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143827.020154:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143827.020247:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b2a0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410463 expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.020261:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b2a11 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410463 expref: 16 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.020267:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143827.020269:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143827.020270:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53c00, rc 0) 00000100:00100000:0.0:1746143827.020291:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2204:x1830963624596608:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 7015us (7227us total) trans 8589944727 rc 0/0 00000100:00100000:0.0:1746143827.020296:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13751 00000100:00100000:0.0:1746143827.024182:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.037257:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.037831:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.038219:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15693 00000100:00100000:0.0:1746143827.038225:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963624598016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143827.038231:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.038239:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b2a57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841047f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143827.038258:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096942300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627324800:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143827.038677:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143827.055684:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.092721:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.092750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.092830:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.092867:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624598784 00000100:00100000:0.0:1746143827.092870:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624598784 00000100:00100000:0.0:1746143827.092891:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15695 00000100:00100000:0.0:1746143827.092897:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:2201:x1830963624598784:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143827.092907:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.092939:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b2a65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841048d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.092957:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b291c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484103ad expref: 49 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.092964:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73b29fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410455 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.092969:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b2931 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484103d7 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.092974:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.092975:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.092978:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b2a65 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3526656->4194303] (req 3526656->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841048d expref: 49 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.092999:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b2931 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103d7 expref: 23 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.093008:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b2931 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103d7 expref: 23 pid: 9587 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.093018:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096942300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627325184:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.093070:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73b29fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410455 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.093083:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73b29fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410455 expref: 13 pid: 3135 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.093091:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627325312:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.093133:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b291c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103ad expref: 49 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.093141:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b291c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103ad expref: 49 pid: 3135 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.093148:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627325440:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143827.093165:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143827.103171:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.103205:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.103271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.107119:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.110197:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.117379:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.120021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.128341:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.128379:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.134249:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.140818:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.142616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.143271:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.145392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.145539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.146770:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.148160:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.148202:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.148402:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627326336:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.148418:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b2a96 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484104a2 expref: 49 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.148427:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428e00, rc 0) 00000100:00100000:0.0:1746143827.148445:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+49:2208:x1830963624601088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5067us (5175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.148450:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15697 00000100:00100000:0.0:1746143827.158716:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2010:x1830963624601600:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10426us (10549us total) trans 21474841072 rc 0/0 00000100:00100000:0.0:1746143827.158727:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2519 00002000:00100000:0.0:1746143827.158736:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1376255) req@ffff880136ac8700 x1830963624601600/t21474841072(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:223/0 lens 488/448 e 0 to 0 dl 1746143838 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.158749:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8700 with x1830963624601600 ext(1048576->1376255) 00010000:00010000:0.0:1746143827.158758:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b2915 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103c2 expref: 35 pid: 12328 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.158770:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b2915 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103c2 expref: 35 pid: 12328 timeout: 986 lvb_type: 0 00002000:00010000:0.0:1746143827.158776:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136ac8700 00000100:00100000:0.0:1746143827.163887:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.163946:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.164523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.164539:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624602496 00000100:00100000:0.0:1746143827.164542:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624602496 00002000:00100000:0.0:1746143827.164557:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095c6ad80 x1830963624602496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:223/0 lens 488/0 e 0 to 0 dl 1746143838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.164564:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6ad80 with x1830963624602496 ext(1048576->2097151) 00002000:00010000:0.0:1746143827.164568:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6ad80 00000100:00100000:0.0:1746143827.164577:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6737 00000100:00100000:0.0:1746143827.164581:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963624602496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143827.171868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.184611:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.187679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.194380:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.194486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.195528:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6740 00000100:00100000:0.0:1746143827.195537:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963624603520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143827.208251:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143827.208267:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627326848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143827.208308:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143827.208606:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143827.210683:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.210741:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.211772:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15703 00000100:00100000:0.0:1746143827.211779:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963624603904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143827.211785:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.211793:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33400/0x87925e4cb73b2ac0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484104cc expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143827.211821:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627327104:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143827.211845:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143827.215509:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.217806:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.219370:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.219410:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.222039:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.223522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.237540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.237586:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.238592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.241530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.241800:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.243107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.244425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.245289:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.245544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.249420:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.253138:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.256319:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.259149:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627328384:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.259167:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b2aff lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484104fd expref: 36 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.259180:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97800, rc 0) 00000100:00100000:0.0:1746143827.259194:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2212:x1830963624606976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2573us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.259199:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15709 00000100:00100000:0.0:1746143827.259281:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143827.263103:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841073 is committed 00000001:00080000:0.0:1746143827.263111:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841072 is committed 00000001:00080000:0.0:1746143827.263138:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841063 is committed 00000001:00080000:0.0:1746143827.263161:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841047 is committed 00000100:00100000:0.0:1746143827.267719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.276457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.276511:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.305021:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.320194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.342735:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.345350:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143827.345561:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143827.345602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.379247:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.379620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.384413:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.385849:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624609792 00000100:00100000:0.0:1746143827.385852:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624609792 00000100:00100000:0.0:1746143827.385999:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15710 00000100:00100000:0.0:1746143827.386005:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963624609792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143827.386016:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.386027:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b2b4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410512 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143827.386207:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627328640:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143827.386254:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143827.387442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.388394:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627328640:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143827.388415:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b2b4c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410512 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.388426:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b2b4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410512 expref: 23 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.388437:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323bc00, rc 0) 00000100:00100000:0.0:1746143827.388808:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963624609792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2801us (3284us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143827.388813:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15710 00000100:00100000:0.0:1746143827.389340:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.390012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.396976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.398233:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.399216:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.403076:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.412390:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.412414:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624611328 00000100:00100000:0.0:1746143827.412421:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624611328 00010000:00010000:0.0:1746143827.412452:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b28f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841039f expref: 50 pid: 9586 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.412496:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7522 00000100:00100000:0.0:1746143827.412502:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963624611328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.412515:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.412532:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b28f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841039f expref: 50 pid: 9586 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.412542:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b28f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841039f expref: 50 pid: 9586 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.412563:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b28f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841039f expref: 50 pid: 9586 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.412584:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.412638:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+49:2008:x1830963624611328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.412651:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7522 00000100:00100000:0.0:1746143827.413141:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.413204:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.418361:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.422087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.431531:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.441703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.451726:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.452397:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.455490:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.455524:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.456270:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.456323:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624613248 00000100:00100000:0.0:1746143827.456326:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624613248 00000100:00100000:0.0:1746143827.456350:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15715 00000100:00100000:0.0:1746143827.456355:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963624613120:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143827.456368:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.456378:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b2bb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410543 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.456393:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.456395:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.456401:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b2bb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410543 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.456413:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b2bb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410543 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.456421:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:0.0:1746143827.456440:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624613120:12345-192.168.202.3@tcp:101:cat.0 Request processed in 84us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.456698:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15715 00000100:00100000:0.0:1746143827.456961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.457002:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.467059:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.467499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.489469:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.490163:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.495027:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.495781:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143827.497801:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873792 is committed 00000001:00080000:0.0:1746143827.497810:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873791 is committed 00000001:00080000:0.0:1746143827.497843:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873782 is committed 00000001:00080000:0.0:1746143827.497867:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873764 is committed 00000100:00100000:0.0:1746143827.500990:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.508984:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.509028:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.516963:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.524548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.528794:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.539716:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.550972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.551037:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.554819:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.556005:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624617344 00000100:00100000:0.0:1746143827.556009:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624617344 00002000:00100000:0.0:1746143827.556034:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88009e492a00 x1830963624617344/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:223/0 lens 488/0 e 0 to 0 dl 1746143838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.556047:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e492a00 with x1830963624617344 ext(4194304->4808703) 00002000:00010000:0.0:1746143827.556050:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e492a00 00000100:00100000:0.0:1746143827.556070:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6758 00000100:00100000:0.0:1746143827.556075:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2011:x1830963624617344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143827.559030:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.559076:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.568655:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15724 00000100:00100000:0.0:1746143827.568662:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624617984:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143827.568667:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.568675:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410582 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.568685:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.568686:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.568691:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410582 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.568699:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410582 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.568705:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85e00, rc 0) 00000100:00100000:0.0:1746143827.569643:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624617984:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 981us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.569649:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15724 00000100:00100000:0.0:1746143827.569664:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15725 00000100:00100000:0.0:1746143827.569670:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624618240:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143827.569677:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.569685:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b2c17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410590 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.569696:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.569698:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.569702:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b2c17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410590 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.569710:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b2c17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410590 expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143827.569717:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84e00, rc 0) 00000100:00100000:0.0:1746143827.569731:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624618240:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 61us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.569735:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15725 00000100:00100000:0.0:1746143827.569744:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15726 00000100:00100000:0.0:1746143827.569748:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624618368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143827.569754:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.569759:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73b2c1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410597 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143827.571233:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627330816:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143827.572158:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143827.577785:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.579558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.581102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.586605:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624619392 00000100:00100000:0.0:1746143827.586616:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624619392 00000100:00100000:0.0:1746143827.586682:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13762 00000100:00100000:0.0:1746143827.586795:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2231:x1830963624619392:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143827.586824:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.586846:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b2c3a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484105a5 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143827.589605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.594861:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.605358:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.610026:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.610379:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.610999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.615840:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.618603:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.631416:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.631431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.631445:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.631475:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624621184 00000100:00100000:0.0:1746143827.631482:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624621184 00010000:00010000:0.0:1746143827.631514:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75a00/0x87925e4cb73b2b7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410527 expref: 23 pid: 3134 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.631536:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624621440 00000100:00100000:0.0:1746143827.631538:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624621440 00010000:00010000:0.0:1746143827.631546:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410582 expref: 12 pid: 12328 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.631561:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624621696 00000100:00100000:0.0:1746143827.631562:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624621696 00010000:00010000:0.0:1746143827.631570:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b2ab2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104be expref: 10 pid: 3134 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.631583:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7533 00000100:00100000:0.0:1746143827.631588:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963624621184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.631600:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.631618:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d75a00/0x87925e4cb73b2b7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410527 expref: 23 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631626:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d75a00/0x87925e4cb73b2b7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410527 expref: 23 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631648:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75a00/0x87925e4cb73b2b7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410527 expref: 23 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631665:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.631702:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2011:x1830963624621184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.631708:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7533 00000100:00100000:0.0:1746143827.631721:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7534 00000100:00100000:0.0:1746143827.631725:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624621440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.631730:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.631738:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410582 expref: 12 pid: 12328 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.631745:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410582 expref: 12 pid: 12328 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.631754:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b2c02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410582 expref: 12 pid: 12328 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.631760:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.631770:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624621440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.631774:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7534 00000100:00100000:0.0:1746143827.631780:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7535 00000100:00100000:0.0:1746143827.631784:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624621696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.631789:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.631793:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b2ab2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104be expref: 10 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631800:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b2ab2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104be expref: 10 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631807:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b2ab2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104be expref: 10 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631815:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.631823:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963624621696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 39us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.631828:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7535 00000100:00100000:0.0:1746143827.631851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.631864:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624621312 00000100:00100000:0.0:1746143827.631866:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624621312 00010000:00010000:0.0:1746143827.631876:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103bb expref: 10 pid: 9585 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.631887:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7536 00000100:00100000:0.0:1746143827.631902:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624621312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.631909:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.631934:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103bb expref: 10 pid: 9585 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631952:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103bb expref: 10 pid: 9585 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631962:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b400/0x87925e4cb73b290e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484103bb expref: 10 pid: 9585 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.631971:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.631983:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963624621312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.631987:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7536 00000100:00100000:0.0:1746143827.632030:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.632039:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624621568 00000100:00100000:0.0:1746143827.632041:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624621568 00010000:00010000:0.0:1746143827.632051:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73b29f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841044e expref: 12 pid: 3135 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.632064:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7537 00000100:00100000:0.0:1746143827.632069:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624621568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.632076:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.632082:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73b29f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841044e expref: 12 pid: 3135 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.632090:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73b29f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841044e expref: 12 pid: 3135 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.632100:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049600/0x87925e4cb73b29f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841044e expref: 12 pid: 3135 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.632117:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.632130:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624621568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.632135:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7537 00000100:00100000:0.0:1746143827.632165:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.632173:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624621824 00000100:00100000:0.0:1746143827.632176:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624621824 00010000:00010000:0.0:1746143827.632184:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b2c17 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410590 expref: 11 pid: 12328 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.632200:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7538 00000100:00100000:0.0:1746143827.632205:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624621824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.632212:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.632220:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b2c17 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410590 expref: 11 pid: 12328 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.632227:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b2c17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410590 expref: 11 pid: 12328 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.632237:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.632249:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624621824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 44us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.632254:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7538 00000100:00100000:0.0:1746143827.633705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.633763:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.633773:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624622208 00000100:00100000:0.0:1746143827.633775:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624622208 00010000:00010000:0.0:1746143827.633786:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b2c10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410589 expref: 11 pid: 13436 timeout: 986 lvb_type: 1 00000100:00100000:0.0:1746143827.633800:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7544 00000100:00100000:0.0:1746143827.633804:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624622208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.633810:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.633816:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b2c10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410589 expref: 11 pid: 13436 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.633823:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b2c10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410589 expref: 11 pid: 13436 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.633838:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b2c10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410589 expref: 11 pid: 13436 timeout: 986 lvb_type: 1 00010000:00010000:0.0:1746143827.633846:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.633860:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624622208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.633865:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7544 00000100:00100000:0.0:1746143827.633893:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.633902:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624622592 00000100:00100000:0.0:1746143827.633905:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624622592 00010000:00010000:0.0:1746143827.633929:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b2aff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104fd expref: 8 pid: 3134 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.633942:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7545 00000100:00100000:0.0:1746143827.633946:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963624622592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.633951:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.633957:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b2aff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104fd expref: 8 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.633965:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b2aff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104fd expref: 8 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.633975:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b2aff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484104fd expref: 8 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.633992:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.633993:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.633995:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8400/0x87925e4cb73b2c72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.634004:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8400/0x87925e4cb73b2c72 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.634017:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.634031:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624622592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.634036:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7545 00000100:00100000:0.0:1746143827.634054:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624622720 00000100:00100000:0.0:1746143827.634056:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624622720 00010000:00010000:0.0:1746143827.634063:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73b2bc3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410551 expref: 24 pid: 3134 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.634076:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7546 00000100:00100000:0.0:1746143827.634081:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624622720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.634087:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.634093:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73b2bc3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410551 expref: 24 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.634100:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73b2bc3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410551 expref: 24 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.634114:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9200/0x87925e4cb73b2bc3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410551 expref: 24 pid: 3134 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.634121:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.634123:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143827.634125:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189c400/0x87925e4cb73b2c87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.634131:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189c400/0x87925e4cb73b2c87 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.634141:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.634154:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963624622720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.634158:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7546 00000100:00100000:0.0:1746143827.639998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.642308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.647851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.648090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.648115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.648138:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624623232 00000100:00100000:0.0:1746143827.648145:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624623232 00010000:00010000:0.0:1746143827.648404:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73b2207 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410011 expref: 295 pid: 7244 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.648422:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7549 00000100:00100000:0.0:1746143827.648427:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+295:2009:x1830963624623232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.648434:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.648438:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73b2207 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410011 expref: 295 pid: 7244 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.648445:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73b2207 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410011 expref: 295 pid: 7244 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.648457:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73b2207 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410011 expref: 295 pid: 7244 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.648483:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143827.648487:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x87925e4cb73b2c8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143827.648492:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.648507:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+294:2009:x1830963624623232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.648512:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7549 00000100:00100000:0.0:1746143827.649625:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.649643:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624623488 00000100:00100000:0.0:1746143827.649648:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624623488 00010000:00010000:0.0:1746143827.649660:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091380a00/0x87925e4cb73b2303 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b2 expref: 294 pid: 7244 timeout: 986 lvb_type: 0 00000100:00100000:0.0:1746143827.649685:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7551 00000100:00100000:0.0:1746143827.649690:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+294:2009:x1830963624623488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143827.649697:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143827.649700:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091380a00/0x87925e4cb73b2303 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b2 expref: 294 pid: 7244 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.649708:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091380a00/0x87925e4cb73b2303 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b2 expref: 294 pid: 7244 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.649720:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091380a00/0x87925e4cb73b2303 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484100b2 expref: 294 pid: 7244 timeout: 986 lvb_type: 0 00010000:00010000:0.0:1746143827.649728:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143827.649731:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x87925e4cb73b2c8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143827.649738:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x87925e4cb73b2c8e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143827.649744:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x87925e4cb73b2c8e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143827.649761:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143827.649776:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+293:2009:x1830963624623488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.649782:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7551 00000100:00100000:0.0:1746143827.659084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143827.662129:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944746 is committed 00000004:00080000:0.0:1746143827.662142:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2358 committed 00000004:00080000:0.0:1746143827.662157:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2355 committed 00000004:00080000:0.0:1746143827.662170:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2354 committed 00000004:00080000:0.0:1746143827.662172:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2353 committed 00000004:00080000:0.0:1746143827.662173:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2352 committed 00000004:00080000:0.0:1746143827.662175:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2357 committed 00000004:00080000:0.0:1746143827.662176:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2351 committed 00000004:00080000:0.0:1746143827.662179:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2356 committed 00000004:00080000:0.0:1746143827.662180:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2350 committed 00000004:00080000:0.0:1746143827.662181:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2355 committed 00000004:00080000:0.0:1746143827.662183:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2354 committed 00000004:00080000:0.0:1746143827.662184:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2353 committed 00000004:00080000:0.0:1746143827.662185:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2349 committed 00000004:00080000:0.0:1746143827.662187:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2348 committed 00000004:00080000:0.0:1746143827.662188:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2352 committed 00000004:00080000:0.0:1746143827.662189:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2351 committed 00000004:00080000:0.0:1746143827.662190:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2347 committed 00000001:00080000:0.0:1746143827.662203:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944743 is committed 00000001:00080000:0.0:1746143827.662207:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944742 is committed 00000100:00100000:0.0:1746143827.665500:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143827.665525:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627334656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.665547:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143827.667829:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15749 00000100:00100000:0.0:1746143827.667837:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963627334400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.668297:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963627334400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 461us (871us total) trans 21474841082 rc 0/0 00000100:00100000:0.0:1746143827.668303:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15749 00000100:00100000:0.0:1746143827.668330:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841063 gen 2 00000004:00080000:0.0:1746143827.668334:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78380, transno 21474841036 00000004:00080000:0.0:1746143827.668719:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32300, transno 21474841037 00000004:00080000:0.0:1746143827.668722:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30e00, transno 21474841038 00000004:00080000:0.0:1746143827.668724:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f79880, transno 21474841039 00000004:00080000:0.0:1746143827.668727:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33100, transno 21474841040 00000004:00080000:0.0:1746143827.668729:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78e00, transno 21474841041 00000004:00080000:0.0:1746143827.668732:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33800, transno 21474841042 00000004:00080000:0.0:1746143827.668734:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30000, transno 21474841043 00000004:00080000:0.0:1746143827.668737:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32680, transno 21474841048 00000004:00080000:0.0:1746143827.668742:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30380, transno 21474841049 00000004:00080000:0.0:1746143827.668745:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33480, transno 21474841050 00000004:00080000:0.0:1746143827.668748:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30a80, transno 21474841051 00000004:00080000:0.0:1746143827.668750:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31880, transno 21474841052 00000004:00080000:0.0:1746143827.668752:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31f80, transno 21474841053 00000004:00080000:0.0:1746143827.668754:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32a00, transno 21474841054 00000004:00080000:0.0:1746143827.668757:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30700, transno 21474841055 00000004:00080000:0.0:1746143827.668759:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb7100, transno 21474841056 00000004:00080000:0.0:1746143827.668762:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4380, transno 21474841057 00000004:00080000:0.0:1746143827.668764:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb7b80, transno 21474841058 00000004:00080000:0.0:1746143827.668767:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5880, transno 21474841059 00000004:00080000:0.0:1746143827.668769:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb6680, transno 21474841060 00000004:00080000:0.0:1746143827.668771:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb6d80, transno 21474841061 00000004:00080000:0.0:1746143827.668773:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4700, transno 21474841062 00000004:00080000:0.0:1746143827.668775:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5500, transno 21474841063 00000100:00100000:0.0:1746143827.668779:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880093414700 x1830963627334144/t21474841079(21474841079) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143843 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143827.668786:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414700/2, rc 0, transno 21474841079 00000100:00100000:0.0:1746143827.668789:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627334144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143827.669583:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093416300/2, rc 0, transno 21474841080 00000100:00100000:0.0:1746143827.669586:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627334656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.669659:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.670376:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.670945:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627336064 00000100:00100000:0.0:1746143827.670949:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627336064 00000100:00100000:0.0:1746143827.670972:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15750 00000100:00100000:0.0:1746143827.670977:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963627336064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143827.671092:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627336064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (517us total) trans 17179873803 rc 0/0 00000100:00100000:0.0:1746143827.671097:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15750 00000100:00100000:0.0:1746143827.674669:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.679132:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.733023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.738660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.740807:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143827.741966:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801338b5000/0x87925e4cb73b2ce9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143827.741974:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801338b5000/0x87925e4cb73b2ce9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000001:00080000:0.0:1746143827.747820:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944751 is committed 00000004:00080000:0.0:1746143827.747830:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2366 committed 00000004:00080000:0.0:1746143827.747847:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2364 committed 00000004:00080000:0.0:1746143827.747859:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2363 committed 00000004:00080000:0.0:1746143827.747861:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2362 committed 00000004:00080000:0.0:1746143827.747862:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2361 committed 00000004:00080000:0.0:1746143827.747863:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2365 committed 00000004:00080000:0.0:1746143827.747865:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2360 committed 00000004:00080000:0.0:1746143827.747866:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2364 committed 00000004:00080000:0.0:1746143827.747867:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2359 committed 00000004:00080000:0.0:1746143827.747869:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2363 committed 00000004:00080000:0.0:1746143827.747870:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2362 committed 00000004:00080000:0.0:1746143827.747872:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2361 committed 00000004:00080000:0.0:1746143827.747873:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2358 committed 00000004:00080000:0.0:1746143827.747874:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2357 committed 00000004:00080000:0.0:1746143827.747876:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2360 committed 00000004:00080000:0.0:1746143827.747878:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2359 committed 00000004:00080000:0.0:1746143827.747879:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2356 committed 00000001:00080000:0.0:1746143827.747887:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944749 is committed 00000001:00080000:0.0:1746143827.747891:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944747 is committed 00000100:00100000:0.0:1746143827.747991:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e30aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627336448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143827.748083:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143827.748135:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627336960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.748156:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143827.748174:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627337472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.748191:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143827.748441:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627338112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.748457:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143827.748487:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627338112 00000100:00100000:0.0:1746143827.748493:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627338112 00000100:00100000:0.0:1746143827.748520:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15753 00000100:00100000:0.0:1746143827.748526:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3771:x1830963627336832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.748636:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963627336832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (519us total) trans 21474841084 rc 0/0 00000100:00100000:0.0:1746143827.748643:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15753 00000100:00100000:0.0:1746143827.748655:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15757 00000100:00100000:0.0:1746143827.748660:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627337472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143827.748730:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3772:x1830963627337472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (537us total) trans 21474841087 rc 0/0 00000100:00100000:0.0:1746143827.748742:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15757 00000004:00080000:0.0:1746143827.748774:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33100/2, rc 0, transno 21474841086 00000100:00100000:0.0:1746143827.748778:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627336960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143827.748787:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33800/2, rc 0, transno 21474841087 00000100:00100000:0.0:1746143827.748790:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627337472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143827.748803:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30380/2, rc 0, transno 21474841088 00000100:00100000:0.0:1746143827.748806:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627338112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143827.748816:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e30aa00/2, rc 0, transno 17179873804 00000100:00100000:0.0:1746143827.748820:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627336448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143827.748851:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627337216 00000100:00100000:0.0:1746143827.748854:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627337216 00000100:00100000:0.0:1746143827.748869:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627337600 00000100:00100000:0.0:1746143827.748871:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627337600 00000100:00100000:0.0:1746143827.748878:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627338368 00000100:00100000:0.0:1746143827.748880:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627338368 00000100:00100000:0.0:1746143827.748887:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15760 00000100:00100000:0.0:1746143827.748891:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627337216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143827.748970:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627337216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (138us total) trans 17179873807 rc 0/0 00000100:00100000:0.0:1746143827.748976:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15760 00000004:00080000:0.0:1746143827.749014:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493800/2, rc 0, transno 17179873808 00000100:00100000:0.0:1746143827.749018:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627338368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143827.749044:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627337088 00000100:00100000:0.0:1746143827.749046:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627337088 00000100:00100000:0.0:1746143827.749060:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15765 00000100:00100000:0.0:1746143827.749064:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627337088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143827.749118:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627337088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (79us total) trans 17179873811 rc 0/0 00000100:00100000:0.0:1746143827.749124:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15765 00000100:00100000:0.0:1746143827.749134:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15766 00000100:00100000:0.0:1746143827.749139:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627337728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143827.749171:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143827.749174:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143827.749176:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143827.749178:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143827.749180:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143827.749206:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627337728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (139us total) trans 21474841090 rc 0/0 00000100:00100000:0.0:1746143827.749211:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15766 00000100:00100000:0.0:1746143827.753310:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.755319:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.759977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.761328:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.762662:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.764992:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.766969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.778348:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.784845:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624627328 00000100:00100000:0.0:1746143827.784856:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624627328 00000100:00100000:0.0:1746143827.784927:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5266 00000100:00100000:0.0:1746143827.784934:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2235:x1830963624627328:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143827.785317:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2235:x1830963624627328:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 382us (1142us total) trans 8589944753 rc 0/0 00000100:00100000:0.0:1746143827.785324:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5266 00000100:00100000:0.0:1746143827.798341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.798398:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.801589:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.801622:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.812054:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.814605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.814641:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.819010:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.837474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.843522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.847685:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627339136:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.847707:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b2d98 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410646 expref: 10 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.847721:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00000100:00100000:0.0:1746143827.847752:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2247:x1830963624630016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8816us (8941us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143827.847759:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15781 00000100:00100000:0.0:1746143827.860350:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.861634:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.867701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.867852:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.867887:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.868478:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624631296 00000100:00100000:0.0:1746143827.868482:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624631296 00002000:00100000:0.0:1746143827.868498:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800921cc380 x1830963624631296/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:223/0 lens 488/0 e 0 to 0 dl 1746143838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.868505:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963624631296 ext(1048576->2097151) 00002000:00010000:0.0:1746143827.868509:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:0.0:1746143827.868522:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6765 00000100:00100000:0.0:1746143827.868527:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624631168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143827.883876:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.898076:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.898127:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.898161:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624631680 00000100:00100000:0.0:1746143827.898169:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624631680 00002000:00100000:0.0:1746143827.898545:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff8800921ced80 x1830963624631680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:223/0 lens 488/0 e 0 to 0 dl 1746143838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.898554:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ced80 with x1830963624631680 ext(2097152->4194303) 00002000:00010000:0.0:1746143827.898557:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921ced80 00000100:00100000:0.0:1746143827.898581:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6768 00000100:00100000:0.0:1746143827.898587:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624631680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143827.901007:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.903707:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.906070:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.906155:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624632576 00000100:00100000:0.0:1746143827.906162:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624632576 00000100:00100000:0.0:1746143827.906774:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13773 00000100:00100000:0.0:1746143827.906782:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2249:x1830963624632576:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143827.906800:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143827.906813:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521a00/0x87925e4cb73b2dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841065b expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908506:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73b2dc9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143827.908522:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b2d21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484105f9 expref: 265 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908529:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b2d44 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484105f2 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908535:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73b2dbb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410654 expref: 6 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908541:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e521800/0x87925e4cb73b2dc9 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143827.908570:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73b2dbb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410654 expref: 6 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908580:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73b2dbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410654 expref: 6 pid: 10936 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143827.908590:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627339648:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.908655:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b2d44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484105f2 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908662:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b2d44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484105f2 expref: 10 pid: 7244 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143827.908668:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627339776:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143827.908711:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b2d21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484105f9 expref: 265 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143827.908718:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b2d21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484105f9 expref: 265 pid: 7243 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143827.908723:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627339904:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143827.908738:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143827.915441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.918043:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.921606:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624631680:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23018us (23537us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143827.921613:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6768 00002000:00100000:0.0:1746143827.921620:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff8800921ced80 x1830963624631680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:223/0 lens 488/440 e 0 to 0 dl 1746143838 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.921780:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ced80 with x1830963624631680 ext(2097152->4194303) 00002000:00010000:0.0:1746143827.921785:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921ced80 00000100:00100000:0.0:1746143827.921931:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624633472 00000100:00100000:0.0:1746143827.921935:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624633472 00010000:00010000:0.0:1746143827.921951:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53200/0x87925e4cb73b2dbb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410654 expref: 7 pid: 10936 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143827.930067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.932977:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.933024:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.933042:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624633984 00000100:00100000:0.0:1746143827.933046:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624633984 00002000:00100000:0.0:1746143827.933079:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88012d842a00 x1830963624633984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:223/0 lens 488/0 e 0 to 0 dl 1746143838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.933093:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963624633984 ext(1048576->2097151) 00002000:00010000:0.0:1746143827.933097:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d842a00 00000100:00100000:0.0:1746143827.933115:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624634112 00000100:00100000:0.0:1746143827.933117:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624634112 00002000:00100000:0.0:1746143827.933128:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d840a80 x1830963624634112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:223/0 lens 488/0 e 0 to 0 dl 1746143838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.933134:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840a80 with x1830963624634112 ext(1048576->2097151) 00002000:00010000:0.0:1746143827.933137:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840a80 00000100:00100000:0.0:1746143827.933152:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6770 00000100:00100000:0.0:1746143827.933158:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963624633984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143827.941604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.941647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.941671:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.941706:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.943618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.943653:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.943680:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.943693:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.943703:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.947830:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.947883:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.953362:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.953427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.953447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.961235:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.975358:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.975607:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.985039:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143827.995156:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624638208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13958us (14135us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143827.995169:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6776 00002000:00100000:0.0:1746143827.995179:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880136acb100 x1830963624638208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:223/0 lens 488/440 e 0 to 0 dl 1746143838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143827.995187:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963624638208 ext(2097152->3145727) 00002000:00010000:0.0:1746143827.995192:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143828.004054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.008130:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.017115:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.027034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.028785:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.037663:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.046124:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.046170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.046992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.047038:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624640000 00000100:00100000:0.0:1746143828.047044:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624640000 00010000:00010000:0.0:1746143828.047086:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b2e40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841069a expref: 10 pid: 9587 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.047105:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624640256 00000100:00100000:0.0:1746143828.047107:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624640256 00010000:00010000:0.0:1746143828.047115:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b2df3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410669 expref: 28 pid: 9587 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.047623:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7564 00000100:00100000:0.0:1746143828.047656:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624640000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.047669:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.047684:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b2e40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841069a expref: 10 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.047695:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b2e40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841069a expref: 10 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.047874:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b2e40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841069a expref: 10 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.047901:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.047948:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624640000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 319us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.047955:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7564 00000100:00100000:0.0:1746143828.056979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.058628:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.068271:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.069368:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.073858:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.122417:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.199706:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.226484:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.231897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.235054:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.238869:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.240167:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.241393:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.250444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.250496:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.250610:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.251907:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6785 00000100:00100000:0.0:1746143828.251927:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624643840:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143828.257390:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624643840:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5466us (6769us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143828.257402:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6785 00002000:00100000:0.0:1746143828.257412:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3993600->3997695) req@ffff880092b45180 x1830963624643840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:224/0 lens 488/4536 e 0 to 0 dl 1746143839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.257422:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963624643840 ext(3993600->3997695) 00002000:00010000:0.0:1746143828.257428:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b45180 00000100:00100000:0.0:1746143828.271738:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624644480 00000100:00100000:0.0:1746143828.271743:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624644480 00000100:00100000:0.0:1746143828.271783:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5272 00000100:00100000:0.0:1746143828.271788:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+268:2261:x1830963624644480:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143828.271980:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+269:2261:x1830963624644480:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 191us (1240us total) trans 8589944767 rc 0/0 00000100:00100000:0.0:1746143828.271985:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5272 00000100:00100000:0.0:1746143828.282057:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.282117:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.292775:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.300291:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15806 00000100:00100000:0.0:1746143828.300299:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624645632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143828.300308:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143828.300319:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b2f4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841073b expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.300340:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b2f4a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841073b expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143828.300349:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b2f4a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841073b expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143828.300364:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137000, rc 0) 00000100:00100000:0.0:1746143828.300390:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624645632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 93us (412us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143828.300396:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15806 00000100:00100000:0.0:1746143828.308416:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.308475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.309534:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.312772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.314347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.327400:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.327621:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.328664:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5273 00000100:00100000:0.0:1746143828.328671:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2259:x1830963624647040:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143828.328836:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2259:x1830963624647040:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 165us (1442us total) trans 8589944769 rc 0/0 00000100:00100000:0.0:1746143828.328841:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5273 00000100:00100000:0.0:1746143828.342794:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.353394:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15812 00000100:00100000:0.0:1746143828.353401:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624647424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143828.353409:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143828.353419:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d2200/0x87925e4cb73b2f74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841075e expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.353435:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d2200/0x87925e4cb73b2f74 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841075e expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143828.353442:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d2200/0x87925e4cb73b2f74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841075e expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143828.353565:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2200, rc 0) 00000100:00100000:0.0:1746143828.353595:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624647424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 194us (553us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143828.353601:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15812 00000100:00100000:0.0:1746143828.359227:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6791 00000100:00100000:0.0:1746143828.359236:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624648064:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143828.391886:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.398496:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.409101:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.428139:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.440354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.440388:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.440424:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.440447:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624649344 00000100:00100000:0.0:1746143828.440464:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624649344 00002000:00100000:0.0:1746143828.440511:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3624960->3997695) req@ffff880096943100 x1830963624649344/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:224/0 lens 488/0 e 0 to 0 dl 1746143839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.440521:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096943100 with x1830963624649344 ext(3624960->3997695) 00010000:00010000:0.0:1746143828.440530:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b2ef6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3624960->4095999] (req 3624960->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410703 expref: 29 pid: 13430 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.440542:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b2ef6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3624960->4095999] (req 3624960->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410703 expref: 29 pid: 13430 timeout: 987 lvb_type: 0 00002000:00010000:0.0:1746143828.440549:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096943100 00000100:00100000:0.0:1746143828.440944:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624649600 00000100:00100000:0.0:1746143828.440947:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624649600 00002000:00100000:0.0:1746143828.440958:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3407871) req@ffff880096943480 x1830963624649600/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:224/0 lens 488/0 e 0 to 0 dl 1746143839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.440965:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096943480 with x1830963624649600 ext(3145728->3407871) 00010000:00010000:0.0:1746143828.440970:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b2f58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410749 expref: 18 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.440978:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b2f58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410749 expref: 18 pid: 12327 timeout: 987 lvb_type: 0 00002000:00010000:0.0:1746143828.440983:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096943480 00000100:00100000:0.0:1746143828.441099:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2537 00000100:00100000:0.0:1746143828.441105:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624649600:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143828.451319:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.451367:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.452170:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963624649728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.452184:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.452202:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b2ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [3624960->4095999] (req 3624960->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410703 expref: 30 pid: 13430 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.452211:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b2ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [3624960->4095999] (req 3624960->3997695) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410703 expref: 30 pid: 13430 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.452228:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d66400/0x87925e4cb73b2ef6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [3624960->4095999] (req 3624960->3997695) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410703 expref: 30 pid: 13430 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.452244:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.452565:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963624649728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 500us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.452572:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7573 00000100:00100000:0.0:1746143828.462473:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.462529:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624650368 00000100:00100000:0.0:1746143828.462537:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624650368 00000100:00100000:0.0:1746143828.462550:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624650752 00000100:00100000:0.0:1746143828.462552:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624650752 00002000:00100000:0.0:1746143828.462588:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8801368e9500 x1830963624650752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:224/0 lens 488/0 e 0 to 0 dl 1746143839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.462597:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963624650752 ext(3145728->4194303) 00002000:00010000:0.0:1746143828.462602:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:0.0:1746143828.462616:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624650880 00000100:00100000:0.0:1746143828.462618:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624650880 00002000:00100000:0.0:1746143828.462630:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8801368ea300 x1830963624650880/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:224/0 lens 488/0 e 0 to 0 dl 1746143839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.462636:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963624650880 ext(3145728->4194303) 00002000:00010000:0.0:1746143828.462639:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ea300 00000100:00100000:0.0:1746143828.462651:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6794 00000100:00100000:0.0:1746143828.462657:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624650752:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:0.0:1746143828.463258:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb7100 x1830963624650368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:224/0 lens 488/0 e 0 to 0 dl 1746143839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.463265:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963624650368 ext(3145728->4194303) 00002000:00010000:0.0:1746143828.463268:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7100 00000100:00100000:0.0:1746143828.463279:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6796 00000100:00100000:0.0:1746143828.463284:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963624650368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143828.465887:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.493380:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963624650368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 30094us (30901us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143828.493386:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6796 00002000:00100000:0.0:1746143828.493391:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb7100 x1830963624650368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:224/0 lens 488/440 e 0 to 0 dl 1746143839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.493398:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7100 with x1830963624650368 ext(3145728->4194303) 00002000:00010000:0.0:1746143828.493400:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb7100 00000100:00100000:0.0:1746143828.508577:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624651776 00000100:00100000:0.0:1746143828.508581:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624651776 00002000:00100000:0.0:1746143828.508610:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88012d843480 x1830963624651776/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:224/0 lens 488/0 e 0 to 0 dl 1746143839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.508619:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843480 with x1830963624651776 ext(4194304->4808703) 00002000:00010000:0.0:1746143828.508624:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843480 00000100:00100000:0.0:1746143828.508637:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6798 00000100:00100000:0.0:1746143828.508642:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963624651776:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143828.526129:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.542086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.554494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.555313:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624652416 00000100:00100000:0.0:1746143828.555316:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624652416 00010000:00010000:0.0:1746143828.555330:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b2e16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841067e expref: 14 pid: 9585 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.555344:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624652544 00000100:00100000:0.0:1746143828.555346:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624652544 00010000:00010000:0.0:1746143828.555353:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b2d9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841064d expref: 28 pid: 9587 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.555365:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7579 00000100:00100000:0.0:1746143828.555369:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624652416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.555375:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.555382:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b2e16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841067e expref: 14 pid: 9585 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.555390:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b2e16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841067e expref: 14 pid: 9585 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.555401:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b2e16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841067e expref: 14 pid: 9585 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.555413:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.555428:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963624652416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.555433:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7579 00000100:00100000:0.0:1746143828.555474:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7580 00000100:00100000:0.0:1746143828.555478:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963624652544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.555484:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.555490:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b2d9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841064d expref: 28 pid: 9587 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.555497:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b2d9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841064d expref: 28 pid: 9587 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.555508:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b2d9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841064d expref: 28 pid: 9587 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.555516:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.555517:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.555522:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b2fcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410796 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.555530:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b2fcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410796 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.555551:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b2fcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410796 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143828.555561:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627344512:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143828.555597:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143828.558287:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.565446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.565479:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.565525:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.571535:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.571848:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.576979:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627345024:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143828.576998:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.577047:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624653824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4742us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.577056:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7583 00000100:00100000:0.0:1746143828.587694:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.607893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.612433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.622871:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.642252:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.647737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.651707:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.653905:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.657153:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624656512 00000100:00100000:0.0:1746143828.657158:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624656512 00000100:00100000:0.0:1746143828.657322:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15825 00000100:00100000:0.0:1746143828.657328:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624656512:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143828.657346:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.657357:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b2fcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410796 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.657362:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143828.657364:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143828.657366:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.657379:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b2fcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1282047) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410796 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.657386:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b2fcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1089536->1282047) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410796 expref: 26 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.657395:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627345792:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143828.657442:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143828.659898:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15828 00000100:00100000:0.0:1746143828.659905:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e0d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963624656896:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143828.659937:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659949:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73b2f89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841077a expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659955:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b3007 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484107c0 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143828.659960:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659965:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b2e78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484106c4 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659970:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b2f66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410757 expref: 17 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659975:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3a00/0x87925e4cb73b2e4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4096000->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484106b6 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659979:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746143828.659981:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746143828.659982:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 9/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.659996:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3a00/0x87925e4cb73b2e4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4096000->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106b6 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.660006:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3a00/0x87925e4cb73b2e4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4096000->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106b6 expref: 17 pid: 9585 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.660012:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627346176:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143828.661509:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b2f66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410757 expref: 17 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.661517:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b2f66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410757 expref: 17 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.661523:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627346944:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143828.661547:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b2e78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106c4 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.661554:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b2e78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106c4 expref: 27 pid: 13430 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.661560:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627347072:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143828.661580:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.661586:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.661596:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627347200:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143828.661615:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b3007 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484107c0 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143828.661622:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b3007 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484107c0 expref: 11 pid: 12327 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.661628:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627347328:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143828.661649:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73b2f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841077a expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.661656:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73b2f89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841077a expref: 27 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.661663:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627347456:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143828.661676:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143828.675510:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677347:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677433:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677443:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.677494:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624657408 00000100:00100000:0.0:1746143828.677498:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624657408 00010000:00010000:0.0:1746143828.677513:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b2f5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410750 expref: 29 pid: 9585 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.677524:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624657536 00000100:00100000:0.0:1746143828.677525:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624657536 00010000:00010000:0.0:1746143828.677532:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73b3000 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484107b9 expref: 12 pid: 13436 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.677538:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624657792 00000100:00100000:0.0:1746143828.677539:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624657792 00010000:00010000:0.0:1746143828.677545:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d3200/0x87925e4cb73b2f27 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410726 expref: 13 pid: 12328 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.677551:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658304 00000100:00100000:0.0:1746143828.677552:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658304 00010000:00010000:0.0:1746143828.677559:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b2e78 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106c4 expref: 28 pid: 13430 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.677566:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624657664 00000100:00100000:0.0:1746143828.677567:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624657664 00010000:00010000:0.0:1746143828.677572:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73b2e2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106a1 expref: 12 pid: 9587 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.677578:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658176 00000100:00100000:0.0:1746143828.677580:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658176 00010000:00010000:0.0:1746143828.677586:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717600/0x87925e4cb73b2d60 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841060e expref: 29 pid: 9587 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.677593:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7586 00000100:00100000:0.0:1746143828.677597:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624657408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.677605:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.677615:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b2f5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410750 expref: 29 pid: 9585 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677623:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b2f5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410750 expref: 29 pid: 9585 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677639:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b2f5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410750 expref: 29 pid: 9585 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677654:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.677671:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624657408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.677676:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7586 00000100:00100000:0.0:1746143828.677704:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7587 00000100:00100000:0.0:1746143828.677707:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624657536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.677712:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.677717:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73b3000 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484107b9 expref: 12 pid: 13436 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.677723:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa17600/0x87925e4cb73b3000 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484107b9 expref: 12 pid: 13436 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.677731:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.677739:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624657536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.677744:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7587 00000100:00100000:0.0:1746143828.677750:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7588 00000100:00100000:0.0:1746143828.677753:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624657792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.677757:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.677761:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d3200/0x87925e4cb73b2f27 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410726 expref: 13 pid: 12328 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677768:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d3200/0x87925e4cb73b2f27 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410726 expref: 13 pid: 12328 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677775:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.677777:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.677780:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b305b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.677786:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b305b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.677798:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.677807:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624657792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.677811:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7588 00000100:00100000:0.0:1746143828.677817:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7589 00000100:00100000:0.0:1746143828.677820:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624658304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.677825:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.677834:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b2e78 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106c4 expref: 29 pid: 13430 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677841:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b2e78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106c4 expref: 29 pid: 13430 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.677850:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.677858:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624658304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.677861:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7589 00000100:00100000:0.0:1746143828.677867:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7590 00000100:00100000:0.0:1746143828.677870:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624657664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.677874:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.677879:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73b2e2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106a1 expref: 12 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.677885:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31c00/0x87925e4cb73b2e2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106a1 expref: 12 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.677892:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.677899:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624657664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.677903:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7590 00000100:00100000:0.0:1746143828.677908:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7591 00000100:00100000:0.0:1746143828.677927:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624658176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.677931:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.677935:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717600/0x87925e4cb73b2d60 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841060e expref: 28 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.677942:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717600/0x87925e4cb73b2d60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841060e expref: 28 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.677949:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.677958:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624658176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.677962:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7591 00000100:00100000:0.0:1746143828.677995:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.678002:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658560 00000100:00100000:0.0:1746143828.678004:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658560 00010000:00010000:0.0:1746143828.678011:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73b2f82 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410773 expref: 13 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.678020:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7592 00000100:00100000:0.0:1746143828.678023:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624658560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.678027:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.678033:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73b2f82 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410773 expref: 13 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.678039:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048400/0x87925e4cb73b2f82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410773 expref: 13 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.678045:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.678055:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624658560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 31us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.678061:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7592 00000100:00100000:0.0:1746143828.678087:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.678094:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624657920 00000100:00100000:0.0:1746143828.678095:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624657920 00010000:00010000:0.0:1746143828.678102:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3a00/0x87925e4cb73b2e4e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4096000->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106b6 expref: 18 pid: 9585 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.678110:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7593 00000100:00100000:0.0:1746143828.678113:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624657920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.678118:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.678122:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3a00/0x87925e4cb73b2e4e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [4096000->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106b6 expref: 18 pid: 9585 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.678129:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3a00/0x87925e4cb73b2e4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [4096000->18446744073709551615] (req 4194304->4808703) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484106b6 expref: 18 pid: 9585 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.678136:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.678144:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624657920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 30us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.678148:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7593 00000100:00100000:0.0:1746143828.678174:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.678181:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658432 00000100:00100000:0.0:1746143828.678183:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658432 00010000:00010000:0.0:1746143828.678189:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b2d75 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841062a expref: 18 pid: 9587 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.678197:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7594 00000100:00100000:0.0:1746143828.678201:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624658432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.678204:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.678209:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b2d75 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841062a expref: 18 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.678215:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b2d75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841062a expref: 18 pid: 9587 timeout: 987 lvb_type: 1 00010000:00010000:0.0:1746143828.678221:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.678222:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.678225:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.678229:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3062 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.678237:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.678246:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624658432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.678249:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7594 00000100:00100000:0.0:1746143828.678270:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.678276:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658048 00000100:00100000:0.0:1746143828.678278:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658048 00010000:00010000:0.0:1746143828.678285:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b2f66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410757 expref: 18 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.678294:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7595 00000100:00100000:0.0:1746143828.678298:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624658048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.678303:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.678308:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b2f66 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410757 expref: 18 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.678314:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b2f66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410757 expref: 18 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.678322:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.678333:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624658048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 36us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.678337:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7595 00000100:00100000:0.0:1746143828.678378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.680675:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627347456:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143828.680704:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143828.680768:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658688 00000100:00100000:0.0:1746143828.680772:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658688 00010000:00010000:0.0:1746143828.680789:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.680812:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624658944 00000100:00100000:0.0:1746143828.680813:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624658944 00010000:00010000:0.0:1746143828.680821:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b300e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484107c7 expref: 10 pid: 12328 timeout: 987 lvb_type: 1 00000100:00100000:0.0:1746143828.680831:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624659072 00000100:00100000:0.0:1746143828.680833:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624659072 00010000:00010000:0.0:1746143828.680840:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27200/0x87925e4cb73b2f7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841076c expref: 28 pid: 12327 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.680849:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7596 00000100:00100000:0.0:1746143828.680854:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963624658688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.680861:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.680873:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.680880:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.680895:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b2f90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410781 expref: 17 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.680928:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.680946:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963624658688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.680956:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7596 00000100:00100000:0.0:1746143828.680971:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7600 00000100:00100000:0.0:1746143828.680976:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963624659200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.680981:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.680988:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73b2f89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841077a expref: 26 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.681000:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73b2f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841077a expref: 26 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.681010:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048800/0x87925e4cb73b2f89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841077a expref: 26 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.681018:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.681019:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143828.681022:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681027:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681056:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681062:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681071:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681077:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681082:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681087:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143828.681090:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681096:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681104:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.681109:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b3069 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143828.681152:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963624656896:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 21246us (21765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.681160:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15828 00000100:00100000:0.0:1746143828.687908:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963624657152:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9042us (9523us total) trans 17179873817 rc 0/0 00000100:00100000:0.0:1746143828.687932:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2539 00002000:00100000:0.0:1746143828.687940:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39c:0x0] (401408->888831) req@ffff8800931c6a00 x1830963624657152/t17179873817(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:224/0 lens 488/448 e 0 to 0 dl 1746143839 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143828.687947:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c6a00 with x1830963624657152 ext(401408->888831) 00010000:00010000:0.0:1746143828.687954:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73b2fd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->888831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841079d expref: 16 pid: 12327 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.687968:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73b2fd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 401408->888831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841079d expref: 16 pid: 12327 timeout: 987 lvb_type: 0 00002000:00010000:0.0:1746143828.687973:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800931c6a00 00000100:00100000:0.0:1746143828.691735:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143828.692625:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692633:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692648:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692655:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692661:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692668:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143828.692671:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692676:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692690:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.692695:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b3054 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143828.692748:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963624656512:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 35420us (35767us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.692756:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15825 00000100:00100000:0.0:1746143828.697299:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.704327:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624660096 00000100:00100000:0.0:1746143828.704332:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624660096 00000100:00100000:0.0:1746143828.704353:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5276 00000100:00100000:0.0:1746143828.704357:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+20:30501:x1830963624660096:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143828.705371:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:30501:x1830963624660096:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 1012us (2082us total) trans 8589944776 rc 0/0 00000100:00100000:0.0:1746143828.705378:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5276 00000100:00100000:0.0:1746143828.705948:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.708055:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.708126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.708965:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7608 00000100:00100000:0.0:1746143828.708970:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+272:2011:x1830963624660992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.708976:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.708981:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73b2f35 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841072d expref: 272 pid: 10936 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.710229:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73b2f35 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841072d expref: 272 pid: 10936 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.710247:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097369800/0x87925e4cb73b2f35 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841072d expref: 272 pid: 10936 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.710262:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143828.710266:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082049400/0x87925e4cb73b3077 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143828.710273:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.710314:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+271:2011:x1830963624660992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1343us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.710321:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7608 00000100:00100000:0.0:1746143828.722185:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627350016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.722223:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.722241:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627350528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.722256:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.722267:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143828.722271:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627349888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.722286:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.722297:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627350400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.722308:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.722323:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627350272 00000100:00100000:0.0:1746143828.722326:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627350272 00000100:00100000:0.0:1746143828.722340:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627349888 00000100:00100000:0.0:1746143828.722342:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627349888 00000100:00100000:0.0:1746143828.722351:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15833 00000100:00100000:0.0:1746143828.722356:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627349504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.722366:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.722380:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627350144 00000100:00100000:0.0:1746143828.722382:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627350144 00000100:00100000:0.0:1746143828.722393:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15835 00000100:00100000:0.0:1746143828.722396:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3774:x1830963627349248:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143828.723614:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931c4a80/2, rc 0, transno 17179873820 00000100:00100000:0.0:1746143828.723620:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627349632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723626:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931c7480/2, rc 0, transno 17179873824 00000100:00100000:0.0:1746143828.723628:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627350144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723634:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931c5c00/2, rc 0, transno 17179873821 00000100:00100000:0.0:1746143828.723636:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627350272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723641:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931c4700/2, rc 0, transno 17179873825 00000100:00100000:0.0:1746143828.723643:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627349760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723649:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d842d80/2, rc 0, transno 21474841098 00000100:00100000:0.0:1746143828.723651:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627348736:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143828.723681:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143828.723683:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143828.723685:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143828.723686:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143828.723688:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143828.723707:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963627349248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1310us (1584us total) trans 21474841103 rc 0/0 00000100:00100000:0.0:1746143828.723715:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15835 00000004:00080000:0.0:1746143828.723733:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931c7800/2, rc 0, transno 17179873822 00000100:00100000:0.0:1746143828.723736:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627349888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723741:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322e680/2, rc 0, transno 17179873823 00000100:00100000:0.0:1746143828.723744:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627350400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723749:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800931c5180/2, rc 0, transno 17179873819 00000100:00100000:0.0:1746143828.723751:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627350016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723755:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322e300/2, rc 0, transno 17179873818 00000100:00100000:0.0:1746143828.723758:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627350528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.723763:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b4bb80/2, rc 0, transno 21474841101 00000100:00100000:0.0:1746143828.723765:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627348992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143828.723986:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e8000/2, rc 0, transno 21474841102 00000100:00100000:0.0:1746143828.723989:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627349504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.725600:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627350656 00000100:00100000:0.0:1746143828.725607:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627350656 00000100:00100000:0.0:1746143828.726584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.730432:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.732976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.737077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.760177:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.761624:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.765098:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.765127:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.765193:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.769190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.770989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.771011:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.771046:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.771852:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624664320 00000100:00100000:0.0:1746143828.771855:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624664320 00010000:00010000:0.0:1746143828.771866:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b310a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410829 expref: 267 pid: 7243 timeout: 987 lvb_type: 0 00000100:00100000:0.0:1746143828.771888:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7611 00000100:00100000:0.0:1746143828.771892:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+267:2009:x1830963624664320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143828.771898:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143828.771901:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b310a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410829 expref: 267 pid: 7243 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.771908:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b310a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410829 expref: 267 pid: 7243 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.771939:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b310a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410829 expref: 267 pid: 7243 timeout: 987 lvb_type: 0 00010000:00010000:0.0:1746143828.771954:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143828.771956:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b313b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143828.771961:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b311f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143828.771964:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b311f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143828.771972:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b311f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143828.771977:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b313b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143828.771982:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512600/0x87925e4cb73b312d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410837 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143828.771987:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b313b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143828.771997:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.772011:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+266:2009:x1830963624664320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.772017:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7611 00000100:00100000:0.0:1746143828.776839:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143828.777432:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944785 is committed 00000004:00080000:0.0:1746143828.777438:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2382 committed 00000004:00080000:0.0:1746143828.777799:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2382 committed 00000004:00080000:0.0:1746143828.777806:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2381 committed 00000004:00080000:0.0:1746143828.777809:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2380 committed 00000004:00080000:0.0:1746143828.777811:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2379 committed 00000004:00080000:0.0:1746143828.777812:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2381 committed 00000004:00080000:0.0:1746143828.777813:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2378 committed 00000004:00080000:0.0:1746143828.777815:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2380 committed 00000004:00080000:0.0:1746143828.777816:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2377 committed 00000004:00080000:0.0:1746143828.777818:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2379 committed 00000004:00080000:0.0:1746143828.777819:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2378 committed 00000004:00080000:0.0:1746143828.777820:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2377 committed 00000004:00080000:0.0:1746143828.777823:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2376 committed 00000004:00080000:0.0:1746143828.777824:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2375 committed 00000004:00080000:0.0:1746143828.777826:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2376 committed 00000004:00080000:0.0:1746143828.777827:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2375 committed 00000004:00080000:0.0:1746143828.777829:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2374 committed 00000001:00080000:0.0:1746143828.777834:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944784 is committed 00000001:00080000:0.0:1746143828.777844:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944780 is committed 00000100:00100000:0.0:1746143828.778424:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627351808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.778473:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.778502:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.778529:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.778572:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.778596:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.778618:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746143828.778625:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627351680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.778647:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.778666:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.778687:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.778706:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.778727:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.778759:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627351808 00000100:00100000:0.0:1746143828.778765:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627351808 00000100:00100000:0.0:1746143828.778788:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627352320 00000100:00100000:0.0:1746143828.778792:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627352320 00000100:00100000:0.0:1746143828.778806:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627352832 00000100:00100000:0.0:1746143828.778809:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627352832 00000100:00100000:0.0:1746143828.778821:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627351680 00000100:00100000:0.0:1746143828.778823:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627351680 00000100:00100000:0.0:1746143828.779690:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627352192 00000100:00100000:0.0:1746143828.779694:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627352192 00000100:00100000:0.0:1746143828.780209:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15854 00000100:00100000:0.0:1746143828.780215:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3772:x1830963627352320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.780286:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963627352320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1757us total) trans 17179873827 rc 0/0 00000100:00100000:0.0:1746143828.780291:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15854 00000100:00100000:0.0:1746143828.780303:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15856 00000100:00100000:0.0:1746143828.780308:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627351680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143828.780342:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143828.780345:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143829 -> 1746143829 00002000:00010000:0.0:1746143828.780347:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143828 -> 1746143828 00002000:00010000:0.0:1746143828.780349:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143829 -> 1746143829 00002000:00010000:0.0:1746143828.780350:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143828.780367:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3772:x1830963627351680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (1720us total) trans 21474841105 rc 0/0 00000100:00100000:0.0:1746143828.780373:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15856 00000100:00100000:0.0:1746143828.780382:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15858 00000100:00100000:0.0:1746143828.780387:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3772:x1830963627352704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143828.780419:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143828.780422:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143828.780423:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143828.780425:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143828.780427:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143828.780441:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963627352704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (1715us total) trans 17179873829 rc 0/0 00000100:00100000:0.0:1746143828.780462:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15858 00000100:00100000:0.0:1746143828.780552:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627353344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.780575:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143828.780602:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8000/2, rc 0, transno 21474841105 00000100:00100000:0.0:1746143828.780606:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627351680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143828.780614:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35a680/2, rc 0, transno 17179873830 00000100:00100000:0.0:1746143828.780620:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.780627:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391d500/2, rc 0, transno 17179873829 00000100:00100000:0.0:1746143828.780630:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.780636:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac9880/2, rc 0, transno 21474841104 00000100:00100000:0.0:1746143828.780638:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627351808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143828.780644:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35bb80/2, rc 0, transno 17179873827 00000100:00100000:0.0:1746143828.780646:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352320:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143828.780653:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009391f100/2, rc 0, transno 17179873828 00000100:00100000:0.0:1746143828.780655:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627352832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.780662:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143828.780667:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627353216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.780682:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143828.780714:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627353344 00000100:00100000:0.0:1746143828.780717:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627353344 00000100:00100000:0.0:1746143828.780727:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627351424 00000100:00100000:0.0:1746143828.780729:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627351424 00000100:00100000:0.0:1746143828.780837:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627352064 00000100:00100000:0.0:1746143828.780840:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627352064 00000100:00100000:0.0:1746143828.780849:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627353088 00000100:00100000:0.0:1746143828.780851:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627353088 00000100:00100000:0.0:1746143828.780857:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627351936 00000100:00100000:0.0:1746143828.780859:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627351936 00000100:00100000:0.0:1746143828.780865:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627352960 00000100:00100000:0.0:1746143828.780867:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627352960 00000100:00100000:0.0:1746143828.780875:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15859 00000100:00100000:0.0:1746143828.780878:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963627353344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.780952:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963627353344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (376us total) trans 21474841106 rc 0/0 00000100:00100000:0.0:1746143828.780957:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15859 00000100:00100000:0.0:1746143828.780966:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15861 00000100:00100000:0.0:1746143828.780970:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963627353216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143828.781005:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143828.781007:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143828.781009:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143828.781011:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143828.781012:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143828.781029:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963627353216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (346us total) trans 21474841107 rc 0/0 00000100:00100000:0.0:1746143828.781034:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15861 00000100:00100000:0.0:1746143828.781044:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15863 00000100:00100000:0.0:1746143828.781049:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627352576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.781094:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627352576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (379us total) trans 17179873833 rc 0/0 00000100:00100000:0.0:1746143828.781099:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15863 00000100:00100000:0.0:1746143828.781107:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15865 00000100:00100000:0.0:1746143828.781112:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e0d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963627353600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.781171:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627353600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (422us total) trans 17179873834 rc 0/0 00000100:00100000:0.0:1746143828.781176:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15865 00000100:00100000:0.0:1746143828.781185:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15867 00000100:00100000:0.0:1746143828.781189:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963627352448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143828.781231:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627352448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (442us total) trans 17179873835 rc 0/0 00000100:00100000:0.0:1746143828.781236:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15867 00000100:00100000:0.0:1746143828.781245:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15869 00000100:00100000:0.0:1746143828.781249:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3774:x1830963627353472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.781289:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3774:x1830963627353472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (468us total) trans 21474841110 rc 0/0 00000100:00100000:0.0:1746143828.781294:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15869 00000004:00080000:0.0:1746143828.781321:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b44a80/2, rc 0, transno 21474841107 00000100:00100000:0.0:1746143828.781324:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627353216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143828.781330:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46300/2, rc 0, transno 21474841106 00000100:00100000:0.0:1746143828.781333:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627353344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143828.787787:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.789483:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.789861:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.796652:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.796734:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.796757:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.798899:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.799522:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.799651:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.799878:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.800094:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.800856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.802970:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627353856:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143828.802981:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143828.803006:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624665216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6067us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143828.803012:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7613 00000100:00100000:0.0:1746143828.809610:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.809653:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.825873:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.825945:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.837333:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.848178:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.852462:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.860224:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.866215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.874265:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.874295:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.874327:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.885844:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.888767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.924207:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.927337:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.947679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.947716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.970131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.983883:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.994388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143828.998729:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.022197:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.025673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.030167:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.034980:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143829.035700:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143829.041177:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.047850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.052220:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.053078:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.063322:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.069095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143829.069761:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143829.127269:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.147126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.147182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.196027:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.206283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.213977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143829.214656:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143829.216361:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.217286:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.218602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.219646:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627355648:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143829.219656:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627355776:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143829.219686:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae56000/0x87925e4cb73b31f1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [778240->1048575] (req 778240->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484108b5 expref: 29 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.219701:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae56000, rc 0) 00000100:00100000:0.0:1746143829.219724:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2294:x1830963624674944:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5552us (5753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143829.219731:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15882 00000100:00100000:0.0:1746143829.221099:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.221133:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.228788:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.235714:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.240073:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.250221:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963624676096:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9741us (10144us total) trans 21474841113 rc 0/0 00000100:00100000:0.0:1746143829.250237:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2541 00002000:00100000:0.0:1746143829.250250:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1789952->2097151) req@ffff88009610d180 x1830963624676096/t21474841113(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:225/0 lens 488/448 e 0 to 0 dl 1746143840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143829.250260:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610d180 with x1830963624676096 ext(1789952->2097151) 00010000:00010000:0.0:1746143829.250271:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73b31b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410899 expref: 16 pid: 1947 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.250289:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73b31b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1789952->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410899 expref: 16 pid: 1947 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746143829.250296:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009610d180 00000100:00100000:0.0:1746143829.254012:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.256235:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.263726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.270768:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.271072:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.281224:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.287567:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.302943:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.308836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.325232:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624678144 00000100:00100000:0.0:1746143829.325242:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624678144 00000100:00100000:0.0:1746143829.325304:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13802 00000100:00100000:0.0:1746143829.325312:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2311:x1830963624678144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143829.325341:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143829.325360:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73b3237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484108d8 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.325453:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325465:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325476:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325489:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325494:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325499:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325610:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73b324c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325620:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73b324c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325626:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73b324c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143829.325634:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143829.325719:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325727:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325733:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325739:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325745:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143829.325749:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325756:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325769:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143829.325772:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143829.325776:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325786:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716600/0x87925e4cb73b323e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325806:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325812:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325816:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325821:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093717600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143829.325823:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325827:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325835:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030e00) 00010000:00010000:0.0:1746143829.325836:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143829.325839:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325843:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b3245 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.325888:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717800/0x87925e4cb73b3237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484108d8 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.325902:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73b324c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484108d8 expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.325934:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143829.325936:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143829.325938:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716c00, rc 0) 00000100:00100000:0.0:1746143829.325988:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2311:x1830963624678144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 676us (802us total) trans 8589944796 rc 0/0 00000100:00100000:0.0:1746143829.325994:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13802 00000100:00100000:0.0:1746143829.327295:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.332518:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627356544:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143829.332549:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143829.332606:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963624678272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4997us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143829.332617:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7625 00000100:00100000:0.0:1746143829.338871:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.347194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.357539:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.364195:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.368964:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624679168:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10946us (11381us total) trans 17179873836 rc 0/0 00000100:00100000:0.0:1746143829.368977:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2543 00002000:00100000:0.0:1746143829.368993:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (778240->1048575) req@ffff880093c71500 x1830963624679168/t17179873836(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:225/0 lens 488/448 e 0 to 0 dl 1746143840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143829.369003:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c71500 with x1830963624679168 ext(778240->1048575) 00010000:00010000:0.0:1746143829.369015:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ae56000/0x87925e4cb73b31f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108b5 expref: 32 pid: 1947 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.369037:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ae56000/0x87925e4cb73b31f1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 778240->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108b5 expref: 32 pid: 1947 timeout: 988 lvb_type: 0 00002000:00010000:0.0:1746143829.369044:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093c71500 00000100:00100000:0.0:1746143829.374573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.381740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.384251:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624679808 00000100:00100000:0.0:1746143829.384256:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624679808 00002000:00100000:0.0:1746143829.384285:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009391dc00 x1830963624679808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:225/0 lens 488/0 e 0 to 0 dl 1746143840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143829.384293:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963624679808 ext(0->1048575) 00002000:00010000:0.0:1746143829.384297:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391dc00 00000100:00100000:0.0:1746143829.384317:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6829 00000100:00100000:0.0:1746143829.384322:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624679808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143829.392421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.397757:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.401203:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.405234:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.414254:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.417981:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.419362:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624680960 00000100:00100000:0.0:1746143829.419369:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624680960 00010000:00010000:0.0:1746143829.419397:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b31ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108bc expref: 33 pid: 1947 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143829.419425:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7627 00000100:00100000:0.0:1746143829.419431:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963624680960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143829.419454:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143829.419476:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b31ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108bc expref: 33 pid: 1947 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.419487:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b31ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108bc expref: 33 pid: 1947 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.419508:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b31ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1732607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108bc expref: 33 pid: 1947 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.419527:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143829.419529:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143829.419536:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b3284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410909 expref: 18 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.419545:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b3284 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410909 expref: 18 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.419580:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b3284 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410909 expref: 18 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.419592:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b3284 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410909 expref: 18 pid: 13430 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143829.419610:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627357568:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143829.419677:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143829.430365:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.430475:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.433096:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.433160:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.433726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.435804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.435831:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.437279:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.438439:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.438894:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.466033:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.479215:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.494355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.505518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.534438:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.541220:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.541267:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.541298:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.541326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.550633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.556733:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.558152:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.565742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143829.566392:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143829.568376:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.571070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.571230:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624687104 00000100:00100000:0.0:1746143829.571234:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624687104 00010000:00010000:0.0:1746143829.571297:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b31ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108ae expref: 18 pid: 7243 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143829.571321:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7634 00000100:00100000:0.0:1746143829.571328:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624687104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143829.571341:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143829.571346:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b31ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108ae expref: 18 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.571358:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b31ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108ae expref: 18 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.571377:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b31ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484108ae expref: 18 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.571393:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143829.571398:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b3317 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.571407:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b3317 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.571412:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b3317 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143829.571430:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143829.571475:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963624687104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143829.571482:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7634 00010000:00010000:1.0:1746143829.571744:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b3309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571761:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571766:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571771:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571774:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143829.571776:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571780:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571785:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e600300) 00010000:00010000:1.0:1746143829.571928:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143829.571932:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571936:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3310 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143829.571959:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b3302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841094f expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.571970:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b3317 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841094f expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.571977:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.571979:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143829.571981:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634200, rc 0) 00000100:00100000:1.0:1746143829.572032:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2322:x1830963624686464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5997us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143829.572037:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13805 00000100:00100000:1.0:1746143829.575104:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.575149:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.575188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.576258:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.576300:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.576324:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.579693:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.583936:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.584025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.588994:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.589007:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624688640 00000100:00100000:1.0:1746143829.589009:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624688640 00010000:00010000:1.0:1746143829.589025:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b3333 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410956 expref: 273 pid: 7243 timeout: 988 lvb_type: 0 00000100:00100000:1.0:1746143829.589191:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7636 00000100:00100000:1.0:1746143829.589195:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:2009:x1830963624688640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143829.589201:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143829.589203:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b3333 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410956 expref: 273 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:1.0:1746143829.589410:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b3333 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410956 expref: 273 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:1.0:1746143829.589418:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b3333 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410956 expref: 273 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:1.0:1746143829.589431:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.589433:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.589439:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.589452:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.589464:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143829.589478:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:2009:x1830963624688640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 283us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143829.589482:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7636 00000100:00100000:0.0:1746143829.593222:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.597863:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.597948:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624688896 00000100:00100000:1.0:1746143829.597959:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624688896 00010000:00010000:1.0:1746143829.598003:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841098e expref: 10 pid: 7243 timeout: 988 lvb_type: 0 00000100:00100000:1.0:1746143829.598043:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7637 00000100:00100000:1.0:1746143829.598051:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624688896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143829.598065:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143829.598072:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841098e expref: 10 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:1.0:1746143829.598082:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841098e expref: 10 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:1.0:1746143829.598458:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b3379 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841098e expref: 10 pid: 7243 timeout: 988 lvb_type: 0 00010000:00010000:1.0:1746143829.598485:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.598489:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.598498:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.598505:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.598525:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143829.598574:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624688896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 524us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143829.598582:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7637 00010000:00010000:1.0:1746143829.598603:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.598608:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143829.598657:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:1.0:1746143829.598661:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143829.598678:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.598706:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b3387 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410995 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.598722:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410995 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.598727:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.598730:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143829.598732:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96200, rc 0) 00000100:00100000:1.0:1746143829.598768:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2322:x1830963624688768:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4742us (5554us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143829.598774:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13808 00000100:00100000:0.0:1746143829.599632:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.599834:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624689024 00000100:00100000:1.0:1746143829.599841:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624689024 00010000:00010000:1.0:1746143829.599864:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b32bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1830911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410925 expref: 22 pid: 13430 timeout: 988 lvb_type: 0 00000100:00100000:0.0:1746143829.601634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.605329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.605674:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624689408 00000100:00100000:1.0:1746143829.605685:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624689408 00000100:00100000:1.0:1746143829.605738:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13809 00000100:00100000:1.0:1746143829.605746:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2322:x1830963624689408:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143829.605767:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143829.605786:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b339c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484109a3 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.605890:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605906:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605942:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605956:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605962:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605967:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605973:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143829.605977:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605983:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.605993:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.605996:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143829.606000:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.606005:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33a3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.606032:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b339c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109a3 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.606040:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b339c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109a3 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.606051:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634a00, rc 0) 00000100:00100000:1.0:1746143829.606072:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2322:x1830963624689408:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 327us (754us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143829.606078:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13809 00000100:00100000:0.0:1746143829.607024:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.608847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.637581:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.664224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.672843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.677656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.689877:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.689994:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624691072 00000100:00100000:1.0:1746143829.690007:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624691072 00000100:00100000:0.0:1746143829.690058:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624691328 00000100:00100000:0.0:1746143829.690061:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624691328 00000100:00100000:1.0:1746143829.690071:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5292 00000100:00100000:1.0:1746143829.690080:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+272:2319:x1830963624691072:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143829.690095:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13811 00000100:00100000:0.0:1746143829.690099:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2329:x1830963624691328:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143829.690116:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143829.690135:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dbc00/0x87925e4cb73b33d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484109b8 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143829.690306:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:2319:x1830963624691072:12345-192.168.202.3@tcp:35:cat.0 Request processed in 226us (1485us total) trans 8589944807 rc 0/0 00000100:00100000:1.0:1746143829.690314:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5292 00010000:00010000:1.0:1746143829.690429:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.690458:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410995 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.690465:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b33bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109aa expref: 20 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.690473:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.690503:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b33bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109aa expref: 20 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.690519:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b33bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109aa expref: 20 pid: 7245 timeout: 988 lvb_type: 0 00000100:00100000:1.0:1746143829.690530:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627359872:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143829.690608:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410995 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.690616:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b338e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410995 expref: 8 pid: 7243 timeout: 988 lvb_type: 0 00000100:00100000:1.0:1746143829.690623:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627360000:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143829.690643:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143829.695404:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627359872:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143829.695423:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627360000:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143829.695471:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143829.700745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.703434:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624691840 00000100:00100000:0.0:1746143829.703440:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624691840 00002000:00100000:0.0:1746143829.703494:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009322ed80 x1830963624691840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:225/0 lens 488/0 e 0 to 0 dl 1746143840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143829.703505:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ed80 with x1830963624691840 ext(1048576->2097151) 00002000:00010000:0.0:1746143829.703509:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ed80 00000100:00100000:0.0:1746143829.703543:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6842 00000100:00100000:0.0:1746143829.703551:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624691840:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143829.703713:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.703721:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143829.703740:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143829.703873:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dbc00/0x87925e4cb73b33d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b8 expref: 21 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.703896:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b8 expref: 20 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.703902:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.703905:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143829.703907:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634600, rc 0) 00000100:00100000:1.0:1746143829.703957:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2329:x1830963624691328:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13856us (13959us total) trans 8589944808 rc 0/0 00000100:00100000:1.0:1746143829.703963:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13811 00000100:00100000:1.0:1746143829.735542:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624692096 00000100:00100000:1.0:1746143829.735554:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624692096 00000100:00100000:1.0:1746143829.735612:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5293 00000100:00100000:1.0:1746143829.735622:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2327:x1830963624692096:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143829.735892:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2327:x1830963624692096:12345-192.168.202.3@tcp:35:cat.0 Request processed in 269us (554us total) trans 8589944809 rc 0/0 00000100:00100000:1.0:1746143829.735899:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5293 00000100:00100000:0.0:1746143829.750406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.760216:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.760298:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.760321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.760346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.760374:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624692480 00000100:00100000:0.0:1746143829.760382:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624692480 00010000:00010000:0.0:1746143829.760420:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b316c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841086f expref: 34 pid: 9839 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143829.760456:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624692608 00000100:00100000:0.0:1746143829.760458:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624692608 00010000:00010000:0.0:1746143829.760470:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2db000/0x87925e4cb73b3356 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410972 expref: 10 pid: 9587 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143829.760482:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624692736 00000100:00100000:0.0:1746143829.760484:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624692736 00010000:00010000:0.0:1746143829.760492:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73b30ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841080d expref: 18 pid: 1947 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143829.760504:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7641 00000100:00100000:0.0:1746143829.760510:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963624692480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143829.760525:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143829.760545:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b316c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841086f expref: 34 pid: 9839 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143829.760555:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b316c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841086f expref: 34 pid: 9839 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143829.760579:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143829.760619:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963624692480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143829.760625:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7641 00000100:00100000:0.0:1746143829.760640:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7642 00000100:00100000:0.0:1746143829.760644:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624692608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143829.760650:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143829.760655:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e2db000/0x87925e4cb73b3356 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410972 expref: 10 pid: 9587 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143829.760662:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e2db000/0x87925e4cb73b3356 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410972 expref: 10 pid: 9587 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143829.760672:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143829.760683:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624692608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 39us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143829.760687:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7642 00000100:00100000:0.0:1746143829.760694:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7643 00000100:00100000:0.0:1746143829.760698:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624692736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143829.760705:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143829.760709:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73b30ee lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841080d expref: 18 pid: 1947 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143829.760717:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323a600/0x87925e4cb73b30ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841080d expref: 18 pid: 1947 timeout: 988 lvb_type: 1 00010000:00010000:0.0:1746143829.760727:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143829.760729:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143829.760736:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091381c00/0x87925e4cb73b33e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109bf expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.760743:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091381c00/0x87925e4cb73b33e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109bf expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.760775:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091381c00/0x87925e4cb73b33e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109bf expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143829.760788:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627360512:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143829.760843:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143829.765488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.765523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.765577:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624692992 00000100:00100000:1.0:1746143829.765585:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624692992 00000100:00100000:0.0:1746143829.765609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143829.765625:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b33cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b1 expref: 24 pid: 1947 timeout: 988 lvb_type: 1 00000100:00100000:0.0:1746143829.767407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.767639:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624692864 00000100:00100000:1.0:1746143829.767644:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624692864 00010000:00010000:1.0:1746143829.767661:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3395 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841099c expref: 10 pid: 13430 timeout: 988 lvb_type: 1 00000100:00100000:1.0:1746143829.767678:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624693376 00000100:00100000:1.0:1746143829.767680:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624693376 00010000:00010000:1.0:1746143829.767687:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b336b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410987 expref: 33 pid: 13430 timeout: 988 lvb_type: 0 00000100:00100000:1.0:1746143829.767701:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7644 00000100:00100000:1.0:1746143829.767707:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963624692992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143829.767716:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143829.767733:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b33cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b1 expref: 23 pid: 1947 timeout: 988 lvb_type: 1 00010000:00010000:1.0:1746143829.767742:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b33cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b1 expref: 23 pid: 1947 timeout: 988 lvb_type: 1 00010000:00010000:1.0:1746143829.767763:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b33cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b1 expref: 23 pid: 1947 timeout: 988 lvb_type: 1 00010000:00010000:1.0:1746143829.767779:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143829.768137:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7646 00000100:00100000:0.0:1746143829.768145:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624693376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143829.768154:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143829.768167:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b336b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410987 expref: 33 pid: 13430 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.768178:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b336b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410987 expref: 33 pid: 13430 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.768190:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b336b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410987 expref: 33 pid: 13430 timeout: 988 lvb_type: 0 00010000:00010000:0.0:1746143829.768203:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143829.768206:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624692992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 497us (2723us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143829.768206:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143829.768213:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7644 00010000:00010000:0.0:1746143829.768213:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.768221:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143829.768253:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143829.768266:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627361024:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143829.768491:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143829.774385:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.779540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.779642:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.784607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.789736:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624694400 00000100:00100000:0.0:1746143829.789742:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624694400 00010000:00010000:0.0:1746143829.789761:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73b32c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841092c expref: 17 pid: 13430 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143829.796201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.800317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.815156:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.815711:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624695168 00000100:00100000:1.0:1746143829.815723:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624695168 00000100:00100000:1.0:1746143829.815903:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13812 00000100:00100000:1.0:1746143829.815931:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+274:2336:x1830963624695168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143829.815960:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143829.815981:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484109d4 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.816057:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816071:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816084:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816097:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816103:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816108:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816201:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73b3413 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816210:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73b3413 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816216:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73b3413 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143829.816224:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143829.816293:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816304:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816309:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816315:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816321:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143829.816324:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816331:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816341:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143829.816344:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143829.816348:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816352:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b3405 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816372:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816377:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816382:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816386:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143829.816389:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816394:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816400:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8100) 00010000:00010000:1.0:1746143829.816402:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143829.816404:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816408:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b340c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143829.816455:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b33fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109d4 expref: 277 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.816470:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634e00/0x87925e4cb73b3413 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109d4 expref: 276 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.816476:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.816478:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143829.816481:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634e00, rc 0) 00000100:00100000:1.0:1746143829.816531:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+276:2336:x1830963624695168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 621us (1624us total) trans 8589944811 rc 0/0 00000100:00100000:1.0:1746143829.816537:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13812 00000100:00100000:0.0:1746143829.819668:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.820550:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624695424 00000100:00100000:0.0:1746143829.820554:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624695424 00000100:00100000:0.0:1746143829.820591:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15912 00000100:00100000:0.0:1746143829.820597:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624695424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143829.820613:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143829.820626:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2db000/0x87925e4cb73b3421 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484109db expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143829.820674:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627361664:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143829.820739:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143829.827430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.830677:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.837702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.837873:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624695808 00000100:00100000:1.0:1746143829.837880:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624695808 00010000:00010000:1.0:1746143829.837909:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 24 pid: 13430 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143829.838028:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7650 00000100:00100000:1.0:1746143829.838036:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963624695808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143829.838047:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143829.838062:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 24 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143829.838072:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 24 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143829.838092:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7f800/0x87925e4cb73b33f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1282048->1732607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109c6 expref: 24 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143829.839456:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143829.839460:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143829.839468:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.839478:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.839510:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143829.839521:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627361920:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143829.840055:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143829.842847:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627361920:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143829.843020:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143829.843069:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963624695808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5031us (5368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143829.843081:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7650 00000100:00100000:0.0:1746143829.845385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.845670:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.845695:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624696320 00000100:00100000:0.0:1746143829.845702:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624696320 00002000:00100000:0.0:1746143829.845733:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1785855) req@ffff880090e7b800 x1830963624696320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:225/0 lens 488/0 e 0 to 0 dl 1746143840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143829.845748:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b800 with x1830963624696320 ext(1048576->1785855) 00002000:00010000:0.0:1746143829.845753:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e7b800 00000100:00100000:0.0:1746143829.845785:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6848 00000100:00100000:0.0:1746143829.845793:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624696320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143829.854741:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624696320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8946us (9069us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746143829.854749:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6848 00002000:00100000:1.0:1746143829.854755:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1785855) req@ffff880090e7b800 x1830963624696320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:225/0 lens 488/440 e 0 to 0 dl 1746143840 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143829.854762:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b800 with x1830963624696320 ext(1048576->1785855) 00002000:00010000:1.0:1746143829.854765:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e7b800 00000100:00100000:0.0:1746143829.871893:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.872410:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624696576 00000100:00100000:1.0:1746143829.872417:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624696576 00002000:00100000:1.0:1746143829.872462:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2744320->4194303) req@ffff880090e78700 x1830963624696576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:225/0 lens 488/0 e 0 to 0 dl 1746143840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143829.872470:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78700 with x1830963624696576 ext(2744320->4194303) 00002000:00010000:1.0:1746143829.872475:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e78700 00000100:00100000:1.0:1746143829.873506:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6849 00000100:00100000:1.0:1746143829.873514:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624696576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143829.883490:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624696576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9969us (11594us total) trans 0 rc 1449984/1449984 00000100:00100000:1.0:1746143829.883499:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6849 00002000:00100000:1.0:1746143829.883507:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2744320->4194303) req@ffff880090e78700 x1830963624696576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:225/0 lens 488/440 e 0 to 0 dl 1746143840 ref 1 fl Complete:/200/0 rc 1449984/1449984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143829.883521:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78700 with x1830963624696576 ext(2744320->4194303) 00002000:00010000:1.0:1746143829.883525:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e78700 00000100:00100000:0.0:1746143829.890463:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.890530:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624696832 00000100:00100000:1.0:1746143829.890538:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624696832 00002000:00100000:1.0:1746143829.890574:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff880090e78a80 x1830963624696832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:225/0 lens 488/0 e 0 to 0 dl 1746143840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143829.890582:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78a80 with x1830963624696832 ext(4194304->4808703) 00002000:00010000:1.0:1746143829.890588:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e78a80 00000100:00100000:1.0:1746143829.890843:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6850 00000100:00100000:1.0:1746143829.890851:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624696832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143829.905312:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.905466:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624697088 00000100:00100000:1.0:1746143829.905477:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624697088 00000100:00100000:1.0:1746143829.905533:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5295 00000100:00100000:1.0:1746143829.905542:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+275:2336:x1830963624697088:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143829.905779:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+276:2336:x1830963624697088:12345-192.168.202.3@tcp:35:cat.0 Request processed in 238us (477us total) trans 8589944812 rc 0/0 00000100:00100000:1.0:1746143829.905785:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5295 00000100:00100000:0.0:1746143829.958771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.965404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.965637:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624697472 00000100:00100000:1.0:1746143829.965647:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624697472 00000100:00100000:0.0:1746143829.965700:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.965713:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 948 00000100:00100000:1.0:1746143829.965722:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624697472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143829.965738:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143829.965765:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a400/0x87925e4cb73b3444 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e9 expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143829.965791:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143829.965796:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143829.965840:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624697472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143829.965846:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 948 00000100:00100000:1.0:1746143829.966743:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143829.966778:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.966787:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624697856 00000100:00100000:0.0:1746143829.966791:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624697856 00000100:00100000:0.0:1746143829.966826:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15916 00000100:00100000:0.0:1746143829.966832:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963624697856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143829.966839:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143829.966847:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2da000/0x87925e4cb73b3460 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484109fe expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143829.966882:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627362048:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143829.966979:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143829.982420:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143829.994259:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.001148:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.010776:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.014468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.014515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.014559:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.030624:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143830.031080:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143830.036436:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.039640:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963624699392:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8761us (9017us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143830.039651:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6852 00002000:00100000:0.0:1746143830.039662:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c32300 x1830963624699392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.039673:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32300 with x1830963624699392 ext(1048576->2097151) 00002000:00010000:0.0:1746143830.039677:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32300 00000100:00100000:0.0:1746143830.041011:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.053018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.061771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.061947:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624700032 00000100:00100000:1.0:1746143830.061956:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624700032 00002000:00100000:1.0:1746143830.061995:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2744319) req@ffff880092b70a80 x1830963624700032/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.062004:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70a80 with x1830963624700032 ext(2097152->2744319) 00010000:00010000:1.0:1746143830.062012:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 33 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.062025:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 33 pid: 13430 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.062031:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b70a80 00000100:00100000:1.0:1746143830.062050:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2551 00000100:00100000:1.0:1746143830.062057:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624700032:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143830.073323:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624700032:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11255us (11547us total) trans 17179873839 rc 0/0 00000100:00100000:0.0:1746143830.073336:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2551 00002000:00100000:0.0:1746143830.073349:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2744319) req@ffff880092b70a80 x1830963624700032/t17179873839(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.073358:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70a80 with x1830963624700032 ext(2097152->2744319) 00010000:00010000:0.0:1746143830.073367:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 35 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.073384:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 35 pid: 13430 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143830.073395:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b70a80 00000100:00100000:0.0:1746143830.085555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.085655:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624700160 00000100:00100000:1.0:1746143830.085664:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624700160 00010000:00010000:1.0:1746143830.085700:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 35 pid: 13430 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.085757:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7652 00000100:00100000:1.0:1746143830.085767:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624700160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.085779:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.085796:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 35 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.085806:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 35 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.085826:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b33f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2744319) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109cd expref: 35 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.085845:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.085847:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.085854:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73b34b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a1a expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.085861:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73b34b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a1a expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.085895:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73b34b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a1a expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.085907:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627362688:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143830.086027:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.087319:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627362688:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.087331:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.087354:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624700160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1588us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.087361:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7652 00000100:00100000:0.0:1746143830.093365:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.108653:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143830.108791:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143830.114615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.114652:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.114787:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624700672 00000100:00100000:1.0:1746143830.115101:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624700672 00010000:00010000:1.0:1746143830.115132:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b3452 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109f0 expref: 25 pid: 9586 timeout: 989 lvb_type: 1 00000100:00100000:1.0:1746143830.115163:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624700800 00000100:00100000:1.0:1746143830.115165:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624700800 00010000:00010000:1.0:1746143830.115174:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 33 pid: 13430 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.115200:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7653 00000100:00100000:1.0:1746143830.115206:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963624700672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.115217:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143830.115225:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7654 00000100:00100000:0.0:1746143830.115231:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624700800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.115232:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b3452 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109f0 expref: 25 pid: 9586 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.115237:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.115240:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b3452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109f0 expref: 25 pid: 9586 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.115251:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 33 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.115258:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 33 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.115275:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b3428 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109e2 expref: 33 pid: 13430 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.115292:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.115322:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624700800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.115328:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7654 00010000:00010000:1.0:1746143830.115662:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b3452 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109f0 expref: 25 pid: 9586 timeout: 989 lvb_type: 1 00010000:00010000:1.0:1746143830.115686:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.115688:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.115693:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.115699:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.115722:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.115732:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627363072:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143830.115974:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.122031:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627363072:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.122047:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.122090:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963624700672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6884us (7478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.122098:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7653 00000100:00100000:0.0:1746143830.123463:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6854 00000100:00100000:0.0:1746143830.123473:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963624701056:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143830.123589:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963624701056:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 118us (1774us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143830.123595:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6854 00002000:00100000:0.0:1746143830.123601:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1470464->1474559) req@ffff880095e31c00 x1830963624701056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/4536 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.123608:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31c00 with x1830963624701056 ext(1470464->1474559) 00002000:00010000:0.0:1746143830.123611:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e31c00 00000100:00100000:0.0:1746143830.127266:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.130985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.131092:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624701568 00000100:00100000:1.0:1746143830.131098:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624701568 00000100:00100000:1.0:1746143830.131140:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13816 00000100:00100000:1.0:1746143830.131145:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+277:2347:x1830963624701568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.131159:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.131173:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b34c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a28 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.131232:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131243:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131252:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131263:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131268:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131273:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131345:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73b34d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131353:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73b34d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131358:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73b34d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143830.131366:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143830.131423:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131429:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131435:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131450:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131455:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143830.131458:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131463:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131472:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143830.131474:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143830.131477:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.131481:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b34c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132755:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132763:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132768:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132772:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143830.132775:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132782:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132791:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096d83d00) 00010000:00010000:1.0:1746143830.132794:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143830.132796:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132800:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b34d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.132837:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b34c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a28 expref: 280 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.132847:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3a00/0x87925e4cb73b34d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a28 expref: 279 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.132853:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143830.132854:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143830.132856:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3a00, rc 0) 00000100:00100000:1.0:1746143830.132923:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+279:2347:x1830963624701568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1764us (1927us total) trans 8589944817 rc 0/0 00000100:00100000:1.0:1746143830.132931:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13816 00000100:00100000:0.0:1746143830.135468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.141871:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.142196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.142219:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624701824 00000100:00100000:0.0:1746143830.142219:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.142227:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624701824 00000100:00100000:1.0:1746143830.142510:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15923 00000100:00100000:1.0:1746143830.142517:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624701824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.142524:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.142533:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73b34fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a36 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.142570:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627363328:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143830.142709:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.143359:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.143422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.143490:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624702208 00000100:00100000:0.0:1746143830.143494:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624702208 00010000:00010000:0.0:1746143830.143516:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b3467 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a05 expref: 19 pid: 3134 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143830.143533:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624702336 00000100:00100000:0.0:1746143830.143535:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624702336 00000100:00100000:0.0:1746143830.143564:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7655 00000100:00100000:0.0:1746143830.143569:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963624702208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.143578:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.143594:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b3467 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a05 expref: 19 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.143608:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b3467 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a05 expref: 19 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.143620:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b3467 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a05 expref: 19 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.143631:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.143632:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.143636:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.143642:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.143660:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143830.143667:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627363456:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143830.143706:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.145100:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627363328:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143830.145119:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73b34fa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a36 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.145128:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73b34fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a36 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.145151:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eda00, rc 0) 00000100:00100000:1.0:1746143830.145179:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624701824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2662us (3312us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143830.145185:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15923 00000100:00100000:1.0:1746143830.147248:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627363456:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.147263:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.147304:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624702208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3733us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.147314:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7655 00000100:00100000:0.0:1746143830.147330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.147358:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624702464 00000100:00100000:1.0:1746143830.147363:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624702464 00000100:00100000:1.0:1746143830.147396:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15924 00000100:00100000:1.0:1746143830.147401:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624702464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.147414:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.147433:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b3501 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a4b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.147477:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627363584:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143830.147603:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.148797:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627363584:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143830.148816:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b3501 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a4b expref: 19 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.148826:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b3501 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a4b expref: 19 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.148834:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76600, rc 0) 00000100:00100000:1.0:1746143830.148875:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624702464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1473us (1544us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143830.148882:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15924 00000100:00100000:0.0:1746143830.150549:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.155281:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.155577:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.156042:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624702848 00000100:00100000:1.0:1746143830.156046:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624702848 00000100:00100000:1.0:1746143830.156067:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15925 00000100:00100000:1.0:1746143830.156072:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2347:x1830963624702848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.156081:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.156094:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a52 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.156114:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.156122:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.156123:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.156127:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.156151:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.156161:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 23 pid: 3134 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.156171:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627363712:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.156240:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.157381:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627363712:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.157397:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 33 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.157407:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:1.0:1746143830.157888:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2347:x1830963624702848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1813us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.157894:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15925 00000100:00100000:0.0:1746143830.160143:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.168318:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624703232:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6527us (8202us total) trans 21474841119 rc 0/0 00000100:00100000:0.0:1746143830.168328:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2552 00002000:00100000:0.0:1746143830.168336:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1470464->2097151) req@ffff88012b1d9f80 x1830963624703232/t21474841119(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.168342:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9f80 with x1830963624703232 ext(1470464->2097151) 00010000:00010000:0.0:1746143830.168349:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 26 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.168358:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 26 pid: 3134 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143830.168363:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1d9f80 00000100:00100000:0.0:1746143830.170238:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.170385:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624703360 00000100:00100000:1.0:1746143830.170392:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624703360 00010000:00010000:1.0:1746143830.170420:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 26 pid: 3134 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.170470:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7656 00000100:00100000:1.0:1746143830.170477:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624703360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.170488:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.170502:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 26 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.170512:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 26 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.170529:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b34bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a21 expref: 26 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.170555:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.170557:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.170563:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.170569:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.170593:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.170602:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627363840:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143830.170665:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.173084:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627363840:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.173100:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.173777:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963624703360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3299us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.173786:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7656 00000100:00100000:0.0:1746143830.176576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.192994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.193073:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624703744 00000100:00100000:1.0:1746143830.193080:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624703744 00000100:00100000:1.0:1746143830.193626:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15926 00000100:00100000:1.0:1746143830.193633:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2347:x1830963624703744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.193647:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.193659:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a59 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.193682:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.193688:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.193690:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.193692:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.193713:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.193721:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 17 pid: 3134 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.193730:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627363968:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.193791:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.201383:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.202016:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627363968:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.202034:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.202045:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76000, rc 0) 00000100:00100000:1.0:1746143830.202066:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2347:x1830963624703744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8433us (9080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.202072:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15926 00000100:00100000:0.0:1746143830.207021:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624703872:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5176us (5632us total) trans 17179873840 rc 0/0 00000100:00100000:0.0:1746143830.207037:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2553 00002000:00100000:0.0:1746143830.207049:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1130495) req@ffff88012b1db100 x1830963624703872/t17179873840(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.207059:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db100 with x1830963624703872 ext(1048576->1130495) 00010000:00010000:0.0:1746143830.207070:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 20 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.207088:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 20 pid: 3134 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143830.207096:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1db100 00000100:00100000:0.0:1746143830.212055:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.212153:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624704000 00000100:00100000:1.0:1746143830.212162:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624704000 00010000:00010000:1.0:1746143830.212207:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 20 pid: 3134 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.212248:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7657 00000100:00100000:1.0:1746143830.212256:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624704000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.212273:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.212295:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 20 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.212306:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 20 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.212327:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b34e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a2f expref: 20 pid: 3134 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.212349:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.212351:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.212358:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.212371:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.212405:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.212422:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627364096:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143830.212507:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.215979:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627364096:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.216003:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.216061:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963624704000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3804us (4016us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.216073:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7657 00000100:00100000:0.0:1746143830.220055:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.236972:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.237361:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624704384 00000100:00100000:1.0:1746143830.237373:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624704384 00000100:00100000:1.0:1746143830.237424:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15927 00000100:00100000:1.0:1746143830.237432:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2344:x1830963624704384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143830.237458:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.237475:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a60 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.237508:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73b34b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a1a expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.237516:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b34f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a44 expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.237522:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.237524:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.237527:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.237555:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b34f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a44 expref: 37 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.237564:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b34f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a44 expref: 37 pid: 13430 timeout: 989 lvb_type: 1 00000100:00100000:1.0:1746143830.237575:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627364224:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.237664:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73b34b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a1a expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.237672:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467600/0x87925e4cb73b34b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a1a expref: 18 pid: 3134 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.237680:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627364352:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.237708:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.239154:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.239545:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627364224:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.239557:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627364352:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.239583:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.239602:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76a00, rc 0) 00000100:00100000:1.0:1746143830.239639:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2344:x1830963624704384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2207us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.239646:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15927 00000100:00100000:0.0:1746143830.244992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.245312:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.246315:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624704768 00000100:00100000:1.0:1746143830.246320:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624704768 00000100:00100000:1.0:1746143830.246597:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15928 00000100:00100000:1.0:1746143830.246605:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2347:x1830963624704768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.246617:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.246627:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b351d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a67 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.246646:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.246652:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.246653:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.246656:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b351d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a67 expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.246676:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.246685:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 37 pid: 1947 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.246693:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627364608:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.246752:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.248903:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627364608:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.248931:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b351d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a67 expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.248943:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76800, rc 0) 00000100:00100000:1.0:1746143830.248959:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2347:x1830963624704768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2354us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.248965:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15928 00000100:00100000:0.0:1746143830.249131:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.252398:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.252946:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.252971:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624705408 00000100:00100000:1.0:1746143830.252975:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624705408 00000100:00100000:1.0:1746143830.253001:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15929 00000100:00100000:1.0:1746143830.253006:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2344:x1830963624705408:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143830.253016:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.253027:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a6e expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.253050:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73b30fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841081b expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.253057:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b3364 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410980 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.253063:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095d6ce00/0x87925e4cb73b317a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841087d expref: 34 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.253068:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.253069:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.253072:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->4071423] (req 3145728->4071423) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a6e expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.253099:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095d6ce00/0x87925e4cb73b317a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841087d expref: 34 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.253107:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095d6ce00/0x87925e4cb73b317a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841087d expref: 34 pid: 9587 timeout: 989 lvb_type: 1 00000100:00100000:1.0:1746143830.253116:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627364736:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.253172:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b3364 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410980 expref: 8 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.253180:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b3364 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410980 expref: 8 pid: 9587 timeout: 989 lvb_type: 1 00000100:00100000:1.0:1746143830.253191:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627364864:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.253213:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73b30fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841081b expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.253221:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73b30fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841081b expref: 24 pid: 1947 timeout: 989 lvb_type: 1 00000100:00100000:1.0:1746143830.253228:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627364992:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.253242:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.257008:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963624705280:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4144us (4764us total) trans 17179873841 rc 0/0 00000100:00100000:0.0:1746143830.257017:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2555 00002000:00100000:0.0:1746143830.257026:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4157440->4194303) req@ffff88012b1db800 x1830963624705280/t17179873841(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.257034:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db800 with x1830963624705280 ext(4157440->4194303) 00010000:00010000:0.0:1746143830.257042:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 39 pid: 1947 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.257052:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b3516 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a60 expref: 39 pid: 1947 timeout: 989 lvb_type: 0 00002000:00010000:0.0:1746143830.257058:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1db800 00000100:00100000:0.0:1746143830.259591:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.259611:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627364736:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.259622:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627364864:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.259629:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627364992:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.259656:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->4071423] (req 3145728->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a6e expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.259671:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77c00, rc 0) 00000100:00100000:1.0:1746143830.259705:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2344:x1830963624705408:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6698us (7170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.259712:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15929 00000100:00080000:1.0:1746143830.259929:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143830.261880:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.261985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.264732:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.271935:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.272124:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.272214:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.280071:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.280510:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624706944 00000100:00100000:1.0:1746143830.280519:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624706944 00000100:00100000:1.0:1746143830.281545:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13817 00000100:00100000:1.0:1746143830.281554:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2353:x1830963624706944:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.281573:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.281587:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b352b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a75 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.281640:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281650:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281659:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281670:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281674:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281679:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281753:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3540 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281762:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3540 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281767:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3540 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143830.281778:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143830.281839:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281845:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281849:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281854:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281859:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143830.281862:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281868:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281877:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143830.281880:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143830.281883:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281887:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b3532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281930:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281934:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281941:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281944:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143830.281947:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281952:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281959:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096d83f00) 00010000:00010000:1.0:1746143830.281961:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143830.281963:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281970:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b3539 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.281998:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b352b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a75 expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.282008:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3540 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a75 expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.282014:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143830.282016:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143830.282018:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:1.0:1746143830.282060:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2353:x1830963624706944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 507us (1996us total) trans 8589944819 rc 0/0 00000100:00100000:1.0:1746143830.282065:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13817 00000100:00100000:0.0:1746143830.286742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.289897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.291185:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.291928:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.292042:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.292076:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.293384:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.303337:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.308118:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.309017:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624708864 00000100:00100000:1.0:1746143830.309021:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624708864 00002000:00100000:1.0:1746143830.309038:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095e31180 x1830963624708864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.309044:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963624708864 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.309047:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:1.0:1746143830.309069:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6865 00000100:00100000:1.0:1746143830.309074:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624708864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143830.320643:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.320864:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624708864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11788us (11893us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.320873:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6865 00002000:00100000:1.0:1746143830.320882:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095e31180 x1830963624708864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.320891:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963624708864 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.320895:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:0.0:1746143830.330614:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.330818:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624709376 00000100:00100000:1.0:1746143830.330829:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624709376 00002000:00100000:1.0:1746143830.330885:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136336d80 x1830963624709376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.330895:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136336d80 with x1830963624709376 ext(2097152->3145727) 00002000:00010000:1.0:1746143830.330901:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136336d80 00000100:00100000:1.0:1746143830.330961:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6866 00000100:00100000:1.0:1746143830.330968:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963624709376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.335377:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624709504 00000100:00100000:1.0:1746143830.335388:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624709504 00000100:00100000:1.0:1746143830.335460:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13818 00000100:00100000:1.0:1746143830.335469:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2356:x1830963624709504:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143830.335600:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.335621:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b356a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410a98 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.335689:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b3571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335702:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b3571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335711:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b3571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335724:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b3578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335729:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b3578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335733:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b3578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335807:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b357f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335818:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b8 expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.335824:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b357f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.335860:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b8 expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.335872:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b33db lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484109b8 expref: 25 pid: 7243 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.335884:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627365504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.335979:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.337859:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627365504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.337878:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b357f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746143830.340855:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963624709376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9887us (10251us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.340863:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6866 00002000:00100000:1.0:1746143830.340870:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136336d80 x1830963624709376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.340878:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136336d80 with x1830963624709376 ext(2097152->3145727) 00002000:00010000:1.0:1746143830.340882:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136336d80 00000100:00100000:0.0:1746143830.343411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.347125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.347416:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.348609:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15935 00000100:00100000:0.0:1746143830.348615:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624710144:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143830.348628:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143830.348645:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410aa6 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.348668:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.348670:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.348677:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143830.348696:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143830.348703:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27800, rc 0) 00000100:00100000:0.0:1746143830.348802:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624710144:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 186us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.349225:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15935 00000100:00100000:1.0:1746143830.349329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.349344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.349364:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.349408:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624710272 00000100:00100000:0.0:1746143830.349411:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624710272 00000100:00100000:0.0:1746143830.349462:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624710400 00000100:00100000:0.0:1746143830.349465:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624710400 00000100:00100000:0.0:1746143830.349478:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15936 00000100:00100000:0.0:1746143830.349483:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624710272:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143830.349491:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143830.349501:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410aad expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.349512:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.349514:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.349518:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143830.349528:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143830.349535:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27200, rc 0) 00000100:00080000:1.0:1746143830.349870:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143830.349939:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624710272:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 455us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.349945:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15936 00000100:00100000:0.0:1746143830.353095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.353390:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624710656 00000100:00100000:1.0:1746143830.353396:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624710656 00002000:00100000:1.0:1746143830.353462:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4071423) req@ffff880136337800 x1830963624710656/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.353484:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136337800 with x1830963624710656 ext(3145728->4071423) 00010000:00010000:1.0:1746143830.353491:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a6e expref: 33 pid: 1947 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.353504:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a6e expref: 33 pid: 1947 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.353510:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136337800 00000100:00100000:1.0:1746143830.353538:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2556 00000100:00100000:1.0:1746143830.353544:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624710656:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143830.357054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.361484:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.364950:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624710656:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11395us (11844us total) trans 21474841120 rc 0/0 00000100:00100000:1.0:1746143830.364963:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2556 00002000:00100000:1.0:1746143830.364977:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4071423) req@ffff880136337800 x1830963624710656/t21474841120(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.364986:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136337800 with x1830963624710656 ext(3145728->4071423) 00010000:00010000:1.0:1746143830.364997:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a6e expref: 35 pid: 1947 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.365011:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e77c00/0x87925e4cb73b3524 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a6e expref: 35 pid: 1947 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.365019:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136337800 00000100:00100000:0.0:1746143830.365663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.371609:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7667 00000100:00100000:1.0:1746143830.371618:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624711424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.371627:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.371632:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b35b0 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac2 expref: 12 pid: 7243 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.371641:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b35b0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac2 expref: 12 pid: 7243 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.371655:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143830.371660:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.371668:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.371677:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143830.371695:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.371739:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624711424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.371746:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7667 00010000:00010000:0.0:1746143830.371948:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b35b0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac2 expref: 11 pid: 7243 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143830.371964:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627366016:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143830.371980:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143830.371988:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143830.371994:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746143830.372043:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:0.0:1746143830.372047:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143830.372062:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143830.372089:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c600/0x87925e4cb73b35be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac9 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.372100:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac9 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.372117:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143830.372120:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143830.372122:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d200, rc 0) 00000100:00100000:0.0:1746143830.372147:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2356:x1830963624711168:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6373us (6486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.372154:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13820 00000100:00100000:0.0:1746143830.379046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.380495:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.382128:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.382546:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624712064 00000100:00100000:0.0:1746143830.382552:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624712064 00000100:00100000:0.0:1746143830.382596:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13822 00000100:00100000:0.0:1746143830.382602:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2356:x1830963624712064:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143830.382615:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143830.382624:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26600/0x87925e4cb73b35f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410ade expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.382770:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382779:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382786:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382800:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382804:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382810:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382814:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143830.382816:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382820:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382827:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143830.382829:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143830.382831:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382835:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b35fd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143830.382856:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26600/0x87925e4cb73b35f6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ade expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.382864:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26600/0x87925e4cb73b35f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ade expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.382870:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26600, rc 0) 00000100:00100000:0.0:1746143830.383006:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2356:x1830963624712064:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 403us (878us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143830.383011:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13822 00000100:00100000:0.0:1746143830.386753:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.388777:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.388823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.389003:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6868 00000100:00100000:1.0:1746143830.389012:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624712832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143830.411603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.415670:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.427745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.427939:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5302 00000100:00100000:0.0:1746143830.427949:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e1bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2353:x1830963624713600:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143830.428180:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e1bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2353:x1830963624713600:12345-192.168.202.3@tcp:35:cat.0 Request processed in 232us (444us total) trans 8589944827 rc 0/0 00000100:00100000:0.0:1746143830.428187:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5302 00000100:00100000:0.0:1746143830.447197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.453737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.457783:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.461285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.461320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.462558:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.462602:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624714496 00000100:00100000:1.0:1746143830.462607:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624714496 00010000:00010000:1.0:1746143830.462625:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b358d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a9f expref: 27 pid: 12328 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.462646:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7670 00000100:00100000:1.0:1746143830.462652:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2010:x1830963624714496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.462659:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.462669:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b358d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a9f expref: 27 pid: 12328 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.462677:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b358d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a9f expref: 27 pid: 12328 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.462689:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550800/0x87925e4cb73b358d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a9f expref: 27 pid: 12328 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.462713:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.462716:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.462723:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.462731:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.462760:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.462772:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627366656:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143830.462836:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.466616:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.466692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.466866:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627366656:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.466887:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.467026:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624714496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4371us (4467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.467034:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7670 00000100:00100000:1.0:1746143830.467268:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624714880 00000100:00100000:1.0:1746143830.467272:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624714880 00002000:00100000:1.0:1746143830.467300:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3944448->3948543) req@ffff880129e6c700 x1830963624714880/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.467309:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6c700 with x1830963624714880 ext(3944448->3948543) 00002000:00010000:1.0:1746143830.467313:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e6c700 00000100:00100000:1.0:1746143830.467326:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6870 00000100:00100000:1.0:1746143830.467332:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624714880:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143830.467459:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624714880:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 127us (767us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143830.467465:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6870 00002000:00100000:1.0:1746143830.467470:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3944448->3948543) req@ffff880129e6c700 x1830963624714880/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/4536 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.467477:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6c700 with x1830963624714880 ext(3944448->3948543) 00010000:00010000:1.0:1746143830.467481:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.467490:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.467500:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6c700 00000100:00100000:1.0:1746143830.474481:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624715136 00000100:00100000:1.0:1746143830.474489:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624715136 00002000:00100000:1.0:1746143830.474533:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3944448->4194303) req@ffff880092145880 x1830963624715136/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.474542:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145880 with x1830963624715136 ext(3944448->4194303) 00010000:00010000:1.0:1746143830.474549:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.474561:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 26 pid: 9586 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.474568:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092145880 00000100:00100000:1.0:1746143830.474596:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2557 00000100:00100000:1.0:1746143830.474603:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624715136:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143830.480213:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624715136:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5603us (5893us total) trans 21474841121 rc 0/0 00000100:00100000:1.0:1746143830.480224:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2557 00002000:00100000:1.0:1746143830.480237:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3944448->4194303) req@ffff880092145880 x1830963624715136/t21474841121(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.480246:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145880 with x1830963624715136 ext(3944448->4194303) 00010000:00010000:1.0:1746143830.480258:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 28 pid: 9586 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.480276:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 28 pid: 9586 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.480283:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092145880 00000100:00100000:0.0:1746143830.481520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.481585:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.481607:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624715520 00000100:00100000:0.0:1746143830.481614:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624715520 00010000:00010000:0.0:1746143830.481643:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b351d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a67 expref: 38 pid: 1947 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143830.481675:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624715392 00000100:00100000:0.0:1746143830.481677:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624715392 00010000:00010000:0.0:1746143830.481687:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b359b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ab4 expref: 10 pid: 1947 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746143830.481708:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7671 00000100:00100000:0.0:1746143830.481714:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963624715520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.481728:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.481748:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b351d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a67 expref: 38 pid: 1947 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.481757:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b351d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a67 expref: 38 pid: 1947 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.481783:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.481824:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963624715520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.481830:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7671 00000100:00100000:0.0:1746143830.481843:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7672 00000100:00100000:0.0:1746143830.481848:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624715392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.481854:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.481864:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b359b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ab4 expref: 10 pid: 1947 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.481872:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b359b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ab4 expref: 10 pid: 1947 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.481885:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b359b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ab4 expref: 10 pid: 1947 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.481903:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.481942:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624715392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.481948:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7672 00000100:00100000:0.0:1746143830.488425:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.489074:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624715648 00000100:00100000:1.0:1746143830.489084:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624715648 00010000:00010000:1.0:1746143830.489122:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b355c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a8a expref: 21 pid: 13430 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746143830.489131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.489336:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624715776 00000100:00100000:1.0:1746143830.489340:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624715776 00010000:00010000:1.0:1746143830.489354:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410afa expref: 28 pid: 9586 timeout: 989 lvb_type: 0 00000100:00100000:1.0:1746143830.489383:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7673 00000100:00100000:1.0:1746143830.489394:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963624715648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.489407:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.489428:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b355c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a8a expref: 21 pid: 13430 timeout: 989 lvb_type: 1 00010000:00010000:1.0:1746143830.489449:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b355c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a8a expref: 21 pid: 13430 timeout: 989 lvb_type: 1 00010000:00010000:1.0:1746143830.489474:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b355c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a8a expref: 21 pid: 13430 timeout: 989 lvb_type: 1 00010000:00010000:1.0:1746143830.489496:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.489498:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.489506:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b3651 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b08 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.489513:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b3651 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b08 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.489546:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b3651 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b08 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.489562:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627367296:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143830.489639:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.491597:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627367296:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.491854:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.491903:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624715648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2512us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.491928:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7673 00000100:00100000:1.0:1746143830.494114:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624716032 00000100:00100000:1.0:1746143830.494123:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624716032 00002000:00100000:1.0:1746143830.494165:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88009322ea00 x1830963624716032/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.494175:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ea00 with x1830963624716032 ext(2097152->3145727) 00002000:00010000:1.0:1746143830.494180:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ea00 00000100:00100000:1.0:1746143830.494198:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6871 00000100:00100000:1.0:1746143830.494205:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624716032:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143830.496188:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624716288 00000100:00100000:0.0:1746143830.496195:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624716288 00002000:00100000:0.0:1746143830.496231:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4661248->4665343) req@ffff880092145180 x1830963624716288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.496241:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145180 with x1830963624716288 ext(4661248->4665343) 00002000:00010000:0.0:1746143830.496245:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145180 00000100:00100000:0.0:1746143830.496275:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6872 00000100:00100000:0.0:1746143830.496282:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624716288:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143830.499076:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624716288:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 2782us (2939us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143830.499088:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6872 00002000:00100000:0.0:1746143830.499102:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4661248->4665343) req@ffff880092145180 x1830963624716288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/4536 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.499112:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145180 with x1830963624716288 ext(4661248->4665343) 00002000:00010000:0.0:1746143830.499118:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145180 00000100:00100000:1.0:1746143830.503462:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624716032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9243us (9597us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.503475:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6871 00002000:00100000:1.0:1746143830.503487:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88009322ea00 x1830963624716032/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.503498:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ea00 with x1830963624716032 ext(2097152->3145727) 00002000:00010000:1.0:1746143830.503504:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ea00 00000100:00100000:0.0:1746143830.507703:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.511733:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.517746:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.517829:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.518000:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624716928 00000100:00100000:1.0:1746143830.518011:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624716928 00002000:00100000:1.0:1746143830.518059:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4665343) req@ffff880092ef2d80 x1830963624716928/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.518069:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2d80 with x1830963624716928 ext(4194304->4665343) 00010000:00010000:1.0:1746143830.518077:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b3651 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b08 expref: 20 pid: 9586 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.518091:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b3651 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4665343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b08 expref: 20 pid: 9586 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.518097:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef2d80 00000100:00100000:1.0:1746143830.518118:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2558 00000100:00100000:1.0:1746143830.518123:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624716928:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143830.524792:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.524814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.529120:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.531531:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.531949:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.539563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.540960:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.541407:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624718080 00000100:00100000:1.0:1746143830.541416:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624718080 00002000:00100000:1.0:1746143830.541466:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092ef0380 x1830963624718080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.541477:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963624718080 ext(3145728->4194303) 00002000:00010000:1.0:1746143830.541482:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0380 00000100:00100000:1.0:1746143830.541511:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6874 00000100:00100000:1.0:1746143830.541519:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963624718080:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143830.545251:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.545336:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.546753:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624718464 00000100:00100000:0.0:1746143830.546758:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624718464 00010000:00010000:0.0:1746143830.546776:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b3348 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410964 expref: 9 pid: 1947 timeout: 989 lvb_type: 1 00000100:00100000:0.0:1746143830.546807:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7680 00000100:00100000:0.0:1746143830.546813:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624718464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.546821:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.546832:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b3348 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410964 expref: 9 pid: 1947 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.546841:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b3348 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410964 expref: 9 pid: 1947 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.546858:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b3348 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410964 expref: 9 pid: 1947 timeout: 989 lvb_type: 1 00010000:00010000:0.0:1746143830.547330:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.547732:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963624718464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 916us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.547739:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7680 00000100:00100000:1.0:1746143830.550290:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.551806:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963624718080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10283us (10844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.551818:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6874 00002000:00100000:1.0:1746143830.551831:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092ef0380 x1830963624718080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.551841:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963624718080 ext(3145728->4194303) 00002000:00010000:1.0:1746143830.551847:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0380 00000100:00100000:0.0:1746143830.557124:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.560380:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624719360 00000100:00100000:1.0:1746143830.560385:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624719360 00002000:00100000:1.0:1746143830.560408:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88009322c380 x1830963624719360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.560420:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c380 with x1830963624719360 ext(4194304->4808703) 00002000:00010000:1.0:1746143830.560423:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322c380 00000100:00100000:0.0:1746143830.560427:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624719488 00000100:00100000:0.0:1746143830.560443:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624719488 00000100:00100000:1.0:1746143830.560450:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6876 00000100:00100000:1.0:1746143830.560455:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963624719360:12345-192.168.202.3@tcp:3:multiop.0 00002000:00100000:0.0:1746143830.560461:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1396736->1400831) req@ffff88009322c700 x1830963624719488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.560470:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c700 with x1830963624719488 ext(1396736->1400831) 00002000:00010000:0.0:1746143830.560473:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322c700 00000100:00100000:0.0:1746143830.560487:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6877 00000100:00100000:0.0:1746143830.560492:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624719488:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143830.560632:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624719488:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 139us (305us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143830.560639:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6877 00002000:00100000:0.0:1746143830.560644:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1396736->1400831) req@ffff88009322c700 x1830963624719488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/4536 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.560651:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c700 with x1830963624719488 ext(1396736->1400831) 00002000:00010000:0.0:1746143830.560654:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322c700 00000100:00100000:0.0:1746143830.565004:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.565038:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.565063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.565099:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.568841:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.569206:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963624719360:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8749us (8911us total) trans 0 rc 614400/614400 00000100:00100000:1.0:1746143830.569219:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6876 00002000:00100000:1.0:1746143830.569228:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88009322c380 x1830963624719360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 614400/614400 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.569237:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c380 with x1830963624719360 ext(4194304->4808703) 00002000:00010000:1.0:1746143830.569241:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322c380 00000100:00100000:0.0:1746143830.574830:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.577638:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.577706:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624720512 00000100:00100000:1.0:1746143830.577712:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624720512 00002000:00100000:1.0:1746143830.577743:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (671744->1048575) req@ffff880092ef0a80 x1830963624720512/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.577752:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0a80 with x1830963624720512 ext(671744->1048575) 00010000:00010000:1.0:1746143830.577759:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b365f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 671744->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b16 expref: 38 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.577769:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b365f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 671744->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b16 expref: 38 pid: 9839 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.577775:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef0a80 00000100:00100000:1.0:1746143830.577797:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2559 00000100:00100000:1.0:1746143830.577802:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963624720512:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143830.582342:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963624720512:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4527us (4693us total) trans 17179873843 rc 0/0 00000100:00100000:1.0:1746143830.582354:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2559 00002000:00100000:1.0:1746143830.582366:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (671744->1048575) req@ffff880092ef0a80 x1830963624720512/t17179873843(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.582382:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0a80 with x1830963624720512 ext(671744->1048575) 00010000:00010000:1.0:1746143830.582393:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b365f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 671744->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b16 expref: 40 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.582407:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b365f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 671744->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b16 expref: 40 pid: 9839 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.582414:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef0a80 00000100:00100000:0.0:1746143830.584804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.590349:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.590500:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624720896 00000100:00100000:1.0:1746143830.590510:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624720896 00002000:00100000:1.0:1746143830.590558:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096e57b80 x1830963624720896/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.590569:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e57b80 with x1830963624720896 ext(0->1048575) 00002000:00010000:1.0:1746143830.590574:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e57b80 00000100:00100000:1.0:1746143830.590604:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6878 00000100:00100000:1.0:1746143830.590610:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624720896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.600506:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624720896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9884us (10155us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.600522:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6878 00002000:00100000:1.0:1746143830.600536:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096e57b80 x1830963624720896/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.600546:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e57b80 with x1830963624720896 ext(0->1048575) 00002000:00010000:1.0:1746143830.600553:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e57b80 00000100:00100000:0.0:1746143830.605720:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.610491:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.610716:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624721152 00000100:00100000:1.0:1746143830.610726:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624721152 00002000:00100000:1.0:1746143830.610774:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1400831) req@ffff880096e54e00 x1830963624721152/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.610784:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54e00 with x1830963624721152 ext(1048576->1400831) 00010000:00010000:1.0:1746143830.610793:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 35 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.610807:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 35 pid: 9839 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.610814:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096e54e00 00000100:00100000:1.0:1746143830.610849:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2560 00000100:00100000:1.0:1746143830.610856:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624721152:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143830.615368:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963624721152:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4497us (4872us total) trans 21474841122 rc 0/0 00000100:00100000:1.0:1746143830.615383:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2560 00002000:00100000:1.0:1746143830.615398:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1400831) req@ffff880096e54e00 x1830963624721152/t21474841122(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.615408:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54e00 with x1830963624721152 ext(1048576->1400831) 00010000:00010000:1.0:1746143830.615417:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 37 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:1.0:1746143830.615447:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 37 pid: 9839 timeout: 989 lvb_type: 0 00002000:00010000:1.0:1746143830.615454:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096e54e00 00000100:00100000:0.0:1746143830.620228:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624721280 00000100:00100000:0.0:1746143830.620239:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624721280 00010000:00010000:0.0:1746143830.620274:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 37 pid: 9839 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143830.620318:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7683 00000100:00100000:0.0:1746143830.620325:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963624721280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.620337:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.620354:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 37 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.620365:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 37 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.620388:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d000/0x87925e4cb73b3666 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1400831) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b1d expref: 37 pid: 9839 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.620410:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.620412:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.620417:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.620424:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.620462:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143830.620481:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627369472:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143830.620566:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.625341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.625493:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624721536 00000100:00100000:1.0:1746143830.625500:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624721536 00002000:00100000:1.0:1746143830.625537:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880096e54a80 x1830963624721536/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.625546:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54a80 with x1830963624721536 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.625550:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e54a80 00000100:00100000:1.0:1746143830.625578:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6879 00000100:00100000:1.0:1746143830.625584:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624721536:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.633457:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624721536:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7863us (8113us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.633472:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6879 00002000:00100000:1.0:1746143830.633482:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880096e54a80 x1830963624721536/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.633491:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54a80 with x1830963624721536 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.633495:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e54a80 00000100:00100000:0.0:1746143830.647243:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.647314:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624721792 00000100:00100000:1.0:1746143830.647322:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624721792 00002000:00100000:1.0:1746143830.647357:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880096e56680 x1830963624721792/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.647366:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56680 with x1830963624721792 ext(2097152->4194303) 00002000:00010000:1.0:1746143830.647371:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e56680 00000100:00100000:1.0:1746143830.647405:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6880 00000100:00100000:1.0:1746143830.647412:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624721792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143830.647481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.647495:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624722048 00000100:00100000:0.0:1746143830.647497:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624722048 00002000:00100000:0.0:1746143830.647511:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096e56a00 x1830963624722048/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.647516:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56a00 with x1830963624722048 ext(2097152->4194303) 00002000:00010000:0.0:1746143830.647518:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e56a00 00000100:00100000:0.0:1746143830.647526:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6881 00000100:00100000:0.0:1746143830.647529:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624722048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.664996:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624721792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17576us (17750us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143830.665008:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6880 00002000:00100000:1.0:1746143830.665019:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880096e56680 x1830963624721792/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.665027:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56680 with x1830963624721792 ext(2097152->4194303) 00002000:00010000:1.0:1746143830.665032:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e56680 00000100:00100000:0.0:1746143830.677808:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.679551:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143830.679566:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627369600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746143830.679607:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.680015:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627369600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746143830.711131:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963627369728:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711195:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.711259:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627370240:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711280:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.711294:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963627370752:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711312:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.711331:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746143830.711335:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627370112:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711351:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.711363:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963627370624:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711382:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627370240 00000100:00100000:1.0:1746143830.711385:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627370240 00000100:00100000:1.0:1746143830.711410:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627370112 00000100:00100000:1.0:1746143830.711412:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627370112 00000100:00100000:1.0:1746143830.711425:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627370880 00000100:00100000:1.0:1746143830.711427:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627370880 00000100:00100000:1.0:1746143830.711457:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1746143830.711462:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627370240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711486:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627370240:12345-0@lo:400:kworker.0 Request processed in 25us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.711491:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1746143830.711498:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627371008 00000100:00100000:1.0:1746143830.711500:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627371008 00000100:00100000:1.0:1746143830.711512:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1746143830.711515:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627370112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711533:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627370112:12345-0@lo:400:kworker.0 Request processed in 17us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.711537:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1746143830.711543:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1746143830.711547:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627370880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711563:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627370880:12345-0@lo:400:kworker.0 Request processed in 16us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.711567:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1746143830.711573:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1746143830.711576:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627371008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711592:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627371008:12345-0@lo:400:kworker.0 Request processed in 16us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.711596:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1746143830.711613:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1746143830.711618:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830963627370496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711634:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830963627370496:12345-0@lo:400:kworker.0 Request processed in 16us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.711639:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00080000:1.0:1746143830.711650:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746143830.711653:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746143830.711655:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746143830.711656:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143830.711667:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.711677:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963627371136:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711692:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.711712:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627370240:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711719:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963627370752:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711730:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627370112:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711736:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963627370624:0@lo:400:kworker.0 00000100:00100000:1.0:1746143830.711770:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963627371136:0@lo:400:kworker.0 00000100:00100000:0.0:1746143830.711840:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627369728 00000100:00100000:0.0:1746143830.711844:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627369728 00000100:00100000:0.0:1746143830.711874:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1746143830.711879:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3772:x1830963627369728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143830.711906:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3772:x1830963627369728:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.711924:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1746143830.711983:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b99f1f93-ef24-4932-a1b4-452b64359da1:3772:1830963627369728:0@lo:400:kworker.0 00000100:00100000:0.0:1746143830.742045:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.746148:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.746181:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.746207:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.746241:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624722944 00000100:00100000:0.0:1746143830.746244:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624722944 00010000:00010000:0.0:1746143830.746260:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac9 expref: 11 pid: 7243 timeout: 989 lvb_type: 0 00000100:00100000:0.0:1746143830.746591:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7684 00000100:00100000:0.0:1746143830.746598:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624722944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.746607:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.746613:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac9 expref: 11 pid: 7243 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.746714:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac9 expref: 11 pid: 7243 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.746797:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b35c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ac9 expref: 11 pid: 7243 timeout: 989 lvb_type: 0 00010000:00010000:0.0:1746143830.746813:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143830.746818:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b36b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143830.746829:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b36b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143830.746839:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.746870:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624722944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 273us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.746948:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7684 00000100:00100000:0.0:1746143830.798812:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.798862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.798978:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624723072 00000100:00100000:1.0:1746143830.798986:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624723072 00000100:00100000:1.0:1746143830.799033:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15953 00000100:00100000:1.0:1746143830.799040:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963624723072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.799055:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.799068:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b5c expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.799088:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.799089:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.799097:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b5c expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.799109:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b5c expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.799117:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a000, rc 0) 00000100:00100000:1.0:1746143830.800709:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624723072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1664us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.801060:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15953 00000100:00100000:0.0:1746143830.803713:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.803781:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624723584 00000100:00100000:1.0:1746143830.803786:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624723584 00000100:00100000:1.0:1746143830.804365:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15955 00000100:00100000:1.0:1746143830.804372:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2378:x1830963624723584:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143830.804385:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.804398:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b36e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b71 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.804417:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b364a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b01 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.804425:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73b3697 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b40 expref: 27 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.804429:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.804443:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.804445:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b36e4 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2879488->2887679] (req 2879488->2887679) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b71 expref: 38 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.804472:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73b3697 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b40 expref: 27 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.804482:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550a00/0x87925e4cb73b3697 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b40 expref: 27 pid: 1947 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.804492:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627371648:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.804577:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b364a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b01 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.804726:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b364a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b01 expref: 38 pid: 9586 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.804737:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627371776:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.804756:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.808253:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627371648:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.808265:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627371776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.808286:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b36e4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2879488->2887679] (req 2879488->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b71 expref: 38 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.808300:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ae00, rc 0) 00000100:00100000:1.0:1746143830.808345:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2378:x1830963624723584:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3973us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.808360:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15955 00000100:00100000:0.0:1746143830.811290:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.815569:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.815604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.815640:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.821005:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624724608 00000100:00100000:1.0:1746143830.821013:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624724608 00002000:00100000:1.0:1746143830.821048:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2879488->2883583) req@ffff88012b1db480 x1830963624724608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.821056:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db480 with x1830963624724608 ext(2879488->2883583) 00002000:00010000:1.0:1746143830.821061:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db480 00000100:00100000:1.0:1746143830.821079:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6885 00000100:00100000:1.0:1746143830.821085:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963624724608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.821187:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963624724608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 102us (906us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143830.821193:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6885 00002000:00100000:1.0:1746143830.821198:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2879488->2883583) req@ffff88012b1db480 x1830963624724608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/4536 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.821204:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db480 with x1830963624724608 ext(2879488->2883583) 00002000:00010000:1.0:1746143830.821207:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1db480 00000100:00100000:1.0:1746143830.825500:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624724736 00000100:00100000:1.0:1746143830.825508:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624724736 00000100:00100000:1.0:1746143830.825560:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15956 00000100:00100000:1.0:1746143830.825567:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e0d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2382:x1830963624724736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.825584:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.825602:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b36eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b78 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.825630:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b36e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->2887679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b71 expref: 38 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.825636:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.825638:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.825641:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b36eb lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b78 expref: 28 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.825672:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b36e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->2887679) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b71 expref: 38 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.825682:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b36e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2879488->2887679) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b71 expref: 38 pid: 3134 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.825692:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372032:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.825929:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.827376:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.827451:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372032:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.827469:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b36eb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b78 expref: 28 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.827481:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8aa00, rc 0) 00000100:00100000:1.0:1746143830.827615:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2382:x1830963624724736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2047us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.827621:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15956 00000100:00100000:0.0:1746143830.830580:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.835294:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.835416:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.835487:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624725504 00000100:00100000:1.0:1746143830.835491:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624725504 00000100:00100000:1.0:1746143830.835527:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15957 00000100:00100000:1.0:1746143830.835533:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2374:x1830963624725504:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143830.835545:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.835556:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b7f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.835575:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.835583:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.835589:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 29 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.835596:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.835597:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.835600:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.835623:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 29 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.835633:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 29 pid: 13430 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.835644:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372160:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.835710:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.835717:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 7 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.835724:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372416:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.835862:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.835870:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b3508 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a52 expref: 38 pid: 1947 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.835878:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372544:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.835935:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.836969:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372160:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143830.838507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.838524:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624725632 00000100:00100000:0.0:1746143830.838529:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624725632 00010000:00010000:0.0:1746143830.838549:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 8 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143830.838568:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7690 00000100:00100000:0.0:1746143830.838574:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624725632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.838582:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.838597:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 8 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143830.838605:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 8 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143830.838622:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.838655:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624725632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.838661:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7690 00000100:00100000:0.0:1746143830.838689:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.838700:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624725760 00000100:00100000:0.0:1746143830.838703:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624725760 00010000:00010000:0.0:1746143830.838712:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 30 pid: 13430 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143830.838726:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7691 00000100:00100000:0.0:1746143830.838730:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624725760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.838736:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143830.838742:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 30 pid: 13430 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143830.838750:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 30 pid: 13430 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143830.838760:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b354e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a7c expref: 30 pid: 13430 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143830.838777:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143830.838791:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624725760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143830.838796:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7691 00010000:00010000:1.0:1746143830.838934:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b3586 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aa6 expref: 7 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.838950:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372416:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.838959:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372544:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.838976:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 28 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.838988:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8bc00, rc 0) 00000100:00100000:1.0:1746143830.839005:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2374:x1830963624725504:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3473us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.839011:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15957 00000100:00100000:0.0:1746143830.840044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.840084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.840288:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624726016 00000100:00100000:1.0:1746143830.840291:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624726016 00000100:00100000:1.0:1746143830.840859:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15958 00000100:00100000:1.0:1746143830.840866:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2379:x1830963624726016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143830.840876:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.840884:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7f200/0x87925e4cb73b36f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b86 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.840897:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.840902:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.840904:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143830.840906:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7f200/0x87925e4cb73b36f9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b86 expref: 39 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.840948:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.840957:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 27 pid: 3134 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.840969:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372800:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.841200:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.842236:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624726272 00000100:00100000:0.0:1746143830.842241:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624726272 00002000:00100000:0.0:1746143830.842268:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1da680 x1830963624726272/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.842276:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963624726272 ext(2097152->4194303) 00002000:00010000:0.0:1746143830.842280:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1da680 00000100:00100000:0.0:1746143830.842361:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6886 00000100:00100000:0.0:1746143830.842368:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624726272:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143830.845012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.847581:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627372800:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.847606:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7f200/0x87925e4cb73b36f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b86 expref: 38 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.847622:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f200, rc 0) 00000100:00100000:1.0:1746143830.847668:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2379:x1830963624726016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6801us (7582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.847675:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15958 00000100:00100000:0.0:1746143830.858477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.858977:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624726784 00000100:00100000:1.0:1746143830.858985:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624726784 00000100:00100000:1.0:1746143830.859031:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15959 00000100:00100000:1.0:1746143830.859038:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2374:x1830963624726784:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143830.859054:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143830.859066:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b8d expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.859089:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.859096:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.859106:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b3555 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a83 expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.859111:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.859117:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.859120:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.859210:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b3555 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a83 expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.859220:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b3555 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a83 expref: 23 pid: 13430 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.859230:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627372928:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.859467:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 7 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143830.859475:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 7 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.859482:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627373056:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.859532:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.859542:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 39 pid: 1947 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.859551:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627373184:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.859568:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.859815:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.859850:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.865372:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.865439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.865458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.865618:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7693 00000100:00100000:1.0:1746143830.865625:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624727168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.865636:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.865651:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 8 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143830.865660:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 8 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143830.865687:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7695 00000100:00100000:0.0:1746143830.865694:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963624727424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143830.865700:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.865870:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143830.865885:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 40 pid: 1947 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143830.865891:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 40 pid: 1947 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.865907:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624727168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 283us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.865934:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7693 00000100:00100000:1.0:1746143830.865973:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627372928:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143830.865982:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3594 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410aad expref: 7 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.865995:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627373056:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143830.866004:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627373184:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143830.866211:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76000/0x87925e4cb73b350f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410a59 expref: 40 pid: 1947 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143830.866223:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.866225:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143830.866230:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.866238:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143830.866262:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143830.866273:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627373440:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143830.866306:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00010000:00010000:1.0:1746143830.866351:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.866358:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f800, rc 0) 00000100:00100000:1.0:1746143830.866373:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2374:x1830963624726784:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7337us (7905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.866378:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15959 00000100:00100000:0.0:1746143830.867947:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624726912:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7895us (8127us total) trans 21474841124 rc 0/0 00000100:00100000:0.0:1746143830.867954:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2564 00002000:00100000:0.0:1746143830.867962:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1523712->2097151) req@ffff880092b49500 x1830963624726912/t21474841124(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.867977:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49500 with x1830963624726912 ext(1523712->2097151) 00010000:00010000:0.0:1746143830.867983:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 30 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143830.867995:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b36f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b7f expref: 30 pid: 3134 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746143830.868000:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b49500 00000100:00100000:1.0:1746143830.869906:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.870106:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624727552 00000100:00100000:0.0:1746143830.870112:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624727552 00000100:00100000:0.0:1746143830.870135:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15961 00000100:00100000:0.0:1746143830.870141:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624727552:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143830.870154:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143830.870168:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0600/0x87925e4cb73b370e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410b9b expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143830.870204:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627373568:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143830.870247:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143830.870560:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624727808 00000100:00100000:0.0:1746143830.870563:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624727808 00002000:00100000:0.0:1746143830.870583:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1277952->1282047) req@ffff880095cb4700 x1830963624727808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.870591:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4700 with x1830963624727808 ext(1277952->1282047) 00002000:00010000:0.0:1746143830.870595:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4700 00000100:00100000:0.0:1746143830.871069:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6887 00000100:00100000:0.0:1746143830.871076:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624727808:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143830.871664:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624727808:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 589us (1313us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143830.871670:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6887 00002000:00100000:0.0:1746143830.871675:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1277952->1282047) req@ffff880095cb4700 x1830963624727808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/4536 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143830.871683:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4700 with x1830963624727808 ext(1277952->1282047) 00002000:00010000:0.0:1746143830.871686:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4700 00000100:00100000:1.0:1746143830.875519:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.876400:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.876513:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624728448 00000100:00100000:1.0:1746143830.876517:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624728448 00002000:00100000:1.0:1746143830.876543:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009391f800 x1830963624728448/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.876551:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963624728448 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.876555:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:1.0:1746143830.876580:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6888 00000100:00100000:1.0:1746143830.876585:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963624728448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.883302:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963624728448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6707us (6893us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.883313:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6888 00002000:00100000:1.0:1746143830.883322:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009391f800 x1830963624728448/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.883331:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963624728448 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.883336:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:0.0:1746143830.886406:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.887320:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746143830.887331:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627374080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143830.887366:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143830.887422:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627374080 00000100:00100000:1.0:1746143830.887426:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627374080 00000100:00100000:1.0:1746143830.887458:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1746143830.887463:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627374080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746143830.887482:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445232640 avail 1315770368 00000100:00100000:1.0:1746143830.887517:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627374080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.887523:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1746143830.887627:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627374080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143830.890492:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.890584:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624728704 00000100:00100000:1.0:1746143830.890590:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624728704 00002000:00100000:1.0:1746143830.890618:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1282047) req@ffff88009391d180 x1830963624728704/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.890626:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d180 with x1830963624728704 ext(1048576->1282047) 00010000:00010000:1.0:1746143830.890632:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 22 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.890642:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 22 pid: 3134 timeout: 990 lvb_type: 0 00002000:00010000:1.0:1746143830.890648:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391d180 00000100:00100000:1.0:1746143830.890747:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2565 00000100:00100000:1.0:1746143830.890753:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624728704:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143830.893501:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963624728704:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2742us (3004us total) trans 17179873844 rc 0/0 00000100:00100000:1.0:1746143830.893511:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2565 00002000:00100000:1.0:1746143830.893520:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1282047) req@ffff88009391d180 x1830963624728704/t17179873844(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:226/0 lens 488/448 e 0 to 0 dl 1746143841 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.893527:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d180 with x1830963624728704 ext(1048576->1282047) 00010000:00010000:1.0:1746143830.893535:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 24 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.893547:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129e7f800/0x87925e4cb73b3700 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b8d expref: 24 pid: 3134 timeout: 990 lvb_type: 0 00002000:00010000:1.0:1746143830.893554:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391d180 00000100:00100000:0.0:1746143830.895290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.898739:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.898826:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624729088 00000100:00100000:1.0:1746143830.898833:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624729088 00002000:00100000:1.0:1746143830.898865:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d843100 x1830963624729088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.898874:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843100 with x1830963624729088 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.898878:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843100 00000100:00100000:1.0:1746143830.898894:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6889 00000100:00100000:1.0:1746143830.898901:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624729088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.904896:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624729088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5988us (6153us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.904906:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6889 00002000:00100000:1.0:1746143830.904940:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d843100 x1830963624729088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.904948:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843100 with x1830963624729088 ext(1048576->2097151) 00002000:00010000:1.0:1746143830.904953:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843100 00000100:00100000:0.0:1746143830.914129:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.914196:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624729344 00000100:00100000:1.0:1746143830.914204:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624729344 00002000:00100000:1.0:1746143830.914241:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012d840380 x1830963624729344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.914250:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840380 with x1830963624729344 ext(2097152->3145727) 00002000:00010000:1.0:1746143830.914255:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840380 00000100:00100000:1.0:1746143830.914285:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6890 00000100:00100000:1.0:1746143830.914292:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624729344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143830.922756:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624729344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8457us (8626us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143830.922766:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6890 00002000:00100000:1.0:1746143830.922776:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012d840380 x1830963624729344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/440 e 0 to 0 dl 1746143841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.922785:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840380 with x1830963624729344 ext(2097152->3145727) 00002000:00010000:1.0:1746143830.922790:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840380 00000100:00100000:0.0:1746143830.926181:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.937083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.937360:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624729728 00000100:00100000:1.0:1746143830.937367:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624729728 00002000:00100000:1.0:1746143830.937404:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012d841180 x1830963624729728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:226/0 lens 488/0 e 0 to 0 dl 1746143841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143830.937413:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841180 with x1830963624729728 ext(2097152->4194303) 00002000:00010000:1.0:1746143830.937417:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d841180 00000100:00100000:1.0:1746143830.937448:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6891 00000100:00100000:1.0:1746143830.937454:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963624729728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143830.953113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.958651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.960464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.960501:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624730112 00000100:00100000:1.0:1746143830.960505:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624730112 00010000:00010000:1.0:1746143830.960528:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b3690 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b39 expref: 23 pid: 1947 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143830.960546:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7698 00000100:00100000:1.0:1746143830.960550:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963624730112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.960559:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.960576:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b3690 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b39 expref: 23 pid: 1947 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143830.960584:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b3690 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b39 expref: 23 pid: 1947 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143830.960598:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b3690 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b39 expref: 23 pid: 1947 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143830.960612:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.960642:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624730112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.960647:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7698 00000100:00100000:0.0:1746143830.962243:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.962304:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624730240 00000100:00100000:1.0:1746143830.962309:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624730240 00010000:00010000:1.0:1746143830.962336:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73b3658 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b0f expref: 41 pid: 9586 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.962354:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7699 00000100:00100000:1.0:1746143830.962360:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963624730240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.962371:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.962383:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73b3658 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b0f expref: 41 pid: 9586 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.962392:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73b3658 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b0f expref: 41 pid: 9586 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.962405:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73b3658 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b0f expref: 41 pid: 9586 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.962417:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.962418:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143830.962424:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b372a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb7 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.962442:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b372a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb7 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143830.962469:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b372a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb7 expref: 40 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143830.962479:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627374720:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143830.962535:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.962705:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143830.964620:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627374720:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143830.964635:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.964665:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963624730240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2304us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.964672:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7699 00000100:00100000:0.0:1746143830.967304:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.967441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.972083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143830.972133:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624731136 00000100:00100000:1.0:1746143830.972139:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624731136 00000100:00100000:0.0:1746143830.972146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143830.972163:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3723 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb0 expref: 40 pid: 3134 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143830.972290:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7700 00000100:00100000:1.0:1746143830.972392:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624731136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143830.972403:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143830.972418:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3723 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb0 expref: 40 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.972427:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3723 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb0 expref: 40 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.972456:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3723 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bb0 expref: 40 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143830.972480:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143830.972509:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963624731136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143830.972514:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7700 00000100:00100000:1.0:1746143830.972576:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.975561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.976880:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143830.979980:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.007891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143831.008230:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143831.010153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143831.010555:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143831.010609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:1.0:1746143831.010709:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143831.013013:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.013798:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.016696:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.017472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.017484:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624733312 00000100:00100000:1.0:1746143831.017486:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624733312 00000100:00100000:1.0:1746143831.017500:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15971 00000100:00100000:1.0:1746143831.017505:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624733184:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143831.017512:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.017519:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73b3777 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410be8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.017528:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.017530:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.017534:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73b3777 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be8 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.017543:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73b3777 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be8 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.017549:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513000, rc 0) 00000100:00100000:1.0:1746143831.017672:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624733184:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 167us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.017678:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15971 00000100:00100000:1.0:1746143831.017689:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15974 00000100:00100000:1.0:1746143831.017693:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624733312:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143831.017698:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.017704:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b3785 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410bef expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.017712:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.017714:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.017718:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b3785 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bef expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.017726:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b3785 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bef expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.017732:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513200, rc 0) 00000100:00100000:0.0:1746143831.017733:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15975 00000100:00100000:0.0:1746143831.017738:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624733568:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143831.017743:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.017749:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b378c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410bfd expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.017758:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.017759:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.017762:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b378c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bfd expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.017770:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b378c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bfd expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.017776:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6e00, rc 0) 00000100:00100000:0.0:1746143831.017792:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624733568:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.017797:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15975 00000100:00100000:1.0:1746143831.017973:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624733312:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 274us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.017978:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15974 00000100:00100000:0.0:1746143831.020446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.022266:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.024971:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.026902:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.028706:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.028740:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.028761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.029040:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624735104 00000100:00100000:1.0:1746143831.029043:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624735104 00000100:00100000:0.0:1746143831.029046:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.029060:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.029072:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624734976 00000100:00100000:1.0:1746143831.029074:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624734976 00000100:00100000:0.0:1746143831.029088:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.029094:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624735232 00000100:00100000:1.0:1746143831.029096:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624735232 00000100:00100000:0.0:1746143831.029105:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15978 00000100:00100000:1.0:1746143831.029109:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15979 00000100:00100000:0.0:1746143831.029110:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624735104:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143831.029112:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624734720:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143831.029125:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d428600/0x87925e4cb73b37d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.029125:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.029135:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.029135:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.029142:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73b3777 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be8 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.029142:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b378c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bfd expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.029148:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466600/0x87925e4cb73b36c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b63 expref: 38 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.029148:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.029149:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.029151:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.029154:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.029155:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.029157:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d428600/0x87925e4cb73b37d9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.029172:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b378c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bfd expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.029173:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466600/0x87925e4cb73b36c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b63 expref: 38 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.029182:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466600/0x87925e4cb73b36c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b63 expref: 38 pid: 9587 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143831.029182:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b378c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bfd expref: 12 pid: 9839 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.029192:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627376512:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143831.029193:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627376128:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143831.029233:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15980 00000100:00100000:0.0:1746143831.029238:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624734976:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143831.029251:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.029252:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73b3777 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be8 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.029260:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e513000/0x87925e4cb73b3777 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be8 expref: 11 pid: 3135 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143831.029260:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b371c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba9 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.029266:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3770 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bf6 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143831.029267:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627376640:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143831.029271:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.029272:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.029275:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.029286:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3770 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bf6 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.029288:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.029295:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 28 pid: 13430 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.029297:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3770 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bf6 expref: 12 pid: 1947 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143831.029305:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627376896:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.029306:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627377152:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143831.029327:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b371c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba9 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.029332:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00010000:00010000:0.0:1746143831.029334:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b371c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba9 expref: 41 pid: 3134 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143831.029341:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627377408:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143831.029361:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801226666c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143831.029364:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.029372:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 41 pid: 9587 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143831.029378:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627377536:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.029392:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.031369:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627376128:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143831.034008:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.034023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.034035:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.034060:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.034081:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624736000 00000100:00100000:0.0:1746143831.034087:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624736000 00000100:00080000:0.0:1746143831.034109:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:0.0:1746143831.034139:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2195455) req@ffff880091bdf800 x1830963624736000/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.034147:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf800 with x1830963624736000 ext(2097152->2195455) 00010000:00010000:0.0:1746143831.034154:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b373f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bcc expref: 39 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.034168:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b373f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bcc expref: 39 pid: 9587 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746143831.034175:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bdf800 00000100:00100000:0.0:1746143831.034191:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2568 00000100:00100000:0.0:1746143831.034198:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963624736000:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143831.034393:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7708 00000100:00100000:1.0:1746143831.034401:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963624735744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.034408:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.034417:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73b3769 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be1 expref: 14 pid: 9587 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.034426:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73b3769 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be1 expref: 14 pid: 9587 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.034446:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550800/0x87925e4cb73b3769 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410be1 expref: 14 pid: 9587 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.034459:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.034590:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963624735744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 190us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.034595:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7708 00010000:00010000:1.0:1746143831.034625:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3770 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bf6 expref: 11 pid: 1947 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.034633:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627376896:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.034641:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627377408:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.034653:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.034670:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627377536:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.034680:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.037535:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7710 00000100:00100000:1.0:1746143831.037541:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624736768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.037549:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.037559:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 29 pid: 13430 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.037566:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 29 pid: 13430 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.037577:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466200/0x87925e4cb73b36a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b4e expref: 29 pid: 13430 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.037586:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.037598:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624736768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.037602:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7710 00000100:00100000:1.0:1746143831.038546:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7714 00000100:00100000:1.0:1746143831.038553:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624735488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.038560:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.038567:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b3715 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba2 expref: 28 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.038575:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b3715 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba2 expref: 28 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.038584:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b3715 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba2 expref: 28 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.038591:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.038606:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624735488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.038611:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7714 00000100:00100000:0.0:1746143831.038703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.038716:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624736384 00000100:00100000:0.0:1746143831.038719:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624736384 00010000:00010000:0.0:1746143831.038736:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 42 pid: 9587 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143831.038750:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7715 00000100:00100000:0.0:1746143831.038754:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963624736384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143831.038760:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143831.038768:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 42 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.038774:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 42 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.038783:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467c00/0x87925e4cb73b3738 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4804608->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bc5 expref: 42 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.038794:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.038796:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.038799:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.038805:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.038806:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624736000:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4609us (4745us total) trans 21474841125 rc 0/0 00000100:00100000:1.0:1746143831.038812:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2568 00002000:00100000:1.0:1746143831.038818:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2195455) req@ffff880091bdf800 x1830963624736000/t21474841125(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:227/0 lens 488/448 e 0 to 0 dl 1746143842 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746143831.038824:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746143831.038827:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf800 with x1830963624736000 ext(2097152->2195455) 00010000:00010000:1.0:1746143831.038833:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b373f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bcc expref: 40 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.038840:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b373f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2195455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410bcc expref: 40 pid: 9587 timeout: 990 lvb_type: 0 00000100:00100000:0.0:1746143831.038840:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963624736384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.038845:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7715 00002000:00010000:1.0:1746143831.038846:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bdf800 00000100:00080000:0.0:1746143831.038859:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746143831.038860:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.038867:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.038878:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.038885:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.038886:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143831.038891:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.038896:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b7200 already unused, calling callback (ffffffffa0864d70) 00000100:00100000:0.0:1746143831.038896:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624736256 00010000:00010000:1.0:1746143831.038899:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.038899:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624736256 00010000:00010000:0.0:1746143831.038908:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b5c expref: 41 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.038909:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.038936:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.038938:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7716 00010000:00010000:1.0:1746143831.038941:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b37d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.038943:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963624736256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143831.038948:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143831.038956:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b5c expref: 41 pid: 3134 timeout: 990 lvb_type: 1 00010000:00010000:0.0:1746143831.038963:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b5c expref: 41 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.038972:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624735104:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 9861us (10209us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143831.038973:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a000/0x87925e4cb73b36c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410b5c expref: 41 pid: 3134 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.038979:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15978 00010000:00010000:0.0:1746143831.039175:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.039176:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.039179:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73b37c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.039184:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466e00/0x87925e4cb73b37c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.039252:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7717 00000100:00100000:1.0:1746143831.039258:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963624736640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.039265:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.039273:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b371c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba9 expref: 41 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.039281:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b371c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba9 expref: 41 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.039291:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b371c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ba9 expref: 41 pid: 3134 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.039299:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.039301:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.039303:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039309:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039322:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.039336:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624736640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.039341:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7717 00010000:00010000:1.0:1746143831.039356:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039363:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039372:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039377:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039383:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039388:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b6200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143831.039390:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.039393:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143831.039396:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.039403:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.039406:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963624736256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 464us (520us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143831.039408:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b37e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.039411:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7716 00000100:00100000:1.0:1746143831.039449:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624734976:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 10210us (10387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.039454:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15980 00000100:00100000:0.0:1746143831.041712:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143831.042388:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042396:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042410:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042415:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042421:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042444:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3ac00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143831.042448:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042454:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042463:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.042469:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b37e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.042505:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963624735232:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 13261us (13416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.042890:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15981 00000100:00100000:0.0:1746143831.043728:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.046261:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.046716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.046998:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.048257:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.048285:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.048307:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.049761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.049820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143831.051791:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944840 is committed 00000004:00080000:0.0:1746143831.051798:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2390 committed 00000004:00080000:0.0:1746143831.051813:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2391 committed 00000004:00080000:0.0:1746143831.051825:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2390 committed 00000004:00080000:0.0:1746143831.051826:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2389 committed 00000004:00080000:0.0:1746143831.051828:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2388 committed 00000004:00080000:0.0:1746143831.051829:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2389 committed 00000004:00080000:0.0:1746143831.051830:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2387 committed 00000004:00080000:0.0:1746143831.051831:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2388 committed 00000004:00080000:0.0:1746143831.051832:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2386 committed 00000004:00080000:0.0:1746143831.051834:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2387 committed 00000004:00080000:0.0:1746143831.051835:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2386 committed 00000004:00080000:0.0:1746143831.051836:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2385 committed 00000004:00080000:0.0:1746143831.051837:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2385 committed 00000004:00080000:0.0:1746143831.051839:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2384 committed 00000004:00080000:0.0:1746143831.051840:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2384 committed 00000004:00080000:0.0:1746143831.051841:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2383 committed 00000004:00080000:0.0:1746143831.051842:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2383 committed 00000001:00080000:0.0:1746143831.051856:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944839 is committed 00000001:00080000:0.0:1746143831.051861:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944838 is committed 00000100:00100000:0.0:1746143831.052617:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15986 00000100:00100000:0.0:1746143831.052624:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3774:x1830963627378944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143831.052684:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3774:x1830963627378944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (380us total) trans 21474841128 rc 0/0 00000100:00100000:0.0:1746143831.052689:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15986 00000100:00100000:0.0:1746143831.052699:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15989 00000100:00100000:0.0:1746143831.052703:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627379712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143831.052745:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627379712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (377us total) trans 21474841131 rc 0/0 00000100:00100000:0.0:1746143831.052749:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15989 00000100:00100000:0.0:1746143831.052758:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15992 00000100:00100000:0.0:1746143831.052761:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3771:x1830963627379456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143831.052796:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143831.052798:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143831.052800:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143831.052802:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143831.052803:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143831.052817:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627379456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (398us total) trans 21474841133 rc 0/0 00000100:00100000:0.0:1746143831.052821:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15992 00000100:00100000:1.0:1746143831.052907:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627379328 00000100:00100000:1.0:1746143831.052936:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627379328 00000100:00100000:1.0:1746143831.052955:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627379968 00000100:00100000:1.0:1746143831.052957:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627379968 00000100:00100000:1.0:1746143831.052965:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627380480 00000100:00100000:1.0:1746143831.052966:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627380480 00000100:00100000:1.0:1746143831.052974:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15995 00000100:00100000:1.0:1746143831.052978:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3774:x1830963627379328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.053019:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15997 00000100:00100000:0.0:1746143831.053024:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963627380480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.053038:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963627379328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (164us total) trans 17179873851 rc 0/0 00000100:00100000:1.0:1746143831.053043:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15995 00002000:00010000:0.0:1746143831.053067:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143831.053069:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143831.053071:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143831.053072:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143831.053074:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:1.0:1746143831.053078:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143831.053084:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627380736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.053095:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963627380480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (149us total) trans 17179873853 rc 0/0 00000100:00100000:0.0:1746143831.053100:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15997 00000100:00100000:1.0:1746143831.053102:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143831.053110:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627380736 00000100:00100000:0.0:1746143831.053113:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627380736 00000100:00100000:0.0:1746143831.053129:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15998 00000100:00100000:0.0:1746143831.053132:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3772:x1830963627380736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.053186:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3772:x1830963627380736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (83us total) trans 17179873854 rc 0/0 00000100:00100000:0.0:1746143831.053193:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15998 00000004:00080000:1.0:1746143831.053290:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334e00/2, rc 0, transno 17179873854 00000100:00100000:1.0:1746143831.053294:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627380736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143831.053930:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35aa00/2, rc 0, transno 21474841127 00000100:00100000:0.0:1746143831.053934:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627379584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143831.055984:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.060346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.062551:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.064007:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.095722:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.095813:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624739712 00000100:00100000:1.0:1746143831.095822:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624739712 00000100:00100000:1.0:1746143831.095934:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13834 00000100:00100000:1.0:1746143831.095944:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2394:x1830963624739712:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143831.095965:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.095980:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b37fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c27 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.096040:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096049:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096057:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096068:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096072:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096076:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096149:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b3811 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096155:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b3811 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096160:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b3811 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143831.096167:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143831.096229:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096234:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096239:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096244:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096249:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.096252:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096258:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096266:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143831.096269:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.096272:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096276:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30600/0x87925e4cb73b3803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096289:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096296:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096300:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096303:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.096305:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096308:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096313:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937aca00) 00010000:00010000:1.0:1746143831.096314:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.096316:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096319:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b380a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.096350:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b37fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c27 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.096359:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b3811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c27 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.096363:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.096365:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143831.096366:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:1.0:1746143831.096403:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2394:x1830963624739712:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 461us (687us total) trans 8589944843 rc 0/0 00000100:00100000:1.0:1746143831.096408:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13834 00000100:00100000:0.0:1746143831.104595:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.106687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.106992:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740224 00000100:00100000:1.0:1746143831.106999:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740224 00000100:00100000:1.0:1746143831.107042:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13836 00000100:00100000:1.0:1746143831.107049:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+260:2399:x1830963624740224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143831.107064:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.107074:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b3834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c35 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.107130:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107139:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107149:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107159:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107165:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107169:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107241:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b3849 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107248:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b3849 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107253:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b3849 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143831.107259:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143831.107306:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107312:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107316:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107320:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107325:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.107328:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107333:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107341:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143831.107344:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.107347:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107351:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b383b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107364:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107372:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107376:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107379:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.107381:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107385:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107390:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac900) 00010000:00010000:1.0:1746143831.107392:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.107393:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107397:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b3842 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.107427:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b3834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c35 expref: 263 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.107446:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b3849 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c35 expref: 262 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.107451:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.107453:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143831.107455:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:1.0:1746143831.107486:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:2399:x1830963624740224:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 437us (801us total) trans 8589944845 rc 0/0 00000100:00100000:1.0:1746143831.107492:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13836 00000100:00100000:0.0:1746143831.107971:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.107994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.108019:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.108043:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.108058:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740352 00000100:00100000:0.0:1746143831.108063:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740352 00000100:00100000:0.0:1746143831.108083:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740608 00000100:00100000:0.0:1746143831.108085:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740608 00000100:00100000:0.0:1746143831.108093:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740864 00000100:00100000:0.0:1746143831.108095:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740864 00000100:00100000:0.0:1746143831.108102:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740480 00000100:00100000:0.0:1746143831.108104:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740480 00000100:00100000:0.0:1746143831.108114:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15999 00000100:00100000:0.0:1746143831.108119:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624740352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.108129:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.108144:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b3857 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c3c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143831.108164:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a56, atime: 0x68140a55, ctime: 0x68140a56, blocks: 0x748 00010000:00010000:0.0:1746143831.108176:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108177:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108184:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b3857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c3c expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108194:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b3857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c3c expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108200:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7c00, rc 0) 00000100:00100000:0.0:1746143831.108222:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624740352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.108226:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15999 00000100:00100000:0.0:1746143831.108236:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16001 00000100:00100000:0.0:1746143831.108240:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624740864:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.108245:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.108251:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7600/0x87925e4cb73b3865 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c58 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143831.108259:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4804992, mtime: 0x68140a57, atime: 0x68140a56, ctime: 0x68140a57, blocks: 0x14b8 00010000:00010000:0.0:1746143831.108265:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108267:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108270:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7600/0x87925e4cb73b3865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c58 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108277:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7600/0x87925e4cb73b3865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c58 expref: 23 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108283:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7600, rc 0) 00000100:00100000:0.0:1746143831.108295:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624740864:12345-192.168.202.3@tcp:101:cat.0 Request processed in 55us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.108300:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16001 00000100:00100000:0.0:1746143831.108321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.108330:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740736 00000100:00100000:0.0:1746143831.108333:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740736 00000100:00100000:0.0:1746143831.108345:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16003 00000100:00100000:0.0:1746143831.108349:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624740736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.108354:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.108361:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c51 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143831.108369:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a57, atime: 0x68140a56, ctime: 0x68140a57, blocks: 0x808 00010000:00010000:0.0:1746143831.108375:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108376:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108380:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108387:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108393:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6e00, rc 0) 00000100:00100000:0.0:1746143831.108405:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624740736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 56us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.108413:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16003 00000100:00100000:0.0:1746143831.108420:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624740992 00000100:00100000:0.0:1746143831.108422:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624740992 00000100:00100000:0.0:1746143831.108464:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16004 00000100:00100000:0.0:1746143831.108469:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624740992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.108475:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.108482:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73b387a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c5f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143831.108504:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a57, atime: 0x68140a57, ctime: 0x68140a57, blocks: 0x1008 00010000:00010000:0.0:1746143831.108511:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108512:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.108516:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73b387a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c5f expref: 30 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108524:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7e00/0x87925e4cb73b387a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c5f expref: 30 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.108529:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7e00, rc 0) 00000100:00100000:0.0:1746143831.108546:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624740992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.108550:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16004 00000100:00100000:0.0:1746143831.117450:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.118158:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.118183:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.118196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.118229:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.118298:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624741760 00000100:00100000:1.0:1746143831.118301:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624741760 00002000:00100000:1.0:1746143831.118316:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88012457d880 x1830963624741760/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.118325:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d880 with x1830963624741760 ext(1048576->2097151) 00002000:00010000:1.0:1746143831.118328:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457d880 00000100:00100000:1.0:1746143831.118343:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624742144 00000100:00100000:1.0:1746143831.118345:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624742144 00002000:00100000:1.0:1746143831.118352:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012457f100 x1830963624742144/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.118358:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f100 with x1830963624742144 ext(1048576->2097151) 00002000:00010000:1.0:1746143831.118361:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457f100 00000100:00100000:1.0:1746143831.118366:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624742272 00000100:00100000:1.0:1746143831.118368:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624742272 00002000:00100000:1.0:1746143831.118374:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88012457f480 x1830963624742272/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.118379:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f480 with x1830963624742272 ext(1048576->2097151) 00002000:00010000:1.0:1746143831.118382:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f480 00000100:00100000:1.0:1746143831.118389:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6894 00000100:00100000:1.0:1746143831.118393:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2011:x1830963624741760:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143831.118569:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6896 00000100:00100000:0.0:1746143831.118576:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2011:x1830963624742272:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143831.124175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.124228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.131459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.132068:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.132097:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.132211:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.132228:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624742656 00000100:00100000:0.0:1746143831.132235:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624742656 00000100:00100000:0.0:1746143831.132404:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624743040 00000100:00100000:0.0:1746143831.132407:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624743040 00000100:00100000:0.0:1746143831.132422:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16007 00000100:00100000:0.0:1746143831.132436:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963624742784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.132450:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.132464:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c82 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.132482:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.132484:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.132490:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.132502:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 42 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.132510:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7400, rc 0) 00000100:00100000:0.0:1746143831.132546:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624742784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 119us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.132552:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16007 00000100:00100000:0.0:1746143831.132565:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16008 00000100:00100000:0.0:1746143831.132570:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624742656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.132576:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.132585:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7200/0x87925e4cb73b38ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c7b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.132594:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.132596:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.132600:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7200/0x87925e4cb73b38ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c7b expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.132611:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7200/0x87925e4cb73b38ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c7b expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.132617:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7200, rc 0) 00000100:00100000:0.0:1746143831.132634:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963624742656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.132639:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16008 00000100:00100000:0.0:1746143831.132648:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16010 00000100:00100000:0.0:1746143831.132653:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624743040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.132658:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.132663:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b6000/0x87925e4cb73b38b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c90 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.132676:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.132678:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.132681:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6000/0x87925e4cb73b38b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c90 expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.132689:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6000/0x87925e4cb73b38b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c90 expref: 41 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.132695:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6000, rc 0) 00000100:00100000:0.0:1746143831.132711:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963624743040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 57us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.132715:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16010 00000100:00100000:0.0:1746143831.132745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.134200:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2011:x1830963624742272:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15624us (15968us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143831.134207:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6896 00002000:00100000:1.0:1746143831.134212:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88012457f480 x1830963624742272/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/440 e 0 to 0 dl 1746143842 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.134226:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f480 with x1830963624742272 ext(1048576->2097151) 00002000:00010000:1.0:1746143831.134234:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f480 00000100:00100000:1.0:1746143831.134717:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2011:x1830963624741760:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16322us (16531us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143831.134722:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6894 00002000:00100000:1.0:1746143831.134726:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88012457d880 x1830963624741760/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/440 e 0 to 0 dl 1746143842 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.134732:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d880 with x1830963624741760 ext(1048576->2097151) 00002000:00010000:1.0:1746143831.134735:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457d880 00000100:00100000:0.0:1746143831.136285:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.136305:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.136338:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624743424 00000100:00100000:1.0:1746143831.136345:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624743424 00010000:00010000:1.0:1746143831.136368:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b3888 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c66 expref: 265 pid: 10936 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143831.136391:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7727 00000100:00100000:1.0:1746143831.136394:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:2009:x1830963624743424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.136402:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.136406:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b3888 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c66 expref: 265 pid: 10936 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.136424:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b3888 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c66 expref: 265 pid: 10936 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.136604:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b3888 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c66 expref: 265 pid: 10936 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.136624:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.136628:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.136635:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.136639:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.136662:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963624743424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 267us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.136668:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7727 00000100:00100000:0.0:1746143831.137413:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.137460:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.137470:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624743808 00000100:00100000:1.0:1746143831.137474:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624743808 00000100:00100000:1.0:1746143831.137506:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13839 00000100:00100000:1.0:1746143831.137511:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:2402:x1830963624743808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.137526:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.137533:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410c9e expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.137566:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.137572:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c9e expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.137685:0:10936:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.137720:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c9e expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.137729:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.137731:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143831.137733:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c9e expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.137739:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30c00, rc 0) 00000100:00100000:1.0:1746143831.137757:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2402:x1830963624743808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 246us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.137762:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13839 00000001:00080000:0.0:1746143831.140595:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944847 is committed 00000004:00080000:0.0:1746143831.140604:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2398 committed 00000004:00080000:0.0:1746143831.140623:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2400 committed 00000004:00080000:0.0:1746143831.140637:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2399 committed 00000004:00080000:0.0:1746143831.140639:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2398 committed 00000004:00080000:0.0:1746143831.140640:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2397 committed 00000004:00080000:0.0:1746143831.140642:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2397 committed 00000004:00080000:0.0:1746143831.140643:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2396 committed 00000004:00080000:0.0:1746143831.140644:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2396 committed 00000004:00080000:0.0:1746143831.140646:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2395 committed 00000004:00080000:0.0:1746143831.140647:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2395 committed 00000004:00080000:0.0:1746143831.140649:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2394 committed 00000004:00080000:0.0:1746143831.140650:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2393 committed 00000004:00080000:0.0:1746143831.140651:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2394 committed 00000004:00080000:0.0:1746143831.140653:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2393 committed 00000004:00080000:0.0:1746143831.140654:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2392 committed 00000004:00080000:0.0:1746143831.140656:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2391 committed 00000004:00080000:0.0:1746143831.140657:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2392 committed 00000001:00080000:0.0:1746143831.140661:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944846 is committed 00000001:00080000:0.0:1746143831.140672:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944842 is committed 00000100:00100000:0.0:1746143831.141053:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627381376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143831.141083:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627381248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.141102:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141122:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143831.141133:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627381888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.141138:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627381760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.141151:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141167:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627381376 00000100:00100000:0.0:1746143831.141171:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627382400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.141172:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627381376 00000100:00100000:1.0:1746143831.141182:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143831.141197:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141198:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627382272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.141207:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746143831.141211:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627381504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143831.141213:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143831.141224:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141227:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143831.141232:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627381632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143831.141233:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627382016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.141245:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141254:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627381248 00000100:00100000:1.0:1746143831.141256:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627381248 00000100:00100000:0.0:1746143831.141258:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627382528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.141270:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141281:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627381888 00000100:00100000:1.0:1746143831.141283:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627381888 00000100:00100000:0.0:1746143831.141287:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627381760 00000100:00100000:0.0:1746143831.141290:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627381760 00000100:00100000:1.0:1746143831.141292:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382400 00000100:00100000:1.0:1746143831.141293:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382400 00000100:00100000:1.0:1746143831.141305:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382272 00000100:00100000:0.0:1746143831.141306:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627381504 00000100:00100000:1.0:1746143831.141307:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382272 00000100:00100000:0.0:1746143831.141308:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627381504 00000100:00100000:1.0:1746143831.141312:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382016 00000100:00100000:1.0:1746143831.141314:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382016 00000100:00100000:0.0:1746143831.141316:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382528 00000100:00100000:0.0:1746143831.141318:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382528 00000100:00100000:1.0:1746143831.141323:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16011 00000100:00100000:1.0:1746143831.141328:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3772:x1830963627381248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143831.141335:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16012 00000100:00100000:0.0:1746143831.141339:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3773:x1830963627381888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143831.141422:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4804992 -> 4804992 00002000:00010000:0.0:1746143831.141425:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143831 -> 1746143831 00002000:00010000:0.0:1746143831.141427:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143830 -> 1746143830 00002000:00010000:0.0:1746143831.141437:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143831 -> 1746143831 00002000:00010000:0.0:1746143831.141439:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5304 -> 5304 00000100:00100000:0.0:1746143831.141462:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963627381888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (309us total) trans 17179873855 rc 0/0 00000100:00100000:0.0:1746143831.141467:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16012 00000100:00100000:0.0:1746143831.141478:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16013 00002000:00010000:1.0:1746143831.141480:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746143831.141482:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3772:x1830963627381760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143831.141483:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143830 -> 1746143830 00002000:00010000:1.0:1746143831.141484:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143829 -> 1746143829 00002000:00010000:1.0:1746143831.141486:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143830 -> 1746143830 00002000:00010000:1.0:1746143831.141488:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:1.0:1746143831.141508:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3772:x1830963627381248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (389us total) trans 17179873856 rc 0/0 00000100:00100000:1.0:1746143831.141513:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16011 00002000:00010000:0.0:1746143831.141520:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143831.141522:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143831 -> 1746143831 00000100:00100000:1.0:1746143831.141523:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16014 00002000:00010000:0.0:1746143831.141523:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143830 -> 1746143830 00002000:00010000:0.0:1746143831.141525:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143831 -> 1746143831 00000100:00100000:1.0:1746143831.141527:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963627382400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143831.141527:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143831.141545:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3772:x1830963627381760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (362us total) trans 17179873857 rc 0/0 00000100:00100000:0.0:1746143831.141549:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16013 00000100:00100000:0.0:1746143831.141559:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16015 00002000:00010000:1.0:1746143831.141561:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746143831.141562:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3772:x1830963627382272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143831.141564:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143831.141565:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143831.141567:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143831.141568:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:1.0:1746143831.141585:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963627382400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (387us total) trans 17179873858 rc 0/0 00000100:00100000:1.0:1746143831.141590:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16014 00000100:00100000:1.0:1746143831.141600:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16016 00000100:00100000:1.0:1746143831.141604:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3773:x1830963627381504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143831.141614:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3772:x1830963627382272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (400us total) trans 17179873859 rc 0/0 00000100:00100000:0.0:1746143831.141621:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16015 00000100:00100000:0.0:1746143831.141631:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16017 00000100:00100000:0.0:1746143831.141635:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3773:x1830963627382016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143831.141651:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143831.141653:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143831 -> 1746143831 00002000:00010000:1.0:1746143831.141655:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143830 -> 1746143830 00002000:00010000:1.0:1746143831.141656:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143831 -> 1746143831 00002000:00010000:1.0:1746143831.141658:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143831.141677:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3773:x1830963627381504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (452us total) trans 21474841134 rc 0/0 00000100:00100000:1.0:1746143831.141681:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16016 00000100:00100000:0.0:1746143831.141681:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963627382016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (434us total) trans 17179873860 rc 0/0 00000100:00100000:0.0:1746143831.141687:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16017 00000100:00100000:1.0:1746143831.141690:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16018 00000100:00100000:1.0:1746143831.141694:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3773:x1830963627382528:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143831.141712:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e55c00/2, rc 0, transno 21474841134 00000100:00100000:0.0:1746143831.141717:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627381504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143831.141724:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136335880/2, rc 0, transno 17179873860 00002000:00010000:1.0:1746143831.141729:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00000100:00100000:0.0:1746143831.141729:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627382016:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143831.141731:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143831.141733:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143831.141734:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00000004:00080000:0.0:1746143831.141735:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334000/2, rc 0, transno 17179873855 00002000:00010000:1.0:1746143831.141736:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143831.141737:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627381888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143831.141742:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef0e00/2, rc 0, transno 17179873858 00000100:00100000:0.0:1746143831.141744:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627382400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143831.141752:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef3b80/2, rc 0, transno 17179873861 00000100:00100000:1.0:1746143831.141753:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+57:3773:x1830963627382528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (482us total) trans 17179873861 rc 0/0 00000100:00100000:0.0:1746143831.141754:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627382528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.141757:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16018 00000100:00100000:1.0:1746143831.141775:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141787:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627382144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.141803:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143831.141818:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136337480/2, rc 0, transno 17179873856 00000100:00100000:1.0:1746143831.141821:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627381248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143831.141827:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136337b80/2, rc 0, transno 17179873857 00000100:00100000:1.0:1746143831.141830:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627381760:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143831.141835:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef2a00/2, rc 0, transno 17179873859 00000100:00100000:1.0:1746143831.141838:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627382272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.141846:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627382784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143831.141861:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143831.141872:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627383296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143831.141891:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627381632 00000100:00100000:1.0:1746143831.141893:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627381632 00000100:00100000:1.0:1746143831.141906:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382144 00000100:00100000:1.0:1746143831.141907:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382144 00000100:00100000:1.0:1746143831.141935:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382784 00000100:00100000:1.0:1746143831.141937:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382784 00000100:00100000:1.0:1746143831.141945:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627383040 00000100:00100000:1.0:1746143831.141946:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627383040 00000100:00100000:1.0:1746143831.141951:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627382912 00000100:00100000:1.0:1746143831.141953:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627382912 00000100:00100000:1.0:1746143831.141961:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16019 00000100:00100000:1.0:1746143831.141964:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3772:x1830963627381632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143831.142003:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143831.142006:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143831 -> 1746143831 00002000:00010000:1.0:1746143831.142007:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143831 -> 1746143831 00002000:00010000:1.0:1746143831.142009:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143831 -> 1746143831 00002000:00010000:1.0:1746143831.142010:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143831.142036:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3772:x1830963627381632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (260us total) trans 21474841135 rc 0/0 00000100:00100000:1.0:1746143831.142079:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16019 00000100:00100000:1.0:1746143831.142090:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16022 00000100:00100000:1.0:1746143831.142095:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3774:x1830963627383040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143831.142132:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:1.0:1746143831.142134:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143831.142136:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143831.142137:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143831.142139:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:1.0:1746143831.142160:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3774:x1830963627383040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (275us total) trans 21474841137 rc 0/0 00000100:00100000:1.0:1746143831.142165:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16022 00000100:00100000:1.0:1746143831.142173:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16025 00000100:00100000:1.0:1746143831.142177:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3771:x1830963627383168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143831.142227:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3771:x1830963627383168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (228us total) trans 21474841139 rc 0/0 00000100:00100000:1.0:1746143831.142232:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16025 00000100:00100000:1.0:1746143831.142255:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143831.142272:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e57480/2, rc 0, transno 21474841136 00000100:00100000:1.0:1746143831.142275:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627382784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143831.142281:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e54700/2, rc 0, transno 21474841135 00000100:00100000:1.0:1746143831.142284:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627381632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143831.142290:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef3480/2, rc 0, transno 17179873862 00000100:00100000:1.0:1746143831.142292:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627382144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143831.142317:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16027 00000100:00100000:1.0:1746143831.142321:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3773:x1830963627381376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143831.142355:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143831.142357:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143830 -> 1746143830 00002000:00010000:1.0:1746143831.142359:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143829 -> 1746143829 00002000:00010000:1.0:1746143831.142360:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143830 -> 1746143830 00002000:00010000:1.0:1746143831.142362:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143831.142379:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3773:x1830963627381376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1277us total) trans 21474841141 rc 0/0 00000100:00100000:1.0:1746143831.142384:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16027 00000004:00080000:1.0:1746143831.142401:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972eaa00/2, rc 0, transno 21474841140 00000100:00100000:1.0:1746143831.142404:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627383296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143831.142885:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e54000/2, rc 0, transno 21474841141 00000100:00100000:0.0:1746143831.142889:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627381376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143831.143218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.143284:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624743936 00000100:00100000:1.0:1746143831.143287:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624743936 00000100:00100000:1.0:1746143831.143319:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13840 00000100:00100000:1.0:1746143831.143324:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2400:x1830963624743936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.143335:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.143345:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b38d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410ca5 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.143378:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b38d5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ca5 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.143388:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b38d5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ca5 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.143401:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.143403:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143831.143406:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2c00, rc 0) 00000100:00100000:1.0:1746143831.143446:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2400:x1830963624743936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.143451:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13840 00000100:00100000:0.0:1746143831.144115:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.154857:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.154893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.155489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.155589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.156787:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.157808:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.160055:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624745984 00000100:00100000:0.0:1746143831.160060:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624745984 00002000:00100000:0.0:1746143831.160080:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6ca80 x1830963624745984/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.160089:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6ca80 with x1830963624745984 ext(1048576->2097151) 00002000:00010000:0.0:1746143831.160093:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6ca80 00000100:00100000:0.0:1746143831.160105:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624745472 00000100:00100000:0.0:1746143831.160107:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624745472 00002000:00100000:0.0:1746143831.160117:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009e493100 x1830963624745472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.160124:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493100 with x1830963624745472 ext(1048576->2097151) 00002000:00010000:0.0:1746143831.160127:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e493100 00000100:00100000:0.0:1746143831.160138:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6903 00000100:00100000:0.0:1746143831.160143:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963624745984:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143831.166065:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.175169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.179550:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.180569:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.180820:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7732 00000100:00100000:1.0:1746143831.180826:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963624746752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.180831:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.180840:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73b38b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c89 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.180850:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73b38b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c89 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00000100:00100000:0.0:1746143831.181657:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963624745984:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 21514us (21841us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143831.181662:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6903 00002000:00100000:0.0:1746143831.181667:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6ca80 x1830963624745984/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/440 e 0 to 0 dl 1746143842 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.181673:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6ca80 with x1830963624745984 ext(1048576->2097151) 00002000:00010000:0.0:1746143831.181676:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6ca80 00010000:00010000:1.0:1746143831.181776:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7da00/0x87925e4cb73b38b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c89 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.182805:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.183108:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963624746752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2280us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.183113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.183115:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7732 00000100:00100000:0.0:1746143831.188224:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.188253:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.192038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.192170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.192187:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16032 00000100:00100000:0.0:1746143831.192194:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2400:x1830963624747520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143831.192207:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.192220:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2dbc00/0x87925e4cb73b38f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410cc8 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.192240:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143831.192244:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2dbc00/0x87925e4cb73b38f8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cc8 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.192252:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e2dbc00/0x87925e4cb73b38f8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cc8 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.192257:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2dbc00, rc 0) 00000100:00100000:0.0:1746143831.192283:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2400:x1830963624747520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.192287:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16032 00000100:00100000:0.0:1746143831.192349:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.194072:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.194087:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624748032 00000100:00100000:0.0:1746143831.194090:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624748032 00002000:00100000:0.0:1746143831.194111:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (4009984->4194303) req@ffff880090e7b480 x1830963624748032/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.194124:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b480 with x1830963624748032 ext(4009984->4194303) 00010000:00010000:0.0:1746143831.194130:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73b38dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cac expref: 30 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.194138:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73b38dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cac expref: 30 pid: 9587 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746143831.194145:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e7b480 00000100:00100000:0.0:1746143831.194169:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2571 00000100:00100000:0.0:1746143831.194174:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963624748032:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143831.198611:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963624748032:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4432us (4536us total) trans 21474841142 rc 0/0 00000100:00100000:0.0:1746143831.198619:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2571 00002000:00100000:0.0:1746143831.198627:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (4009984->4194303) req@ffff880090e7b480 x1830963624748032/t21474841142(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/448 e 0 to 0 dl 1746143842 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.198633:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b480 with x1830963624748032 ext(4009984->4194303) 00010000:00010000:0.0:1746143831.198640:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73b38dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cac expref: 32 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.198651:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c528400/0x87925e4cb73b38dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4009984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cac expref: 32 pid: 9587 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746143831.198656:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e7b480 00000100:00100000:0.0:1746143831.199991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.200691:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.205147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.205169:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624748544 00000100:00100000:0.0:1746143831.205174:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624748544 00002000:00100000:0.0:1746143831.205203:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4358144->4362239) req@ffff88012d842300 x1830963624748544/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.205211:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842300 with x1830963624748544 ext(4358144->4362239) 00002000:00010000:0.0:1746143831.205215:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d842300 00000100:00100000:0.0:1746143831.205243:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6906 00000100:00100000:0.0:1746143831.205250:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963624748544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143831.205337:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963624748544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 87us (501us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143831.205342:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6906 00002000:00100000:0.0:1746143831.205346:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4358144->4362239) req@ffff88012d842300 x1830963624748544/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746143842 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.205352:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842300 with x1830963624748544 ext(4358144->4362239) 00002000:00010000:0.0:1746143831.205355:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d842300 00000100:00100000:0.0:1746143831.205381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.205392:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624748800 00000100:00100000:0.0:1746143831.205394:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624748800 00002000:00100000:0.0:1746143831.205410:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012d840000 x1830963624748800/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.205416:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840000 with x1830963624748800 ext(2097152->3145727) 00002000:00010000:0.0:1746143831.205419:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840000 00000100:00100000:0.0:1746143831.205445:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6907 00000100:00100000:0.0:1746143831.205451:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963624748800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143831.205817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.213946:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.214775:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.225700:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.225742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.225789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.231220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.238907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.244657:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624750592:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3350us (3670us total) trans 17179873865 rc 0/0 00000100:00100000:0.0:1746143831.244667:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2573 00002000:00100000:0.0:1746143831.244678:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4362239) req@ffff880091bdea00 x1830963624750592/t17179873865(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/448 e 0 to 0 dl 1746143842 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.244686:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdea00 with x1830963624750592 ext(4194304->4362239) 00010000:00010000:0.0:1746143831.244694:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b38ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cba expref: 27 pid: 12327 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.244704:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b38ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cba expref: 27 pid: 12327 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746143831.244709:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdea00 00000100:00100000:0.0:1746143831.247005:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.248237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.252673:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.258246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.268441:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.273354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.273767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.280951:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.281023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.281135:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624752128 00000100:00100000:1.0:1746143831.281142:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624752128 00002000:00100000:1.0:1746143831.281171:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880129dc1c00 x1830963624752128/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.281178:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1c00 with x1830963624752128 ext(3145728->4194303) 00002000:00010000:1.0:1746143831.281181:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1c00 00000100:00100000:1.0:1746143831.281193:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624752384 00000100:00100000:1.0:1746143831.281196:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624752384 00002000:00100000:1.0:1746143831.281207:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880129dc3480 x1830963624752384/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.281213:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3480 with x1830963624752384 ext(3145728->4194303) 00002000:00010000:1.0:1746143831.281215:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc3480 00000100:00100000:1.0:1746143831.281225:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6914 00000100:00100000:1.0:1746143831.281231:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963624752128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143831.289655:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.292464:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963624752128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11231us (11834us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143831.292471:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6914 00002000:00100000:1.0:1746143831.292477:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880129dc1c00 x1830963624752128/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/440 e 0 to 0 dl 1746143842 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.292484:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1c00 with x1830963624752128 ext(3145728->4194303) 00002000:00010000:1.0:1746143831.292488:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1c00 00000100:00100000:0.0:1746143831.301799:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.307158:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.314504:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.441293:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.446152:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.452650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.456168:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.456731:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624754304 00000100:00100000:0.0:1746143831.456739:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624754304 00000100:00100000:1.0:1746143831.456750:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624754560 00000100:00100000:1.0:1746143831.456756:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624754560 00010000:00010000:0.0:1746143831.456778:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73b3937 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf2 expref: 15 pid: 7243 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143831.456793:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13843 00000100:00100000:1.0:1746143831.456801:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2413:x1830963624754560:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143831.456801:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7737 00000100:00100000:0.0:1746143831.456806:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624754304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143831.456820:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.456822:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.456825:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73b3937 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf2 expref: 15 pid: 7243 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.456836:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73b3937 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf2 expref: 15 pid: 7243 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.456838:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b3953 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d00 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.456854:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d67200/0x87925e4cb73b3937 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf2 expref: 15 pid: 7243 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.456870:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143831.456875:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b394c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143831.456885:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b394c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143831.456892:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b394c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.456906:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.456936:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.456940:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143831.456944:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.456955:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.456959:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.456964:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143831.456976:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624754304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 170us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.456983:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7737 00010000:00010000:0.0:1746143831.457087:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457095:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457100:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143831.457108:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:0.0:1746143831.457180:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457186:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457191:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457196:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457205:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143831.457208:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457214:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457221:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143831.457224:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143831.457227:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457231:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b395a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457239:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457243:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457247:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457251:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143831.457253:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457257:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457261:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937acd00) 00010000:00010000:0.0:1746143831.457263:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143831.457265:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457269:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b3961 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143831.457296:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b3953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d00 expref: 266 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.457305:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d00 expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.457310:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143831.457312:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143831.457314:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74200, rc 0) 00000100:00100000:0.0:1746143831.457335:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2413:x1830963624754560:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 535us (634us total) trans 8589944854 rc 0/0 00000100:00100000:0.0:1746143831.457340:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13843 00000100:00100000:0.0:1746143831.463191:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.464296:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624754688 00000100:00100000:1.0:1746143831.464306:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624754688 00000100:00100000:1.0:1746143831.464360:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16038 00000100:00100000:1.0:1746143831.464367:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2413:x1830963624754688:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143831.464380:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.464393:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d07 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.464416:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 26 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.464434:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.464440:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.464441:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.464444:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1294336->1351679] (req 1294336->1351679) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 46 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.464470:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.464479:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.464489:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627385728:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.464568:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 26 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.464576:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 26 pid: 1945 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.464583:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627385856:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.464599:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.469468:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627385728:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.469484:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627385856:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.469515:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1294336->1351679] (req 1294336->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 46 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.469534:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d400, rc 0) 00000100:00100000:1.0:1746143831.470328:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2413:x1830963624754688:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5954us (7140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.470340:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16038 00000100:00100000:0.0:1746143831.470597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.470831:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624754816 00000100:00100000:1.0:1746143831.470837:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624754816 00010000:00010000:1.0:1746143831.470863:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 27 pid: 1945 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.470892:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7738 00000100:00100000:1.0:1746143831.470898:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624754816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.470931:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.470955:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 27 pid: 1945 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.470965:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 27 pid: 1945 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.470987:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6e00/0x87925e4cb73b3873 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c51 expref: 27 pid: 1945 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.471005:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.471030:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624754816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 132us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.471036:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7738 00000100:00100000:0.0:1746143831.472155:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.472210:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624754944 00000100:00100000:1.0:1746143831.472215:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624754944 00010000:00010000:1.0:1746143831.472234:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.472711:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7739 00000100:00100000:1.0:1746143831.472720:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963624754944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.472734:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.472750:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.472760:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.472777:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7400/0x87925e4cb73b38a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c82 expref: 46 pid: 1945 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.472791:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.472793:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.472799:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.472806:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.472837:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.472850:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627385984:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143831.473698:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.474600:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.474669:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624755072 00000100:00100000:1.0:1746143831.474677:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624755072 00000100:00100000:1.0:1746143831.474771:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16039 00000100:00100000:1.0:1746143831.474779:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2411:x1830963624755072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.474796:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.474813:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d0e expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.474839:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.474846:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143831.474848:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143831.474851:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.474873:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.474884:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143831.474895:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627386112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.475601:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.475879:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627385984:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143831.475895:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.476011:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624754944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3290us (3860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.476020:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7739 00000100:00100000:0.0:1746143831.476205:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.476340:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624755328 00000100:00100000:1.0:1746143831.476345:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624755328 00002000:00100000:1.0:1746143831.476376:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1294336->1298431) req@ffff880135b09880 x1830963624755328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.476386:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963624755328 ext(1294336->1298431) 00010000:00010000:1.0:1746143831.476393:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.476404:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00002000:00010000:1.0:1746143831.476410:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b09880 00000100:00100000:1.0:1746143831.476757:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2574 00000100:00100000:1.0:1746143831.476764:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624755328:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143831.477125:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624755328:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 360us (920us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143831.477132:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2574 00002000:00100000:1.0:1746143831.477138:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1294336->1298431) req@ffff880135b09880 x1830963624755328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:227/0 lens 488/4536 e 0 to 0 dl 1746143842 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.477145:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963624755328 ext(1294336->1298431) 00010000:00010000:1.0:1746143831.477150:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.477163:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00002000:00010000:1.0:1746143831.477167:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b09880 00000100:00100000:1.0:1746143831.478268:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627386112:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.478293:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.478308:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:1.0:1746143831.478345:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2411:x1830963624755072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3567us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.478352:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16039 00000100:00100000:1.0:1746143831.480082:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624755584 00000100:00100000:1.0:1746143831.480091:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624755584 00002000:00100000:0.0:1746143831.480201:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1347584->1351679) req@ffff880091bdd880 x1830963624755584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143831.480211:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963624755584 ext(1347584->1351679) 00010000:00010000:0.0:1746143831.480220:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:0.0:1746143831.480237:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 45 pid: 9587 timeout: 990 lvb_type: 0 00002000:00010000:0.0:1746143831.480243:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdd880 00000100:00100000:0.0:1746143831.482571:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.482628:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.487136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.487387:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624756224 00000100:00100000:1.0:1746143831.487394:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624756224 00000100:00100000:1.0:1746143831.487441:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16040 00000100:00100000:1.0:1746143831.487448:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2410:x1830963624756224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143831.487460:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.487471:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b398b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d15 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.487494:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73b386c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c43 expref: 33 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.487506:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.487511:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.487512:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.487515:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b398b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1122304->1519615] (req 1122304->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d15 expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.487539:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.487548:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 42 pid: 9586 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.487558:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627386240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.487631:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73b386c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c43 expref: 33 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.487639:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad800/0x87925e4cb73b386c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c43 expref: 33 pid: 12328 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.487647:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627386368:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.487685:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.488942:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.488971:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624756352 00000100:00100000:1.0:1746143831.488976:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624756352 00010000:00010000:1.0:1746143831.488997:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 47 pid: 9587 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143831.489030:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7740 00000100:00100000:1.0:1746143831.489036:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963624756352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.489045:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.489061:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 47 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.489070:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 47 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.489086:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d400/0x87925e4cb73b397d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1294336->1351679) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d07 expref: 47 pid: 9587 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.489460:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.489461:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.489468:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.489475:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.489497:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 26 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.489506:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627386496:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143831.489644:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.493676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.494316:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627386496:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143831.494334:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.494369:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963624756352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5333us (5460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.494377:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7740 00000100:00100000:1.0:1746143831.495046:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624756608 00000100:00100000:1.0:1746143831.495054:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624756608 00010000:00010000:1.0:1746143831.495080:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00000100:00100000:1.0:1746143831.495103:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7742 00000100:00100000:1.0:1746143831.495111:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963624756608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.495121:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.495136:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.495147:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.495166:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096010600/0x87925e4cb73b389d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c74 expref: 43 pid: 9586 timeout: 990 lvb_type: 1 00010000:00010000:1.0:1746143831.495180:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.495182:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.495188:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b398b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d15 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.495215:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b398b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d15 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.495983:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b398b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d15 expref: 31 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.496002:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627386624:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143831.496079:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.501700:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627386624:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143831.501719:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143831.501725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.501944:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963624756608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6832us (7059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.501953:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7742 00000100:00100000:0.0:1746143831.515116:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.519332:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.529801:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.534330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.534365:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.534404:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.534516:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624758016 00000100:00100000:1.0:1746143831.534521:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624758016 00000100:00100000:1.0:1746143831.534569:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16042 00000100:00100000:1.0:1746143831.534574:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963624758272:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.534583:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.534593:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d2a expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.534615:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.534618:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.534627:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 47 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.534647:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 47 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.534658:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:1.0:1746143831.534723:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963624758272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 147us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.534729:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16042 00000100:00100000:0.0:1746143831.543213:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.547090:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.556809:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.564575:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.564624:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.564909:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6922 00000100:00100000:1.0:1746143831.564941:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963624759168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143831.589444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.606318:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.610552:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.662406:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.670975:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.704744:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.713474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.714288:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.714466:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624760960 00000100:00100000:1.0:1746143831.714470:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624760960 00010000:00010000:1.0:1746143831.714490:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b391b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ceb expref: 27 pid: 12327 timeout: 990 lvb_type: 0 00000100:00100000:1.0:1746143831.714517:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7745 00000100:00100000:1.0:1746143831.714525:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624760960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.714534:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.714546:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b391b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ceb expref: 27 pid: 12327 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.714557:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b391b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ceb expref: 27 pid: 12327 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.714578:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b391b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ceb expref: 27 pid: 12327 timeout: 990 lvb_type: 0 00010000:00010000:1.0:1746143831.714805:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.714807:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.714815:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73b3a10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3354624->18446744073709551615] (req 3354624->4075519) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d46 expref: 46 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.714824:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73b3a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3354624->18446744073709551615] (req 3354624->4075519) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d46 expref: 46 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.714857:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c0a00/0x87925e4cb73b3a10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3354624->18446744073709551615] (req 3354624->4075519) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d46 expref: 46 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.714869:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627387392:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143831.714954:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.716963:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627387392:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143831.716984:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.717020:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624760960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2496us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.717030:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7745 00000100:00100000:0.0:1746143831.717195:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.725709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.725879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.731972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.732005:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624761856 00000100:00100000:1.0:1746143831.732015:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624761856 00000100:00100000:1.0:1746143831.732078:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 956 00000100:00100000:1.0:1746143831.732087:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+271:2010:x1830963624761856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.732103:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.732128:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097368a00/0x87925e4cb73b3a2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d4d expref: 271 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.732161:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.732166:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.732211:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+270:2010:x1830963624761856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 125us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.732218:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 956 00000100:00100000:0.0:1746143831.732802:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.734057:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.747873:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.748124:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624762496 00000100:00100000:1.0:1746143831.748135:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624762496 00000100:00100000:1.0:1746143831.748883:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13848 00000100:00100000:1.0:1746143831.748892:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2432:x1830963624762496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.749103:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.749125:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b3a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d5b expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.749206:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749218:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749228:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749243:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749247:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749252:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749346:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b3a56 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749354:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b3a56 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749359:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b3a56 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143831.749367:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143831.749453:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749459:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749464:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749470:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749475:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4d7ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.749479:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749484:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749494:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143831.749497:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.749502:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749506:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b3a48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749523:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749528:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749532:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749536:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a45800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.749538:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749542:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749547:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937acd00) 00010000:00010000:1.0:1746143831.749549:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.749551:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749555:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a45800/0x87925e4cb73b3a4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.749592:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b3a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d5b expref: 21 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.749603:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b3a56 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d5b expref: 20 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.749609:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.749611:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143831.749613:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7fa00, rc 0) 00000100:00100000:1.0:1746143831.749665:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2432:x1830963624762496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 775us (1803us total) trans 8589944864 rc 0/0 00000100:00100000:1.0:1746143831.749672:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13848 00000100:00100000:0.0:1746143831.749962:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.752474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.752508:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.752686:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.752726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.752743:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624763008 00000100:00100000:0.0:1746143831.752746:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624763008 00000100:00100000:0.0:1746143831.752771:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624763136 00000100:00100000:0.0:1746143831.752773:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624763136 00000100:00100000:1.0:1746143831.753101:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624762752 00000100:00100000:1.0:1746143831.753105:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624762752 00000100:00100000:1.0:1746143831.753137:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 957 00000100:00100000:1.0:1746143831.753141:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624762752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.753151:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143831.753163:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16048 00000100:00100000:0.0:1746143831.753168:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624763136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.753169:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b3a56 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d5b expref: 20 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.753174:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.753180:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143831.753182:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b3a72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d70 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.753184:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.753203:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963624762752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.753208:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 957 00000100:00100000:0.0:1746143831.753216:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627387776:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143831.753252:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.755898:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627387776:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143831.755956:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b3a72 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d70 expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.755969:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b3a72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d70 expref: 27 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.755985:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:1.0:1746143831.756020:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624763136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2851us (3293us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143831.756028:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16048 00000100:00100000:1.0:1746143831.762729:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.766459:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.778672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.781792:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.781928:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624763904 00000100:00100000:1.0:1746143831.781939:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624763904 00000100:00100000:1.0:1746143831.782006:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13849 00000100:00100000:1.0:1746143831.782014:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2433:x1830963624763904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143831.782041:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.782061:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137a00/0x87925e4cb73b3a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d77 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.782130:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3a80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782144:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3a80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782156:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3a80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782168:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b3a87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782174:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b3a87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782179:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b3a87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782249:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3a8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782260:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b394c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf9 expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.782266:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3a8e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.782297:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b394c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf9 expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.782309:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b394c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cf9 expref: 18 pid: 7243 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143831.782321:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009657f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627388032:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.782382:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.785382:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009657f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627388032:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.785408:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3a8e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143831.785972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.786258:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.786473:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624764032 00000100:00100000:1.0:1746143831.786476:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624764032 00000100:00100000:1.0:1746143831.786500:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16049 00000100:00100000:1.0:1746143831.786505:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2432:x1830963624764032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.786520:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.786532:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b3a95 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d7e expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.786553:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.786556:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.786563:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b3a95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d7e expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.786576:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b3a95 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d7e expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.786584:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137400, rc 0) 00000100:00100000:1.0:1746143831.786603:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2432:x1830963624764032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 98us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.786608:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16049 00000100:00100000:0.0:1746143831.790982:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792206:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792227:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792269:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.792313:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624764800 00000100:00100000:1.0:1746143831.792316:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624764800 00000100:00100000:1.0:1746143831.792336:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16050 00000100:00100000:1.0:1746143831.792341:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009657fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2010:x1830963624764800:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143831.792351:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.792367:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137600/0x87925e4cb73b3a9c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d85 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.792391:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.792393:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.792401:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137600/0x87925e4cb73b3a9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d85 expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.792416:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137600/0x87925e4cb73b3a9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d85 expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.792437:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137600, rc 0) 00000100:00100000:1.0:1746143831.792479:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009657fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963624764800:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 137us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.792485:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16050 00000100:00100000:1.0:1746143831.792498:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624765184 00000100:00100000:1.0:1746143831.792500:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624765184 00000100:00100000:1.0:1746143831.792512:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16051 00000100:00100000:1.0:1746143831.792517:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009657ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963624764928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143831.792523:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.792532:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73b3aa3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d8c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.792543:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.792544:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.792549:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73b3aa3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d8c expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.792560:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136c00/0x87925e4cb73b3aa3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d8c expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.792571:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136c00, rc 0) 00000100:00100000:1.0:1746143831.792585:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009657ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624764928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.792590:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16051 00000100:00100000:1.0:1746143831.792601:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16053 00000100:00100000:1.0:1746143831.792605:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624765184:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143831.792676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.792693:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624765440 00000100:00100000:0.0:1746143831.792696:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624765440 00000100:00100000:0.0:1746143831.792720:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16055 00000100:00100000:0.0:1746143831.792725:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624765440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143831.792731:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.792738:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73b3ab8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410da8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.792748:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.792749:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143831.792754:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73b3ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410da8 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.792763:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73b3ab8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410da8 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143831.792769:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75400, rc 0) 00000100:00100000:0.0:1746143831.792783:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624765440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 58us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143831.792788:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16055 00010000:00010000:1.0:1746143831.793285:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.793294:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b3abf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410d9a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.793306:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.793308:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.793313:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b3abf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d9a expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.793323:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b3abf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d9a expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.793331:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136e00, rc 0) 00000100:00100000:1.0:1746143831.793349:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624765184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 744us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.793355:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16053 00000100:00100000:0.0:1746143831.795086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.795135:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624765568 00000100:00100000:1.0:1746143831.795144:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624765568 00000100:00100000:1.0:1746143831.795193:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16056 00000100:00100000:1.0:1746143831.795202:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2425:x1830963624765568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143831.795217:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.795230:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410daf expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.795255:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.795262:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b3abf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d9a expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.795268:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 50 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.795273:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.795274:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.795278:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1163264->2056191] (req 1163264->2056191) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.795313:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 50 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.795324:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 50 pid: 3134 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746143831.795335:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388160:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.795431:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b3abf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d9a expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.795440:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b3abf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d9a expref: 9 pid: 13436 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746143831.795448:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388288:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.795475:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 30 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.795482:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b3984 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d0e expref: 30 pid: 9587 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143831.795491:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388416:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.795508:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.798983:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624765824 00000100:00100000:0.0:1746143831.798992:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624765824 00000100:00100000:0.0:1746143831.799029:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13850 00000100:00100000:0.0:1746143831.799036:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2433:x1830963624765824:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1746143831.799047:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388160:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143831.799054:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143831.799072:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b3acd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410db6 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.799129:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388288:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.799154:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388416:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143831.799180:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.799183:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1163264->2056191] (req 1163264->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.799195:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3a8e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d77 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.799197:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00010000:00010000:0.0:1746143831.799202:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746143831.799217:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2425:x1830963624765568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4016us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.799223:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16056 00010000:00010000:0.0:1746143831.799232:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3a8e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d77 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143831.799240:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3a8e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d77 expref: 8 pid: 7243 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746143831.799252:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627388544:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.799697:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009657f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624764672:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6929us (7490us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143831.799704:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6930 00002000:00100000:1.0:1746143831.799710:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009657f800 x1830963624764672/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/440 e 0 to 0 dl 1746143842 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.799716:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009657f800 with x1830963624764672 ext(3145728->4194303) 00002000:00010000:1.0:1746143831.799719:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009657f800 00000100:00100000:1.0:1746143831.799987:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.800665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.800687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.800710:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.800870:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7750 00000100:00100000:1.0:1746143831.800875:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+49:2008:x1830963624766208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.800882:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.801014:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 49 pid: 3134 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746143831.801023:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 49 pid: 3134 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746143831.801034:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b39bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d2a expref: 49 pid: 3134 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746143831.801051:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.801053:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143831.801060:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.801068:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.801094:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.801104:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627388672:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143831.801590:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.801760:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627388544:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143831.801778:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143831.802196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.802637:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.802721:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624766464 00000100:00100000:1.0:1746143831.802724:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624766464 00000100:00100000:1.0:1746143831.802748:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16057 00000100:00100000:1.0:1746143831.802753:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963624766464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.802767:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.802786:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3adb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410dbd expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.802820:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388800:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143831.802857:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00010000:00010000:1.0:1746143831.802869:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.802875:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143831.802893:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143831.803146:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b3acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.803158:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.803164:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.803166:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143831.803168:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:1.0:1746143831.803558:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2433:x1830963624765824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4522us (5065us total) trans 8589944865 rc 0/0 00000100:00100000:1.0:1746143831.803565:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13850 00000100:00100000:1.0:1746143831.803604:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627388672:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143831.803614:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.803644:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+50:2008:x1830963624766208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2768us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.803650:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7750 00000100:00100000:0.0:1746143831.803664:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.803682:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624766720 00000100:00100000:1.0:1746143831.803685:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624766720 00002000:00100000:1.0:1746143831.803710:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1163264->1167359) req@ffff88012d840e00 x1830963624766720/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:227/0 lens 488/0 e 0 to 0 dl 1746143842 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143831.803718:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840e00 with x1830963624766720 ext(1163264->1167359) 00002000:00010000:1.0:1746143831.803722:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840e00 00002000:00010000:1.0:1746143831.804859:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143831 -> 1746143832 00002000:00010000:1.0:1746143831.804862:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143830 -> 1746143832 00002000:00010000:1.0:1746143831.804864:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143831 -> 1746143832 00000100:00100000:1.0:1746143831.804872:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627388800:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143831.804891:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3adb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dbd expref: 49 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.804902:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2200/0x87925e4cb73b3adb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dbd expref: 49 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.804928:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2200, rc 0) 00000100:00100000:1.0:1746143831.804950:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963624766464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2196us (2313us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143831.804957:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16057 00000100:00100000:0.0:1746143831.806299:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.806610:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.807387:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624766848 00000100:00100000:1.0:1746143831.807391:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624766848 00000100:00100000:1.0:1746143831.807429:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13851 00000100:00100000:1.0:1746143831.807435:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2433:x1830963624766848:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143831.807458:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.807475:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b3ae9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410dc4 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.807555:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3af0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.807569:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.807575:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3af0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.807603:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.807614:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 9 pid: 7243 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143831.807625:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627388928:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143831.807698:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.807827:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.807978:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624767232 00000100:00100000:1.0:1746143831.807982:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624767232 00000100:00100000:1.0:1746143831.808015:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16058 00000100:00100000:1.0:1746143831.808021:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963624767232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143831.808028:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.808564:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b3af7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410dcb expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.808601:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627389056:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143831.808633:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143831.810340:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.810361:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624767360 00000100:00100000:1.0:1746143831.810368:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624767360 00010000:00010000:1.0:1746143831.810398:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 10 pid: 7243 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143831.810566:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7752 00000100:00100000:1.0:1746143831.810573:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624767360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.810587:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.810593:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 10 pid: 7243 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143831.810605:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 10 pid: 7243 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143831.810626:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b3ad4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410db6 expref: 10 pid: 7243 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143831.810640:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.810645:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3af0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.810654:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3af0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.810661:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b3af0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143831.810889:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.811404:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624767360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 829us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.811411:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7752 00000100:00100000:1.0:1746143831.811931:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627389056:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143831.811951:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b3af7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dcb expref: 49 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.811961:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b3af7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dcb expref: 49 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.811969:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00000100:00100000:1.0:1746143831.812003:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963624767232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3982us (4176us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143831.812009:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16058 00000100:00100000:0.0:1746143831.815029:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.815134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.815220:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624767488 00000100:00100000:1.0:1746143831.815228:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624767488 00000100:00100000:1.0:1746143831.815275:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16059 00000100:00100000:1.0:1746143831.815282:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624767488:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143831.815299:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.815314:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466600/0x87925e4cb73b3afe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410dd2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143831.815366:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627389184:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143831.815449:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143831.817387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.817677:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627389184:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143831.817697:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466600/0x87925e4cb73b3afe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dd2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.817709:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466600/0x87925e4cb73b3afe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dd2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143831.817718:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466600, rc 0) 00000100:00100000:1.0:1746143831.817743:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624767488:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2461us (2722us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143831.817749:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16059 00000100:00100000:0.0:1746143831.817889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.818069:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624768256 00000100:00100000:1.0:1746143831.818072:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624768256 00000100:00100000:1.0:1746143831.818089:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5322 00000100:00100000:1.0:1746143831.818094:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2432:x1830963624768256:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143831.818194:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2432:x1830963624768256:12345-192.168.202.3@tcp:35:cat.0 Request processed in 99us (304us total) trans 8589944867 rc 0/0 00000100:00100000:1.0:1746143831.818199:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5322 00000100:00100000:0.0:1746143831.819237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.823738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.823794:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.824056:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5324 00000100:00100000:1.0:1746143831.824071:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2433:x1830963624769024:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143831.824324:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2433:x1830963624769024:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 258us (528us total) trans 8589944869 rc 0/0 00000100:00100000:1.0:1746143831.824331:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5324 00000100:00100000:0.0:1746143831.941721:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.942568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.946001:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.946083:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.946164:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624769664 00000100:00100000:1.0:1746143831.946171:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624769664 00000100:00100000:1.0:1746143831.946468:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 958 00000100:00100000:1.0:1746143831.946476:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624769664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.946488:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.946509:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b3b28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410de0 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.946536:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.946540:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.946754:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624769664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 279us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.946761:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 958 00000100:00100000:0.0:1746143831.951622:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.955468:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.955545:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.955729:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624770048 00000100:00100000:1.0:1746143831.955736:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624770048 00010000:00010000:1.0:1746143831.955759:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73b3b44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410de7 expref: 22 pid: 6587 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143831.955842:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7753 00000100:00100000:1.0:1746143831.955849:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624770048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143831.955864:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143831.955869:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73b3b44 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410de7 expref: 22 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143831.955879:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73b3b44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410de7 expref: 22 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143831.955898:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550800/0x87925e4cb73b3b44 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410de7 expref: 22 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143831.955980:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.955984:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73b3b60 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143831.955992:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73b3b60 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143831.955997:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551e00/0x87925e4cb73b3b60 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143831.956038:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143831.956066:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963624770048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 218us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143831.956072:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7753 00000100:00100000:0.0:1746143831.956952:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.964091:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.970214:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.970514:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624770816 00000100:00100000:1.0:1746143831.970522:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624770816 00000100:00100000:1.0:1746143831.970576:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13857 00000100:00100000:1.0:1746143831.970583:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+272:2443:x1830963624770816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143831.970607:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.970625:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b3b7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e03 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.970699:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970711:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970721:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970733:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970739:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970744:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970836:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b3b91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970844:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b3b91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.970855:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b3b91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143831.970863:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000100:00100000:0.0:1746143831.971502:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143831.972217:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972224:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972230:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972236:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972241:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.972244:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972251:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972259:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143831.972260:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.972263:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972266:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b3b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972283:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972286:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972289:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972295:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.972297:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972302:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972307:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac300) 00010000:00010000:1.0:1746143831.972309:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143831.972311:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972316:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b3b8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.972353:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b3b7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e03 expref: 275 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.972363:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b3b91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e03 expref: 274 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.972368:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.972370:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143831.972372:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408dc00, rc 0) 00000100:00100000:1.0:1746143831.972397:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+274:2443:x1830963624770816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1814us (2192us total) trans 8589944872 rc 0/0 00000100:00100000:1.0:1746143831.972407:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13857 00000100:00100000:0.0:1746143831.974314:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.975357:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143831.979814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.980222:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624771456 00000100:00100000:1.0:1746143831.980232:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624771456 00000100:00100000:1.0:1746143831.980297:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13858 00000100:00100000:1.0:1746143831.980304:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2440:x1830963624771456:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143831.980325:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143831.980347:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28a00/0x87925e4cb73b3ba6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e11 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143831.980351:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143831.980394:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624771712 00000100:00100000:1.0:1746143831.980397:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624771712 00000100:00100000:1.0:1746143831.980441:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5325 00000100:00100000:1.0:1746143831.980447:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2441:x1830963624771712:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143831.980696:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2441:x1830963624771712:12345-192.168.202.3@tcp:35:cat.0 Request processed in 248us (347us total) trans 8589944873 rc 0/0 00000100:00100000:1.0:1746143831.980704:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5325 00010000:00010000:1.0:1746143831.980763:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980777:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980787:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980798:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980803:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980808:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980816:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e28c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143831.980819:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980825:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980833:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143831.980836:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143831.980839:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980843:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bad lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143831.980863:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28a00/0x87925e4cb73b3ba6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e11 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.980869:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28a00/0x87925e4cb73b3ba6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e11 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143831.980875:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:1.0:1746143831.980906:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2440:x1830963624771456:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 602us (1102us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143831.981013:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13858 00000100:00100000:1.0:1746143831.985080:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624771968 00000100:00100000:1.0:1746143831.985091:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624771968 00000100:00100000:1.0:1746143831.985302:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5326 00000100:00100000:1.0:1746143831.985312:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013735b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2440:x1830963624771968:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143831.985537:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013735b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2440:x1830963624771968:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 226us (562us total) trans 8589944874 rc 0/0 00000100:00100000:1.0:1746143831.985543:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5326 00000100:00100000:0.0:1746143832.041414:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.041527:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624772224 00000100:00100000:1.0:1746143832.041537:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624772224 00000100:00100000:1.0:1746143832.041598:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13859 00000100:00100000:1.0:1746143832.041607:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2449:x1830963624772224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.041635:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.041657:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28a00/0x87925e4cb73b3bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e18 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.041736:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041751:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041764:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041779:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041784:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041789:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041888:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041903:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.041909:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143832.041950:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143832.042681:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042688:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042855:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042863:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042868:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e28c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.042872:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042879:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042892:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143832.042895:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.042899:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.042904:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b3bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044335:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044345:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044350:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044354:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.044356:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044360:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044369:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac900) 00010000:00010000:1.0:1746143832.044371:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.044374:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044378:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b3bc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.044450:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28a00/0x87925e4cb73b3bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e18 expref: 276 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.044463:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e18 expref: 275 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.044469:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.044472:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143832.044475:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32400, rc 0) 00000100:00100000:1.0:1746143832.045489:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+275:2449:x1830963624772224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3879us (4081us total) trans 8589944875 rc 0/0 00000100:00100000:1.0:1746143832.045502:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13859 00000100:00100000:0.0:1746143832.047685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.047942:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624772480 00000100:00100000:1.0:1746143832.047951:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624772480 00000100:00100000:1.0:1746143832.047997:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13860 00000100:00100000:1.0:1746143832.048003:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2450:x1830963624772480:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.048024:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.048042:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b3bd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e1f expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.048119:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048132:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048142:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048154:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048158:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048163:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048252:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048261:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048266:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143832.048273:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143832.048340:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048347:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048352:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048357:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048363:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.048367:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048372:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048381:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143832.048383:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.048387:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048391:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32800/0x87925e4cb73b3bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048415:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048429:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048433:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048437:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.048439:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048443:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048449:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac900) 00010000:00010000:1.0:1746143832.048452:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.048453:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048458:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b3be5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.048490:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b3bd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e1f expref: 25 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.048500:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e1f expref: 24 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.048507:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.048509:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143832.048512:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:1.0:1746143832.048555:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2450:x1830963624772480:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 552us (878us total) trans 8589944876 rc 0/0 00000100:00100000:1.0:1746143832.048561:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13860 00000100:00100000:0.0:1746143832.062853:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.066751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143832.067797:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143832.080249:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624772864:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12118us (13492us total) trans 17179873868 rc 0/0 00000100:00100000:0.0:1746143832.080263:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2579 00002000:00100000:0.0:1746143832.080277:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1163264->2056191) req@ffff880133571180 x1830963624772864/t17179873868(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:228/0 lens 488/448 e 0 to 0 dl 1746143843 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143832.080287:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133571180 with x1830963624772864 ext(1163264->2056191) 00010000:00010000:0.0:1746143832.080298:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 29 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.080316:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b3ac6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410daf expref: 29 pid: 13436 timeout: 991 lvb_type: 0 00002000:00010000:0.0:1746143832.080323:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880133571180 00000100:00100000:0.0:1746143832.083460:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.090096:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.093189:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.105568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.105608:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.105634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.107581:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7757 00000100:00100000:0.0:1746143832.107594:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624773504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143832.107612:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143832.107635:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e2dbc00/0x87925e4cb73b38f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cc8 expref: 29 pid: 1945 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.107655:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e2dbc00/0x87925e4cb73b38f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cc8 expref: 29 pid: 1945 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.107814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.107834:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624773888 00000100:00100000:1.0:1746143832.107839:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624773888 00010000:00010000:1.0:1746143832.107870:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73b3ab1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410da1 expref: 9 pid: 9587 timeout: 991 lvb_type: 1 00000100:00100000:1.0:1746143832.107888:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7760 00000100:00100000:1.0:1746143832.107895:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624773888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.107906:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143832.108004:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e2dbc00/0x87925e4cb73b38f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410cc8 expref: 29 pid: 1945 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.108027:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143832.108095:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624773504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 503us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143832.108103:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7757 00000100:00080000:0.0:1746143832.108133:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143832.108237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143832.108588:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73b3ab1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410da1 expref: 9 pid: 9587 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746143832.108603:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73b3ab1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410da1 expref: 9 pid: 9587 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746143832.108625:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1800/0x87925e4cb73b3ab1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410da1 expref: 9 pid: 9587 timeout: 991 lvb_type: 1 00010000:00010000:1.0:1746143832.108663:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.108680:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624773888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 786us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.108686:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7760 00000100:00100000:0.0:1746143832.112597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.121493:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.125217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.127846:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.130610:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.130646:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.130697:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624774912 00000100:00100000:1.0:1746143832.130710:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624774912 00010000:00010000:1.0:1746143832.131836:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b3914 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ce4 expref: 44 pid: 12327 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.131878:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7764 00000100:00100000:1.0:1746143832.131886:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963624774912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.131899:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.132012:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b3914 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ce4 expref: 44 pid: 12327 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.132023:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b3914 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ce4 expref: 44 pid: 12327 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.132043:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b3914 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ce4 expref: 44 pid: 12327 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.132069:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.132071:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.132076:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.132084:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.132111:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.132126:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627391488:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143832.132290:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.133129:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627391488:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143832.133145:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.133172:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963624774912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1286us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.133180:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7764 00000100:00100000:0.0:1746143832.142017:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.145485:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.145544:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624775552 00000100:00100000:1.0:1746143832.145555:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624775552 00002000:00100000:1.0:1746143832.145601:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880133571500 x1830963624775552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/0 e 0 to 0 dl 1746143843 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.145612:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133571500 with x1830963624775552 ext(3145728->4194303) 00002000:00010000:1.0:1746143832.145617:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133571500 00000100:00100000:1.0:1746143832.145652:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6939 00000100:00100000:1.0:1746143832.145660:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880133571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+48:2008:x1830963624775552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143832.148256:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.155769:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880133571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+48:2008:x1830963624775552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10096us (10281us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143832.155782:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6939 00002000:00100000:1.0:1746143832.155795:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880133571500 x1830963624775552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/440 e 0 to 0 dl 1746143843 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.155804:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880133571500 with x1830963624775552 ext(3145728->4194303) 00002000:00010000:1.0:1746143832.155810:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880133571500 00000100:00100000:0.0:1746143832.157478:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.164253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.176557:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.190500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.196221:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.196304:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.201082:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.201110:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.201709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.201835:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624777472 00000100:00100000:1.0:1746143832.201842:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624777472 00000100:00100000:1.0:1746143832.201928:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16069 00000100:00100000:1.0:1746143832.201935:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963624777472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.201949:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.201962:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73b3c40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e5e expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.202002:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627391872:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143832.202047:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00002000:00010000:1.0:1746143832.203726:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143831 -> 1746143832 00002000:00010000:1.0:1746143832.203732:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143831 -> 1746143832 00002000:00010000:1.0:1746143832.203734:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143831 -> 1746143832 00000100:00100000:1.0:1746143832.203750:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627391872:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143832.203773:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73b3c40 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e5e expref: 35 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.204366:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27000/0x87925e4cb73b3c40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e5e expref: 35 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.204383:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27000, rc 0) 00000100:00100000:1.0:1746143832.204414:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963624777472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2478us (2704us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143832.204431:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16069 00000100:00100000:0.0:1746143832.207266:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.208246:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624777600 00000100:00100000:1.0:1746143832.208255:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624777600 00010000:00010000:1.0:1746143832.208289:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 45 pid: 13436 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.208324:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7765 00000100:00100000:1.0:1746143832.208331:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963624777600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.208343:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.208361:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 45 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.208379:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 45 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.208396:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551a00/0x87925e4cb73b3c0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2326527) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e3b expref: 45 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.208410:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.208411:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.208426:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73b3c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e42 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.208434:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73b3c16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e42 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.208461:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73b3c16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e42 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.208471:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627392000:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143832.208549:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143832.212122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.212589:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627392000:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143832.212604:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.212633:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963624777600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4303us (5374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.212641:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7765 00000100:00100000:0.0:1746143832.215096:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627392128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143832.215138:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143832.215655:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627392128:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1746143832.215791:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143832.216601:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.221586:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.221655:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624778240 00000100:00100000:1.0:1746143832.221663:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624778240 00000100:00100000:1.0:1746143832.221781:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16070 00000100:00100000:1.0:1746143832.221975:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2450:x1830963624778240:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.221991:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.222005:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b3c47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e65 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.222027:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 47 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.222034:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.222036:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.222038:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b3c47 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4194304->4411391] (req 4194304->4411391) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e65 expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.222062:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 47 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.222072:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 47 pid: 13436 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.222081:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627392256:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143832.222412:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143832.225716:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.225815:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627392256:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143832.225838:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b3c47 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4194304->4411391] (req 4194304->4411391) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e65 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.225854:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27600, rc 0) 00000100:00100000:1.0:1746143832.225882:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2450:x1830963624778240:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4095us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.225890:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16070 00000100:00100000:0.0:1746143832.232654:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.233030:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624778496 00000100:00100000:1.0:1746143832.233041:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624778496 00000100:00100000:1.0:1746143832.233306:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16071 00000100:00100000:1.0:1746143832.233316:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2455:x1830963624778496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.233338:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.233357:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e6c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.233389:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.233391:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.233401:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.233413:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.233440:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26600, rc 0) 00000100:00100000:1.0:1746143832.233503:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2455:x1830963624778496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 189us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.233510:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16071 00000100:00100000:0.0:1746143832.233514:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b54cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+50:2010:x1830963624778368:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7446us (7795us total) trans 17179873869 rc 0/0 00000100:00100000:0.0:1746143832.233527:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2581 00002000:00100000:0.0:1746143832.233538:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2572288->3145727) req@ffff88009b54cc50 x1830963624778368/t17179873869(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/448 e 0 to 0 dl 1746143843 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143832.233546:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b54cc50 with x1830963624778368 ext(2572288->3145727) 00010000:00010000:0.0:1746143832.233554:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 50 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.233569:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 50 pid: 13436 timeout: 991 lvb_type: 0 00002000:00010000:0.0:1746143832.233575:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b54cc50 00000100:00100000:0.0:1746143832.237754:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.238000:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624778624 00000100:00100000:1.0:1746143832.238011:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624778624 00010000:00010000:1.0:1746143832.238052:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 50 pid: 13436 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.238099:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7766 00000100:00100000:1.0:1746143832.238108:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+50:2010:x1830963624778624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.238124:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.238147:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 50 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.238159:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 50 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.238185:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137000/0x87925e4cb73b3c08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2572288->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e34 expref: 50 pid: 13436 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.238207:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.238209:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.238217:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b3c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4411391) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e65 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.238230:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b3c47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4411391) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e65 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.238240:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.238241:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.238245:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.238251:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.238282:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.238293:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627392384:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143832.238387:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b3c47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4194304->4411391) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e65 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.238395:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627392512:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143832.238472:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.239777:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627392512:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143832.240341:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627392384:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143832.240361:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.240407:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+49:2010:x1830963624778624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2298us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.240431:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7766 00000100:00100000:0.0:1746143832.243816:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.246720:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.246909:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624779136 00000100:00100000:1.0:1746143832.246946:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624779136 00000100:00100000:1.0:1746143832.246998:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5329 00000100:00100000:1.0:1746143832.247007:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2450:x1830963624779136:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143832.247222:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2450:x1830963624779136:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 216us (513us total) trans 8589944880 rc 0/0 00000100:00100000:1.0:1746143832.247228:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5329 00000100:00100000:0.0:1746143832.247611:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.247701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.269796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.269901:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624779776 00000100:00100000:1.0:1746143832.269940:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624779776 00000100:00100000:1.0:1746143832.270104:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16072 00000100:00100000:1.0:1746143832.270112:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963624779776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.270131:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.270148:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3c55 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e73 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.270200:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627392640:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143832.270295:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.271574:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627392640:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143832.271595:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3c55 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e73 expref: 30 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.271604:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3c55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e73 expref: 30 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.271627:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27200, rc 0) 00000100:00100000:1.0:1746143832.271658:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963624779776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1547us (1873us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143832.271663:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16072 00000100:00100000:0.0:1746143832.275367:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.276138:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.282020:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.282056:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.282088:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624780416 00000100:00100000:1.0:1746143832.282096:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624780416 00010000:00010000:1.0:1746143832.282132:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e1f expref: 27 pid: 10936 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.282158:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624780672 00000100:00100000:1.0:1746143832.282160:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624780672 00010000:00010000:1.0:1746143832.282169:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b3b75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dfc expref: 11 pid: 6587 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.282184:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7767 00000100:00100000:1.0:1746143832.282191:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624780416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.282204:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.282210:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e1f expref: 27 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.282220:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e1f expref: 27 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.282239:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32c00/0x87925e4cb73b3bec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e1f expref: 27 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.282266:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.282271:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.282280:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.282285:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.282322:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624780416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.282328:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7767 00000100:00100000:1.0:1746143832.282339:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7768 00000100:00100000:1.0:1746143832.282344:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624780672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143832.282345:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143832.282349:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.282352:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b3b75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dfc expref: 11 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.282359:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b3b75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dfc expref: 11 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.282368:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b3b75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410dfc expref: 11 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.282375:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.282378:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.282382:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.282386:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.282398:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624780672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.282402:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7768 00000100:00100000:1.0:1746143832.282408:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624780544 00000100:00100000:1.0:1746143832.282410:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624780544 00010000:00010000:1.0:1746143832.282428:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e18 expref: 279 pid: 10936 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746143832.282439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.282447:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7769 00000100:00100000:1.0:1746143832.282465:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624780800 00000100:00100000:1.0:1746143832.282467:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624780800 00000100:00100000:1.0:1746143832.282484:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16073 00000100:00100000:1.0:1746143832.282488:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624780800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.282501:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.282514:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73b3c6a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e81 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.282554:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627393152:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143832.282978:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.282998:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:2008:x1830963624780544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.283013:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.283023:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e18 expref: 279 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.283035:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e18 expref: 279 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.283055:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b3bc9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e18 expref: 279 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.283073:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.283076:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.283085:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.283204:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143832.283296:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.283328:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:2008:x1830963624780544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 874us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.283335:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7769 00000100:00100000:1.0:1746143832.284942:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627393152:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143832.284963:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73b3c6a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e81 expref: 30 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.284974:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26800/0x87925e4cb73b3c6a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e81 expref: 30 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.284981:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26800, rc 0) 00000100:00100000:1.0:1746143832.285006:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624780800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2516us (2566us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143832.285012:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16073 00000100:00100000:0.0:1746143832.287860:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.287955:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624780928 00000100:00100000:1.0:1746143832.287962:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624780928 00000100:00100000:1.0:1746143832.288005:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16074 00000100:00100000:1.0:1746143832.288012:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624780928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.288027:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.288041:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3c78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e88 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.288083:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627393280:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143832.288299:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143832.291278:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627393280:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143832.291301:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3c78 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e88 expref: 30 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143832.291312:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b3c78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e88 expref: 30 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143832.291323:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27200, rc 0) 00000100:00100000:0.0:1746143832.291353:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624780928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3342us (3500us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143832.291360:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16074 00000100:00100000:0.0:1746143832.350843:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.351322:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.351354:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.351382:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.351537:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624781312 00000100:00100000:0.0:1746143832.351546:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624781312 00000100:00080000:0.0:1746143832.351573:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143832.351604:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624781440 00000100:00100000:0.0:1746143832.351606:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624781440 00000100:00080000:0.0:1746143832.351616:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143832.351940:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1195 00000100:00100000:0.0:1746143832.351947:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963624781184:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143832.352012:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1196 00000100:00100000:1.0:1746143832.352019:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2009:x1830963624781440:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143832.352547:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+20:2009:x1830963624781184:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 600us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143832.352554:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1195 00000100:00100000:1.0:1746143832.352630:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2009:x1830963624781440:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 612us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.352635:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1196 00000100:00100000:0.0:1746143832.366732:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.366951:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624781696 00000100:00100000:1.0:1746143832.366960:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624781696 00000100:00100000:1.0:1746143832.367008:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13863 00000100:00100000:1.0:1746143832.367015:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2461:x1830963624781696:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.367042:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.367063:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b3c7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e8f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.367179:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.367198:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.367208:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143832.367219:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143832.367319:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27a00/0x87925e4cb73b3c7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e8f expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.367353:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e8f expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.367361:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.367363:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143832.367367:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26800, rc 0) 00000100:00100000:1.0:1746143832.367415:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2461:x1830963624781696:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 400us (693us total) trans 8589944882 rc 0/0 00000100:00100000:1.0:1746143832.367436:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13863 00000100:00100000:0.0:1746143832.394182:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.399718:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.399759:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.399774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.399815:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.399850:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624782208 00000100:00100000:1.0:1746143832.399859:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624782208 00000100:00100000:1.0:1746143832.399901:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624782336 00000100:00100000:1.0:1746143832.399903:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624782336 00000100:00100000:1.0:1746143832.399936:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624782464 00000100:00100000:1.0:1746143832.399938:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624782464 00000100:00100000:1.0:1746143832.399954:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16075 00000100:00100000:1.0:1746143832.399961:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+49:2008:x1830963624782208:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.399995:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.400013:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27a00/0x87925e4cb73b3cb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410e9d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.400069:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627393408:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143832.400157:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.400222:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16077 00000100:00100000:1.0:1746143832.400228:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2458:x1830963624782464:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.400235:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.400242:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b3cc5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410eab expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.400258:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73b3c16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e42 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.400265:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.400266:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.400270:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b3cc5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410eab expref: 47 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.400288:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73b3c16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e42 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.400300:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d550e00/0x87925e4cb73b3c16 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e42 expref: 33 pid: 13436 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.400313:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627393664:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143832.400332:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.402079:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627393664:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143832.402107:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b3cc5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410eab expref: 47 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.402122:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00000100:00100000:1.0:1746143832.402165:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2458:x1830963624782464:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1934us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.402173:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16077 00000100:00100000:1.0:1746143832.402679:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.412567:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.412609:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:1.0:1746143832.415807:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841146 is committed 00000001:00080000:1.0:1746143832.415820:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841145 is committed 00000001:00080000:1.0:1746143832.415840:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841141 is committed 00000100:00100000:0.0:1746143832.416719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.423646:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.425271:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.433145:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.433229:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.433947:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6950 00000100:00100000:1.0:1746143832.433955:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963624783872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143832.449278:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963624783872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15313us (16038us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746143832.449290:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6950 00002000:00100000:1.0:1746143832.449302:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88009c4d4380 x1830963624783872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 504/440 e 0 to 0 dl 1746143843 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.449311:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963624783872 ext(2097152->3145727) 00002000:00010000:1.0:1746143832.449317:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4380 00000100:00100000:0.0:1746143832.455478:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.458082:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.458113:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.458225:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.458630:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16083 00000100:00100000:1.0:1746143832.458646:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+51:2464:x1830963624784384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.458662:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.458678:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b3cef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410ed5 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.458700:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143832.458706:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73b3ce1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4018175] (req 3145728->4018175) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ec7 expref: 52 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.458712:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143832.458715:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b3cef lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ed5 expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.458749:0:3135:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096010c00/0x87925e4cb73b3ce1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4018175] (req 3145728->4018175) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ec7 expref: 52 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.458760:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012224fa00/0x87925e4cb73b3cef lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ed5 expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.458769:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fa00, rc 0) 00000100:00100000:1.0:1746143832.458808:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+52:2464:x1830963624784384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 168us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.458814:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16083 00000100:00100000:0.0:1746143832.463643:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.463674:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.464036:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624784512 00000100:00100000:1.0:1746143832.464044:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624784512 00010000:00010000:1.0:1746143832.464070:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c0600/0x87925e4cb73b3aaa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d93 expref: 9 pid: 9587 timeout: 991 lvb_type: 1 00000100:00100000:0.0:1746143832.464750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.469227:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.475670:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.479447:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.485277:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.489439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.503398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.508236:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627395072:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143832.508259:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143832.508296:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+53:2010:x1830963624786048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4472us (4906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143832.508306:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7775 00000100:00100000:0.0:1746143832.510010:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.510054:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.514073:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.514115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.515219:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16085 00000100:00100000:1.0:1746143832.515227:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624786816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143832.515235:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.515244:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b3cfd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410ee3 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.515277:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627395200:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143832.515706:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143832.516124:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963624786432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5896us (6116us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143832.516136:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6953 00002000:00100000:0.0:1746143832.516148:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800931c5880 x1830963624786432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/440 e 0 to 0 dl 1746143843 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143832.516158:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c5880 with x1830963624786432 ext(3145728->4194303) 00002000:00010000:0.0:1746143832.516163:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931c5880 00000100:00100000:1.0:1746143832.517236:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627395200:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143832.517255:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b3cfd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ee3 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.517265:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b3cfd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ee3 expref: 8 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.517288:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010c00, rc 0) 00000100:00100000:1.0:1746143832.517311:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624786816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2085us (3195us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143832.517318:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16085 00000100:00100000:0.0:1746143832.521761:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.526725:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.527267:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.533516:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.535537:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.538390:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.539863:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.539948:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.545878:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.547134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.547251:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624788480 00000100:00100000:1.0:1746143832.547256:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624788480 00000100:00100000:1.0:1746143832.547296:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5330 00000100:00100000:1.0:1746143832.547303:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:2464:x1830963624788480:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143832.548225:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:2464:x1830963624788480:12345-192.168.202.3@tcp:35:cat.0 Request processed in 914us (1083us total) trans 8589944884 rc 0/0 00000100:00100000:1.0:1746143832.548237:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5330 00000100:00100000:0.0:1746143832.548692:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627395968:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143832.548711:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143832.548752:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963624788224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2670us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143832.548761:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7776 00000100:00100000:0.0:1746143832.556517:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.558617:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.577521:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.597168:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.602882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.602958:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624789632 00000100:00100000:1.0:1746143832.602966:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624789632 00000100:00100000:1.0:1746143832.603017:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5331 00000100:00100000:1.0:1746143832.603023:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:16365:x1830963624789632:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143832.603229:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:16365:x1830963624789632:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 205us (350us total) trans 8589944885 rc 0/0 00000100:00100000:1.0:1746143832.603236:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5331 00000100:00100000:0.0:1746143832.612228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.612297:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624789888 00000100:00100000:1.0:1746143832.612307:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624789888 00000100:00100000:1.0:1746143832.612478:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13866 00000100:00100000:1.0:1746143832.612487:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:2476:x1830963624789888:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.612512:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.612532:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b3d43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410f14 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.612598:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612611:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612621:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612631:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612637:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612642:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612738:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b3d58 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612748:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b3d58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612754:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b3d58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143832.612762:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143832.612838:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612845:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612850:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612855:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612860:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee76400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.612863:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612870:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612881:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143832.612883:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.612887:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612892:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b3d4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612943:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612949:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612953:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612958:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b6200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.612960:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612964:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612970:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7600) 00010000:00010000:1.0:1746143832.612972:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.612974:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.612979:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6200/0x87925e4cb73b3d51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.613010:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b3d43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f14 expref: 284 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.613022:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b3d58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f14 expref: 283 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.613027:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.613030:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143832.613032:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.613037:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.613041:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6000, rc 0) 00000100:00100000:1.0:1746143832.613088:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+283:2476:x1830963624789888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 602us (863us total) trans 8589944886 rc 0/0 00000100:00100000:1.0:1746143832.613094:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13866 00000100:00100000:0.0:1746143832.613294:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624790272 00000100:00100000:0.0:1746143832.613299:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624790272 00010000:00010000:0.0:1746143832.613317:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e8f expref: 29 pid: 7245 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746143832.613334:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7777 00000100:00100000:0.0:1746143832.613339:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963624790272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143832.613347:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143832.613351:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e8f expref: 29 pid: 7245 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.613361:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e8f expref: 29 pid: 7245 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.613374:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b3c86 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e8f expref: 29 pid: 7245 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.613391:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143832.613394:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143832.613400:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143832.613405:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143832.613410:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143832.613440:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624790272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143832.613446:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7777 00000100:00100000:0.0:1746143832.615630:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.615723:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624790528 00000100:00100000:1.0:1746143832.615732:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624790528 00000100:00100000:0.0:1746143832.616042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.616061:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624790656 00000100:00100000:0.0:1746143832.616065:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624790656 00010000:00010000:0.0:1746143832.616086:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e7a expref: 283 pid: 6587 timeout: 991 lvb_type: 0 00000100:00100000:0.0:1746143832.616123:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7778 00000100:00100000:0.0:1746143832.616131:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+283:2010:x1830963624790656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143832.616143:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143832.616149:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e7a expref: 283 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.616159:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e7a expref: 283 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.616177:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b3c63 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e7a expref: 283 pid: 6587 timeout: 991 lvb_type: 0 00010000:00010000:0.0:1746143832.616191:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143832.616195:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143832.616204:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143832.616211:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143832.616235:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.616317:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13867 00000100:00100000:1.0:1746143832.616323:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2475:x1830963624790528:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.616345:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.616359:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b47bc00/0x87925e4cb73b3d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410f1b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.616458:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.616466:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616471:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.616485:0:7245:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616492:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.616535:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616542:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143832.616564:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00000004:00200000:1.0:1746143832.616568:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143832.616583:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616592:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616601:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616606:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616611:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616615:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616620:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.616622:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616629:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616638:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143832.616640:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.616643:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616648:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b3d2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616657:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616661:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616665:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616668:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143832.616670:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616675:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616680:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7600) 00010000:00010000:1.0:1746143832.616682:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143832.616684:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616688:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b3d35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.616713:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3600/0x87925e4cb73b3d27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f0d expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.616725:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f0d expref: 11 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.616733:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f0d expref: 11 pid: 10936 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.616739:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb2e00, rc 0) 00000100:00100000:0.0:1746143832.617205:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:2010:x1830963624790656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1072us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143832.617211:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7778 00000100:00100000:1.0:1746143832.617212:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2472:x1830963624789376:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 19124us (20055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.617218:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13865 00000100:00100000:1.0:1746143832.617761:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624790784 00000100:00100000:1.0:1746143832.617767:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624790784 00000100:00100000:1.0:1746143832.617792:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 961 00000100:00100000:1.0:1746143832.617797:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:2008:x1830963624790784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.617806:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.617818:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b3d58 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f14 expref: 282 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.617830:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.617834:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.617840:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.617849:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.617881:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:2008:x1830963624790784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.617887:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 961 00000100:00100000:0.0:1746143832.621703:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.621755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.621775:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624791040 00000100:00100000:1.0:1746143832.621785:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624791040 00000100:00100000:1.0:1746143832.621846:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13868 00000100:00100000:1.0:1746143832.621853:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2472:x1830963624791040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143832.621874:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.621893:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b3d74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410f22 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.622025:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.622040:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.622045:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.622063:0:10936:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143832.622072:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143832.626123:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.628104:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624791168 00000100:00100000:1.0:1746143832.628117:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624791168 00010000:00010000:1.0:1746143832.628159:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f1b expref: 30 pid: 7245 timeout: 991 lvb_type: 0 00000100:00100000:1.0:1746143832.628193:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7780 00000100:00100000:1.0:1746143832.628200:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2011:x1830963624791168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.628213:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.628222:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f1b expref: 30 pid: 7245 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.628235:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f1b expref: 30 pid: 7245 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.628258:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b3d6d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f1b expref: 30 pid: 7245 timeout: 991 lvb_type: 0 00010000:00010000:1.0:1746143832.628272:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.628277:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.628286:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.628293:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143832.628319:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.628379:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624791168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 180us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.628384:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7780 00000100:00100000:0.0:1746143832.630081:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.630110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.630148:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.631191:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16093 00000100:00100000:1.0:1746143832.631199:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624791552:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143832.631206:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.631213:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b3d97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410f37 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.631223:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.631224:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.631229:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b3d97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f37 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.631239:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b3d97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f37 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.631246:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf14000, rc 0) 00000100:00100000:1.0:1746143832.631467:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963624791552:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 268us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.631473:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16093 00000100:00100000:0.0:1746143832.631705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.634618:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624791680 00000100:00100000:1.0:1746143832.634628:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624791680 00000100:00100000:1.0:1746143832.634684:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16094 00000100:00100000:1.0:1746143832.634691:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624791680:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143832.634709:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.634725:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b3d9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410f3e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.634746:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.634748:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.634757:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b3d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f3e expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.634778:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b3d9e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f3e expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.634790:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:1.0:1746143832.634840:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963624791680:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 150us (3135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.634846:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16094 00000100:00100000:0.0:1746143832.652747:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.662515:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.663967:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624792320 00000100:00100000:1.0:1746143832.663975:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624792320 00000100:00100000:1.0:1746143832.664041:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 962 00000100:00100000:1.0:1746143832.664050:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963624792320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.664063:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.664079:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b3dba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f45 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.664108:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143832.664112:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.664148:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624792320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.664155:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 962 00000100:00100000:0.0:1746143832.770519:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.774900:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.775243:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.777895:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.790327:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.790383:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.790495:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624793344 00000100:00100000:1.0:1746143832.790502:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624793344 00010000:00010000:1.0:1746143832.790531:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 32 pid: 9839 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143832.790563:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624793600 00000100:00100000:1.0:1746143832.790565:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624793600 00010000:00010000:1.0:1746143832.790575:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b3cf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410edc expref: 33 pid: 9585 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143832.790604:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7781 00000100:00100000:1.0:1746143832.790611:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2009:x1830963624793344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.790628:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.790650:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 33 pid: 9839 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.790664:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 33 pid: 9839 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.790689:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26600/0x87925e4cb73b3c4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e6c expref: 33 pid: 9839 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.790705:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.790739:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2009:x1830963624793344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.790744:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7781 00000100:00100000:1.0:1746143832.790756:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7782 00000100:00100000:1.0:1746143832.790761:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963624793600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.790766:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.790772:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b3cf6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410edc expref: 31 pid: 9585 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143832.790779:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b3cf6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410edc expref: 31 pid: 9585 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143832.790788:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b3cf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410edc expref: 31 pid: 9585 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143832.790795:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.790816:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624793600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.790821:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7782 00000100:00100000:0.0:1746143832.793698:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.793726:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.793753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.794269:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7785 00000100:00100000:0.0:1746143832.794276:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+54:2011:x1830963624793856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143832.794283:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143832.794291:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b3cda lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ec0 expref: 54 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143832.794317:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b3cda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ec0 expref: 54 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143832.794327:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b3cda lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ec0 expref: 54 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143832.794335:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143832.794337:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143832.794342:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c47c200/0x87925e4cb73b3e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2154496->3067903) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f68 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143832.794348:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c47c200/0x87925e4cb73b3e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2154496->3067903) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f68 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143832.794372:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c47c200/0x87925e4cb73b3e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2154496->3067903) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f68 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143832.794383:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627397248:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143832.794429:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143832.799165:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.800397:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.800599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.800755:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16099 00000100:00100000:1.0:1746143832.800764:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+51:2476:x1830963624794368:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143832.800774:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143832.800786:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b3e15 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410f76 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.800807:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b3c01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e2d expref: 52 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.800815:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73b3d89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f30 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.800821:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b3c32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e50 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.800831:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.800833:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.800836:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b3e15 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1150976->2097151] (req 1150976->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f76 expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.800859:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b3c32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e50 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.800869:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b3c32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e50 expref: 29 pid: 3135 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143832.800877:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627397376:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143832.800946:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73b3d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f30 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143832.800953:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d800/0x87925e4cb73b3d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f30 expref: 8 pid: 3135 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143832.800960:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627397504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143832.800981:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b3c01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e2d expref: 52 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.800988:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b3c01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410e2d expref: 52 pid: 13436 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143832.800999:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627397632:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143832.801015:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.807720:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627397376:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143832.807733:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627397504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143832.807741:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627397632:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143832.807773:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b3e15 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1150976->2097151] (req 1150976->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f76 expref: 52 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.807791:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:1.0:1746143832.807843:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+52:2476:x1830963624794368:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7079us (7243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.807852:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16099 00000100:00100000:0.0:1746143832.811459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.811503:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.811519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.811545:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.815747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.821964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.822001:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.822060:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.832016:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.838833:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.838874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.839118:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6963 00000100:00100000:1.0:1746143832.839133:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624796288:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143832.840629:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.841496:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.847259:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624796288:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8124us (8427us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143832.847287:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6963 00002000:00100000:1.0:1746143832.847297:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c33800 x1830963624796288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/440 e 0 to 0 dl 1746143843 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.847307:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963624796288 ext(1048576->2097151) 00002000:00010000:1.0:1746143832.847321:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c33800 00000100:00100000:0.0:1746143832.851000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.851054:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:0.0:1746143832.862622:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873872 is committed 00000001:00080000:0.0:1746143832.862631:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873871 is committed 00000001:00080000:0.0:1746143832.862658:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873863 is committed 00000100:00100000:0.0:1746143832.863093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.864532:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.871625:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.871668:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.885966:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624797952 00000100:00100000:1.0:1746143832.885977:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624797952 00002000:00100000:1.0:1746143832.886012:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2187264->2191359) req@ffff8801373b9c00 x1830963624797952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/0 e 0 to 0 dl 1746143843 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.886021:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963624797952 ext(2187264->2191359) 00010000:00010000:1.0:1746143832.886028:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 27 pid: 12327 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.886038:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 27 pid: 12327 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746143832.886044:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801373b9c00 00000100:00100000:1.0:1746143832.886062:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2590 00000100:00100000:1.0:1746143832.886069:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624797952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143832.886171:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624797952:12345-192.168.202.3@tcp:3:cat.0 Request processed in 96us (975us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143832.886178:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2590 00002000:00100000:1.0:1746143832.886183:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2187264->2191359) req@ffff8801373b9c00 x1830963624797952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/4536 e 0 to 0 dl 1746143843 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.886189:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963624797952 ext(2187264->2191359) 00010000:00010000:1.0:1746143832.886193:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 27 pid: 12327 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.886204:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 27 pid: 12327 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746143832.886210:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801373b9c00 00000100:00100000:0.0:1746143832.890965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.891004:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.894142:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.896397:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.896866:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7792 00000100:00100000:1.0:1746143832.896873:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963624798720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143832.896882:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143832.896897:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 28 pid: 12327 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.896907:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 28 pid: 12327 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.896938:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7000/0x87925e4cb73b3e2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2191359) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f8b expref: 28 pid: 12327 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143832.896951:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.896953:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143832.896958:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b3e3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fa0 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.896965:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b3e3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fa0 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143832.896987:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b3e3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fa0 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143832.896997:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627399040:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143832.897033:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338a5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143832.900447:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627399040:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143832.900463:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143832.900495:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624798720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3622us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143832.900503:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7792 00000100:00100000:0.0:1746143832.901433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.918114:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.918148:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.918320:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6968 00000100:00100000:0.0:1746143832.918330:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624799488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143832.924449:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.935862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.936175:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624799872 00000100:00100000:1.0:1746143832.936183:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624799872 00002000:00100000:1.0:1746143832.936219:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009322dc00 x1830963624799872/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:228/0 lens 488/0 e 0 to 0 dl 1746143843 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.936228:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322dc00 with x1830963624799872 ext(2097152->4194303) 00002000:00010000:1.0:1746143832.936232:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322dc00 00000100:00100000:1.0:1746143832.936263:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6969 00000100:00100000:1.0:1746143832.936270:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963624799872:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143832.947965:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963624799872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11686us (12101us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143832.947979:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6969 00002000:00100000:1.0:1746143832.947992:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009322dc00 x1830963624799872/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:228/0 lens 488/440 e 0 to 0 dl 1746143843 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.948001:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322dc00 with x1830963624799872 ext(2097152->4194303) 00002000:00010000:1.0:1746143832.948006:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322dc00 00000100:00100000:0.0:1746143832.948610:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.955115:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143832.955188:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624800256 00000100:00100000:1.0:1746143832.955197:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624800256 00002000:00100000:1.0:1746143832.955237:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88009322fb80 x1830963624800256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/0 e 0 to 0 dl 1746143843 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.955247:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322fb80 with x1830963624800256 ext(4194304->4808703) 00002000:00010000:1.0:1746143832.955252:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322fb80 00000100:00100000:1.0:1746143832.955281:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6970 00000100:00100000:1.0:1746143832.955288:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624800256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143832.959652:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624800256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4357us (4540us total) trans 0 rc 614400/614400 00000100:00100000:1.0:1746143832.959662:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6970 00002000:00100000:1.0:1746143832.959671:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88009322fb80 x1830963624800256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:228/0 lens 488/440 e 0 to 0 dl 1746143843 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143832.959679:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322fb80 with x1830963624800256 ext(4194304->4808703) 00002000:00010000:1.0:1746143832.959684:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322fb80 00000100:00100000:1.0:1746143832.959851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143832.966345:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.053181:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143833.054437:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143833.056283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.056595:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624801152 00000100:00100000:1.0:1746143833.056601:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624801152 00010000:00010000:1.0:1746143833.056634:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f22 expref: 13 pid: 10936 timeout: 992 lvb_type: 0 00000100:00080000:0.0:1746143833.056936:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143833.056964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.057353:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624801280 00000100:00100000:1.0:1746143833.057357:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624801280 00010000:00010000:1.0:1746143833.057375:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d200/0x87925e4cb73b3deb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f53 expref: 285 pid: 10936 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.057391:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7793 00000100:00100000:1.0:1746143833.057397:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624801152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.057407:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.057418:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f22 expref: 13 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.057426:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f22 expref: 13 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.057443:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b3d7b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f22 expref: 13 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.057457:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143833.057461:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143833.057467:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143833.057471:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.057501:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624801152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.057507:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7793 00000100:00100000:1.0:1746143833.057519:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7794 00000100:00100000:1.0:1746143833.057523:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963624801280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.057529:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.057532:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d200/0x87925e4cb73b3deb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f53 expref: 285 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.057544:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d200/0x87925e4cb73b3deb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f53 expref: 285 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.057554:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d7d200/0x87925e4cb73b3deb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f53 expref: 285 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.057561:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143833.057564:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143833.057570:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143833.057575:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143833.057588:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.057601:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963624801280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.057606:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7794 00010000:00010000:1.0:1746143833.057698:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143833.057703:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143833.057718:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 8999296 00010000:00010000:1.0:1746143833.057810:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b3e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fb5 expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.057826:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b3e5b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fb5 expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.057831:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143833.057833:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143833.057835:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:1.0:1746143833.057852:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2490:x1830963624801024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4529us (4679us total) trans 8589944895 rc 0/0 00000100:00100000:1.0:1746143833.057858:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13872 00000100:00080000:0.0:1746143833.058045:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143833.093536:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.105306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.109740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143833.110751:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143833.125328:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.131043:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.131286:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.143424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.152602:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.155645:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.159806:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.164687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.169244:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.186196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.197687:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.202799:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.204493:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624804096 00000100:00100000:1.0:1746143833.204505:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624804096 00002000:00100000:1.0:1746143833.204559:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3514367) req@ffff88009e490e00 x1830963624804096/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.204569:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490e00 with x1830963624804096 ext(3145728->3514367) 00010000:00010000:1.0:1746143833.204579:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3eaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3514367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fca expref: 28 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.204595:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3eaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3514367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fca expref: 28 pid: 3135 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746143833.204602:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e490e00 00000100:00100000:1.0:1746143833.204650:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2592 00000100:00100000:1.0:1746143833.204659:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624804096:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143833.210948:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624804096:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6283us (8142us total) trans 17179873875 rc 0/0 00000100:00100000:1.0:1746143833.210958:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2592 00002000:00100000:1.0:1746143833.210968:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3514367) req@ffff88009e490e00 x1830963624804096/t17179873875(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/448 e 0 to 0 dl 1746143844 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.210977:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490e00 with x1830963624804096 ext(3145728->3514367) 00010000:00010000:1.0:1746143833.210986:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3eaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3514367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fca expref: 30 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.210997:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3eaf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3514367) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fca expref: 30 pid: 3135 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746143833.211003:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e490e00 00000100:00100000:1.0:1746143833.211663:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.211718:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.211769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.211795:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624804480 00000100:00100000:1.0:1746143833.211798:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624804480 00010000:00010000:1.0:1746143833.212170:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73b3896 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c6d expref: 30 pid: 9586 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143833.212188:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7798 00000100:00100000:1.0:1746143833.212193:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624804480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.212203:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.212219:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73b3896 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c6d expref: 30 pid: 9586 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143833.212228:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73b3896 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c6d expref: 30 pid: 9586 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143833.212399:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010200/0x87925e4cb73b3896 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c6d expref: 30 pid: 9586 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143833.212427:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.212673:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624804480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 478us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.212680:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7798 00000100:00100000:0.0:1746143833.214401:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.215177:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.215241:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624804992 00000100:00100000:1.0:1746143833.215245:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624804992 00002000:00100000:1.0:1746143833.215277:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (151552->155647) req@ffff88009e493480 x1830963624804992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.215285:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493480 with x1830963624804992 ext(151552->155647) 00002000:00010000:1.0:1746143833.215289:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493480 00000100:00100000:1.0:1746143833.215305:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6975 00000100:00100000:1.0:1746143833.215310:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624804992:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143833.215427:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624804992:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 116us (249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143833.215433:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6975 00002000:00100000:1.0:1746143833.215438:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (151552->155647) req@ffff88009e493480 x1830963624804992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.215445:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493480 with x1830963624804992 ext(151552->155647) 00002000:00010000:1.0:1746143833.215448:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493480 00000100:00100000:0.0:1746143833.226101:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.227849:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624805248 00000100:00100000:1.0:1746143833.227862:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624805248 00002000:00100000:1.0:1746143833.227926:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009e493100 x1830963624805248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.227937:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493100 with x1830963624805248 ext(2097152->4194303) 00002000:00010000:1.0:1746143833.227943:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493100 00000100:00100000:1.0:1746143833.227976:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6976 00000100:00100000:1.0:1746143833.227984:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624805248:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143833.234060:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.237958:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.240391:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.240582:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624805248:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12597us (14493us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143833.240592:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6976 00002000:00100000:1.0:1746143833.240600:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009e493100 x1830963624805248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.240609:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493100 with x1830963624805248 ext(2097152->4194303) 00002000:00010000:1.0:1746143833.240613:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493100 00000100:00100000:0.0:1746143833.241015:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143833.241154:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143833.247482:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.247567:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624806016 00000100:00100000:1.0:1746143833.247578:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624806016 00002000:00100000:1.0:1746143833.247635:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88007f649f80 x1830963624806016/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.247645:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963624806016 ext(4194304->4808703) 00002000:00010000:1.0:1746143833.247651:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649f80 00000100:00100000:1.0:1746143833.247731:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6977 00000100:00100000:1.0:1746143833.247740:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624806016:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143833.250478:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.253766:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624806016:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6015us (6282us total) trans 0 rc 614400/614400 00000100:00100000:1.0:1746143833.253779:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6977 00002000:00100000:1.0:1746143833.253792:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4808703) req@ffff88007f649f80 x1830963624806016/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 614400/614400 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.253802:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963624806016 ext(4194304->4808703) 00002000:00010000:1.0:1746143833.253809:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649f80 00000100:00100000:0.0:1746143833.353397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.358261:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.359125:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.359149:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.359170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.359189:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624806784 00000100:00100000:0.0:1746143833.359193:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624806784 00000100:00100000:0.0:1746143833.359222:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624806912 00000100:00100000:0.0:1746143833.359224:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624806912 00000100:00100000:0.0:1746143833.359235:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624807040 00000100:00100000:0.0:1746143833.359236:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624807040 00000100:00100000:0.0:1746143833.359246:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16113 00000100:00100000:0.0:1746143833.359250:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624806784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143833.359264:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143833.359277:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e505400/0x87925e4cb73b3ef5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410ff4 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143833.359330:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627401216:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143833.359405:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.359476:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16114 00000100:00100000:0.0:1746143833.359481:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963624806912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143833.359489:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143833.359504:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096b24c00/0x87925e4cb73b3efc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248410ffb expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143833.359527:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627401344:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143833.362558:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00002000:00010000:1.0:1746143833.363304:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143831 -> 1746143833 00002000:00010000:1.0:1746143833.363307:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143831 -> 1746143833 00002000:00010000:1.0:1746143833.363309:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143831 -> 1746143833 00000100:00100000:1.0:1746143833.363320:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627401344:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143833.363338:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096b24c00/0x87925e4cb73b3efc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ffb expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.363347:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096b24c00/0x87925e4cb73b3efc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ffb expref: 25 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.363359:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096b24c00, rc 0) 00000100:00100000:1.0:1746143833.363379:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963624806912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3898us (4228us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143833.363385:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16114 00000100:00100000:0.0:1746143833.369220:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.369348:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624807168 00000100:00100000:1.0:1746143833.369359:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624807168 00000100:00100000:1.0:1746143833.369641:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16116 00000100:00100000:1.0:1746143833.369650:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2505:x1830963624807168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143833.369671:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143833.369688:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73b3f0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411009 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.369717:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.369725:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143833.369726:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143833.369730:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73b3f0a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411009 expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.369763:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.369775:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 7 pid: 3135 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.369787:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627401472:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143833.369886:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143833.371119:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627401472:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143833.371141:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2a00/0x87925e4cb73b3f0a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411009 expref: 30 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.371153:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2a00, rc 0) 00000100:00100000:1.0:1746143833.371182:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2505:x1830963624807168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1533us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.371193:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16116 00000100:00100000:0.0:1746143833.371593:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.371838:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624807296 00000100:00100000:1.0:1746143833.371844:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624807296 00002000:00100000:1.0:1746143833.371877:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (151552->1048575) req@ffff88007f64b100 x1830963624807296/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.371886:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b100 with x1830963624807296 ext(151552->1048575) 00010000:00010000:1.0:1746143833.371893:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 8 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.371905:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 8 pid: 3135 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746143833.371936:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f64b100 00000100:00100000:1.0:1746143833.371953:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2593 00000100:00100000:1.0:1746143833.371961:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624807296:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143833.381563:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624807296:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9589us (9957us total) trans 17179873876 rc 0/0 00000100:00100000:1.0:1746143833.381577:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2593 00002000:00100000:1.0:1746143833.381590:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (151552->1048575) req@ffff88007f64b100 x1830963624807296/t17179873876(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/448 e 0 to 0 dl 1746143844 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.381599:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b100 with x1830963624807296 ext(151552->1048575) 00010000:00010000:1.0:1746143833.381611:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 10 pid: 3135 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.381708:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6200/0x87925e4cb73b3ec4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 151552->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fdf expref: 10 pid: 3135 timeout: 992 lvb_type: 0 00002000:00010000:1.0:1746143833.381716:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f64b100 00000100:00100000:0.0:1746143833.390321:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.394870:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.397842:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.399577:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.399606:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.400273:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624808192 00000100:00100000:1.0:1746143833.400277:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624808192 00002000:00100000:1.0:1746143833.400303:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129dc1f80 x1830963624808192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.400312:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1f80 with x1830963624808192 ext(0->1048575) 00002000:00010000:1.0:1746143833.400317:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1f80 00000100:00100000:1.0:1746143833.400329:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6979 00000100:00100000:1.0:1746143833.400333:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963624808192:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143833.406778:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.406821:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.406851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.406879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.406907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.407363:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624808448 00000100:00100000:0.0:1746143833.407450:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624808448 00000100:00100000:0.0:1746143833.407474:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16118 00000100:00100000:0.0:1746143833.407479:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624808576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143833.407487:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143833.407499:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841102c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143833.407511:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143833.407513:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143833.407518:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841102c expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143833.407529:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841102c expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143833.407536:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00000100:00100000:0.0:1746143833.407578:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624808576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 97us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143833.407584:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16118 00000100:00100000:0.0:1746143833.407602:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16119 00000100:00100000:0.0:1746143833.407606:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624808704:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143833.407613:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143833.407620:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411033 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143833.407699:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143833.407700:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143833.407705:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411033 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143833.407720:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411033 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143833.407726:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:1.0:1746143833.408009:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16121 00000100:00100000:1.0:1746143833.408017:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624808448:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143833.408024:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143833.408036:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3f6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411025 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.408090:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627401856:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143833.408211:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.408446:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624808704:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 837us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143833.408452:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16119 00000100:00100000:1.0:1746143833.409168:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963624808192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8832us (9559us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143833.409176:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6979 00002000:00100000:1.0:1746143833.409185:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129dc1f80 x1830963624808192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.409195:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1f80 with x1830963624808192 ext(0->1048575) 00002000:00010000:1.0:1746143833.409199:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1f80 00000100:00100000:1.0:1746143833.411691:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627401856:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143833.411729:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3f6c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411025 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.411743:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b3f6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411025 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.411798:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:1.0:1746143833.411954:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624808448:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3936us (5131us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143833.411962:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16121 00000100:00100000:0.0:1746143833.415276:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.418397:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.418507:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624809216 00000100:00100000:1.0:1746143833.418516:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624809216 00000100:00100000:1.0:1746143833.418562:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16122 00000100:00100000:1.0:1746143833.418570:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+24:2505:x1830963624809216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143833.418587:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143833.418604:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73b3f81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411048 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.418633:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b3ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fe6 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.418641:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143833.418644:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143833.418647:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73b3f81 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411048 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.418674:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b3ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fe6 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.418684:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b3ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fe6 expref: 9 pid: 3135 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.418695:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627402240:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143833.418788:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.423739:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.424314:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627402240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143833.424346:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73b3f81 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411048 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.424363:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:1.0:1746143833.424394:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2505:x1830963624809216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5824us (6005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.424402:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16122 00000100:00100000:0.0:1746143833.428802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.428863:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624809728 00000100:00100000:1.0:1746143833.428869:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624809728 00000100:00100000:1.0:1746143833.428898:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16123 00000100:00100000:1.0:1746143833.428903:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2507:x1830963624809728:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143833.428933:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143833.428949:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b3f8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841104f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.428980:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b3ebd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fd8 expref: 10 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.428988:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3f65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841103a expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.428994:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b3f03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411002 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.429000:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.429001:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.429005:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b3f8f lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3661824->4194303] (req 3661824->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841104f expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.429032:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b3f03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411002 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.429041:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7200/0x87925e4cb73b3f03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411002 expref: 29 pid: 3135 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143833.429052:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627402368:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143833.429130:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841103a expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.429138:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841103a expref: 9 pid: 1947 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143833.429150:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627402496:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143833.429175:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b3ebd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fd8 expref: 10 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.429183:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b3ebd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410fd8 expref: 10 pid: 3135 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.429191:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627402624:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143833.429208:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.435489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.435549:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.435594:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.441468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.441519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.442950:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.451070:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.453785:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.456135:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.457282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.457346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.465762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.465851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.467224:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.467331:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624811776 00000100:00100000:1.0:1746143833.467336:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624811776 00010000:00010000:1.0:1746143833.467352:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73b3df9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f61 expref: 27 pid: 12327 timeout: 992 lvb_type: 1 00000100:00100000:1.0:1746143833.467381:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7815 00000100:00100000:1.0:1746143833.467387:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624811776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.467394:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.467402:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73b3df9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f61 expref: 27 pid: 12327 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143833.467423:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73b3df9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f61 expref: 27 pid: 12327 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143833.467436:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c400/0x87925e4cb73b3df9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f61 expref: 27 pid: 12327 timeout: 992 lvb_type: 1 00010000:00010000:1.0:1746143833.467464:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.467466:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.467473:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.467479:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.467506:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 10 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.467517:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627403648:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.467580:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143833.475659:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627403648:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.475682:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.475710:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624811776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8322us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.475720:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7815 00000100:00100000:0.0:1746143833.476200:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.479110:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.488479:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.488562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.493430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.493475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.493488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.493519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.493534:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624813184 00000100:00100000:1.0:1746143833.493536:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624813184 00000100:00100000:1.0:1746143833.493553:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624813312 00000100:00100000:1.0:1746143833.493554:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624813312 00000100:00100000:1.0:1746143833.493567:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16129 00000100:00100000:1.0:1746143833.493571:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624813184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143833.493579:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143833.493588:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b3fd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411087 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.493600:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.493602:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.493610:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b3fd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411087 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.493624:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b3fd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411087 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143833.493632:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:1.0:1746143833.493647:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624813184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.493652:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16129 00000100:00100000:0.0:1746143833.508086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.508121:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.508160:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.508238:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624813696 00000100:00100000:1.0:1746143833.508247:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624813696 00002000:00100000:1.0:1746143833.508281:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880095e31180 x1830963624813696/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.508290:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963624813696 ext(0->1048575) 00002000:00010000:1.0:1746143833.508294:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:1.0:1746143833.508311:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624813952 00000100:00100000:1.0:1746143833.508314:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624813952 00002000:00100000:1.0:1746143833.508326:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88012d841880 x1830963624813952/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.508338:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841880 with x1830963624813952 ext(1048576->2097151) 00002000:00010000:1.0:1746143833.508341:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d841880 00000100:00100000:1.0:1746143833.508354:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6983 00000100:00100000:1.0:1746143833.508360:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624813696:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143833.511203:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143833.511223:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627404160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746143833.511745:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143833.512394:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627404160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143833.514813:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.517789:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624813696:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9422us (9661us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143833.517799:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6983 00002000:00100000:1.0:1746143833.517809:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880095e31180 x1830963624813696/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.517817:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963624813696 ext(0->1048575) 00002000:00010000:1.0:1746143833.517821:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:0.0:1746143833.527250:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.527471:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624814208 00000100:00100000:1.0:1746143833.527479:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624814208 00010000:00010000:1.0:1746143833.527507:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b3f8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841104f expref: 12 pid: 9585 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.528234:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7816 00000100:00100000:1.0:1746143833.528243:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624814208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.528255:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.528273:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b3f8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841104f expref: 12 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.528283:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b3f8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841104f expref: 12 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.528302:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b3f8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841104f expref: 12 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.528332:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.528334:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.528341:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.528348:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.528375:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.528385:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627404288:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.528465:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.528725:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.533699:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627404288:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.533715:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.533761:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624814208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5518us (6518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.533768:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7816 00000100:00100000:0.0:1746143833.539637:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.541035:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.551708:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.551783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.552295:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624815488 00000100:00100000:1.0:1746143833.552299:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624815488 00010000:00010000:1.0:1746143833.552317:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 31 pid: 13436 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.552346:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7817 00000100:00100000:1.0:1746143833.552351:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963624815488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.552360:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.552375:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 31 pid: 13436 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.552383:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 31 pid: 13436 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.552397:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b3fe3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411095 expref: 31 pid: 13436 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.552431:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.552432:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.552438:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.552444:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.552465:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.552477:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627404672:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.552500:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.554722:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.554926:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627404672:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.554942:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.554972:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963624815488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2619us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.554979:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7817 00000100:00100000:0.0:1746143833.555563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.558098:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.563861:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.563902:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.563958:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.563980:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624816512 00000100:00100000:0.0:1746143833.563986:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624816512 00000100:00100000:0.0:1746143833.564045:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16136 00000100:00100000:0.0:1746143833.564051:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2509:x1830963624816512:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143833.564066:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143833.564080:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484110b8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143833.564101:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143833.564103:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143833.564108:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->3612671] (req 3145728->3612671) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143833.564117:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->3612671] (req 3145728->3612671) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143833.564126:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97400, rc 0) 00000100:00100000:0.0:1746143833.564172:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2509:x1830963624816512:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143833.564178:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16136 00000100:00100000:1.0:1746143833.565233:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624816256 00000100:00100000:1.0:1746143833.565238:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624816256 00010000:00010000:1.0:1746143833.565253:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 14 pid: 9585 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.565269:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7818 00000100:00100000:1.0:1746143833.565274:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963624816256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.565281:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.565293:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 14 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.565301:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 14 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.565316:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b3fa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841105d expref: 14 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.566086:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.566088:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.566095:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73b3ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110aa expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.566104:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73b3ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110aa expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.566111:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.566112:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.566115:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.566123:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.566146:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.566157:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627404928:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.566605:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73b3ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110aa expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.566614:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627405056:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.566633:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.570257:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.571110:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627404928:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.571119:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627405056:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.571135:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.571160:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624816256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5885us (7306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.571168:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7818 00000100:00100000:0.0:1746143833.577851:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.579196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.579338:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624817152 00000100:00100000:1.0:1746143833.579346:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624817152 00010000:00010000:1.0:1746143833.579374:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 32 pid: 13436 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.580164:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7819 00000100:00100000:1.0:1746143833.580169:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624817152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.580178:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.580191:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 32 pid: 13436 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.580201:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 32 pid: 13436 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.580289:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b3fea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3846144->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841109c expref: 32 pid: 13436 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.580313:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.580315:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.580321:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b3fff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b1 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.580332:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b3fff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b1 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.580363:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b3fff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b1 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.580373:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627405184:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.580437:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143833.582237:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627405184:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.582252:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.582275:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963624817152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2106us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.582281:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7819 00000100:00100000:0.0:1746143833.584766:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.584807:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.584847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.585042:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624817408 00000100:00100000:0.0:1746143833.585045:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624817408 00002000:00100000:0.0:1746143833.585069:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093415880 x1830963624817408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143833.585076:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415880 with x1830963624817408 ext(3145728->4194303) 00002000:00010000:0.0:1746143833.585081:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415880 00000100:00100000:0.0:1746143833.585092:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6990 00000100:00100000:0.0:1746143833.585097:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963624817408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143833.590794:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.590864:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.590937:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624818048 00000100:00100000:1.0:1746143833.590944:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624818048 00002000:00100000:1.0:1746143833.590978:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093415500 x1830963624818048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.590987:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415500 with x1830963624818048 ext(3145728->4194303) 00002000:00010000:1.0:1746143833.590991:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415500 00000100:00100000:1.0:1746143833.591005:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624818304 00000100:00100000:1.0:1746143833.591007:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624818304 00002000:00100000:1.0:1746143833.591018:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3612672->4194303) req@ffff88009322df80 x1830963624818304/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.591025:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322df80 with x1830963624818304 ext(3612672->4194303) 00002000:00010000:1.0:1746143833.591028:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322df80 00000100:00100000:1.0:1746143833.591039:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6991 00000100:00100000:1.0:1746143833.591045:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624818048:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143833.598888:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624818048:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7839us (8096us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143833.598897:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6991 00002000:00100000:1.0:1746143833.598903:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093415500 x1830963624818048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.598926:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415500 with x1830963624818048 ext(3145728->4194303) 00002000:00010000:1.0:1746143833.598931:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415500 00000100:00100000:0.0:1746143833.606425:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.606569:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.610159:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.615294:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.618005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.618743:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624819072 00000100:00100000:1.0:1746143833.618751:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624819072 00010000:00010000:1.0:1746143833.618781:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 28 pid: 9585 timeout: 992 lvb_type: 0 00000100:00100000:1.0:1746143833.618985:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7820 00000100:00100000:1.0:1746143833.618995:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624819072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143833.619006:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143833.619033:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 28 pid: 9585 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746143833.619431:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143833.619889:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 28 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.619906:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b4006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110b8 expref: 28 pid: 9585 timeout: 992 lvb_type: 0 00010000:00010000:1.0:1746143833.619936:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.619939:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143833.619944:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x87925e4cb73b401b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110c6 expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.619952:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x87925e4cb73b401b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110c6 expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.619973:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x87925e4cb73b401b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484110c6 expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143833.619984:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627405696:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143833.620035:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143833.622986:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.623428:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627405696:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143833.623442:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143833.623457:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624819072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4464us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.623462:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7820 00000100:00100000:0.0:1746143833.624457:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.628105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.637023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.637063:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.637104:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.647282:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.648303:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.651037:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.651118:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624821376 00000100:00100000:1.0:1746143833.651124:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624821376 00002000:00100000:1.0:1746143833.651155:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3796992->3801087) req@ffff880093cf9f80 x1830963624821376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.651164:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9f80 with x1830963624821376 ext(3796992->3801087) 00002000:00010000:1.0:1746143833.651168:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9f80 00000100:00100000:1.0:1746143833.651195:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6997 00000100:00100000:1.0:1746143833.651202:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963624821376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143833.651299:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963624821376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 97us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143833.651304:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6997 00002000:00100000:1.0:1746143833.651309:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3796992->3801087) req@ffff880093cf9f80 x1830963624821376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/4536 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.651315:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9f80 with x1830963624821376 ext(3796992->3801087) 00002000:00010000:1.0:1746143833.651317:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9f80 00000100:00100000:0.0:1746143833.655530:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.718603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.719497:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.721162:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.722497:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.722552:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.722579:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624822272 00000100:00100000:0.0:1746143833.722583:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624822272 00000100:00100000:0.0:1746143833.722605:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624822400 00000100:00100000:0.0:1746143833.722606:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624822400 00010000:00010000:0.0:1746143833.722615:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048400/0x87925e4cb73b4029 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110d4 expref: 35 pid: 10936 timeout: 992 lvb_type: 0 00000100:00100000:0.0:1746143833.722863:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7824 00000100:00100000:0.0:1746143833.722869:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2009:x1830963624822400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143833.722878:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143833.722883:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082048400/0x87925e4cb73b4029 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110d4 expref: 35 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143833.722891:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082048400/0x87925e4cb73b4029 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110d4 expref: 35 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143833.723025:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048400/0x87925e4cb73b4029 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110d4 expref: 35 pid: 10936 timeout: 992 lvb_type: 0 00010000:00010000:0.0:1746143833.723114:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143833.723117:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143833.723142:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963624822400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 273us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143833.723156:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7824 00000100:00100000:0.0:1746143833.726445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.726491:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.736001:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.741276:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.745804:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.753079:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.764442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.774452:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.777468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.780110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.786527:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.824003:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.839290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.843278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.844212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.849832:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.853650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.859096:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.859147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.860800:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624825600 00000100:00100000:1.0:1746143833.860804:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624825600 00002000:00100000:1.0:1746143833.860829:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3989504->4194303) req@ffff880087df6680 x1830963624825600/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.861083:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df6680 with x1830963624825600 ext(3989504->4194303) 00010000:00010000:1.0:1746143833.861090:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841113d expref: 29 pid: 12327 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143833.861098:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841113d expref: 29 pid: 12327 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143833.861104:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df6680 00000100:00100000:1.0:1746143833.861119:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2602 00000100:00100000:1.0:1746143833.861125:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624825600:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143833.865107:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.865148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.869544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.877444:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963624825600:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 16306us (18283us total) trans 21474841153 rc 0/0 00000100:00100000:1.0:1746143833.877457:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2602 00002000:00100000:1.0:1746143833.877470:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3989504->4194303) req@ffff880087df6680 x1830963624825600/t21474841153(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/448 e 0 to 0 dl 1746143844 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.877479:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df6680 with x1830963624825600 ext(3989504->4194303) 00010000:00010000:1.0:1746143833.877490:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841113d expref: 31 pid: 12327 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143833.877507:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3989504->18446744073709551615] (req 3989504->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841113d expref: 31 pid: 12327 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143833.877514:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df6680 00000100:00100000:0.0:1746143833.879498:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.879610:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624826368 00000100:00100000:1.0:1746143833.879619:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624826368 00000100:00100000:1.0:1746143833.879671:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5345 00000100:00100000:1.0:1746143833.879679:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+295:2524:x1830963624826368:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143833.879984:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+296:2524:x1830963624826368:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 305us (492us total) trans 8589944913 rc 0/0 00000100:00100000:1.0:1746143833.879991:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5345 00000100:00100000:0.0:1746143833.884254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.884302:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.891945:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.891969:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.892006:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.892162:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624827008 00000100:00100000:1.0:1746143833.892167:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624827008 00010000:00010000:1.0:1746143833.892184:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048400/0x87925e4cb73b40ed lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841112f expref: 296 pid: 6587 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143833.893090:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624827264 00000100:00100000:1.0:1746143833.893098:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624827264 00002000:00100000:1.0:1746143833.893130:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88011e308380 x1830963624827264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.893599:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308380 with x1830963624827264 ext(3145728->4194303) 00002000:00010000:1.0:1746143833.893603:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e308380 00000100:00100000:1.0:1746143833.893725:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6999 00000100:00100000:1.0:1746143833.893732:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624827264:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143833.904901:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.904965:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.905382:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624827264:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11650us (13375us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143833.905390:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6999 00002000:00100000:1.0:1746143833.905397:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88011e308380 x1830963624827264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.905415:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308380 with x1830963624827264 ext(3145728->4194303) 00002000:00010000:1.0:1746143833.905418:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e308380 00000100:00100000:0.0:1746143833.910585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.919897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.921655:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.921930:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624828032 00000100:00100000:1.0:1746143833.921935:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624828032 00002000:00100000:1.0:1746143833.921965:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880095c3a300 x1830963624828032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.921973:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a300 with x1830963624828032 ext(2097152->3145727) 00002000:00010000:1.0:1746143833.921977:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3a300 00000100:00100000:1.0:1746143833.922004:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7000 00000100:00100000:1.0:1746143833.922011:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963624828032:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143833.928392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.932163:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963624828032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10145us (10502us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143833.932173:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7000 00002000:00100000:1.0:1746143833.932184:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880095c3a300 x1830963624828032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.932192:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a300 with x1830963624828032 ext(2097152->3145727) 00002000:00010000:1.0:1746143833.932197:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3a300 00000100:00100000:0.0:1746143833.937852:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.940085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.950111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.952381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.952606:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624829056 00000100:00100000:1.0:1746143833.952611:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624829056 00002000:00100000:1.0:1746143833.952637:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095c3b800 x1830963624829056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.952645:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b800 with x1830963624829056 ext(3145728->4194303) 00002000:00010000:1.0:1746143833.952649:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b800 00000100:00100000:1.0:1746143833.952673:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7001 00000100:00100000:1.0:1746143833.952679:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624829056:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143833.956383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.964725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.965101:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624829056:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12420us (12719us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143833.965111:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7001 00002000:00100000:1.0:1746143833.965120:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095c3b800 x1830963624829056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:229/0 lens 488/440 e 0 to 0 dl 1746143844 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.965128:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b800 with x1830963624829056 ext(3145728->4194303) 00002000:00010000:1.0:1746143833.965133:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b800 00000100:00100000:0.0:1746143833.970338:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.972660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.978667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.986010:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143833.986061:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.986188:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624830208 00000100:00100000:1.0:1746143833.986198:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624830208 00000100:00100000:1.0:1746143833.986260:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16159 00000100:00100000:1.0:1746143833.986268:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2530:x1830963624830208:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143833.986288:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143833.986307:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411191 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.986340:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.986348:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143833.986350:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143833.986353:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->4386815] (req 4194304->4386815) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.986387:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 31 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.986398:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 31 pid: 9586 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143833.986423:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627409536:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143833.986501:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143833.994070:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627409536:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143833.994103:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->4386815] (req 4194304->4386815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143833.994119:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136800, rc 0) 00000100:00100000:1.0:1746143833.994161:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2530:x1830963624830208:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7894us (8099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143833.994168:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16159 00000100:00100000:1.0:1746143833.994232:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143833.994273:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624830336 00000100:00100000:1.0:1746143833.994279:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624830336 00002000:00100000:1.0:1746143833.994311:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4851231) req@ffff880129dc2a00 x1830963624830336/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/0 e 0 to 0 dl 1746143844 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143833.994318:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2a00 with x1830963624830336 ext(4194304->4851231) 00010000:00010000:1.0:1746143833.994324:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 32 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143833.994332:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 32 pid: 9586 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143833.994336:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc2a00 00000100:00100000:1.0:1746143833.994359:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2606 00000100:00100000:1.0:1746143833.994364:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624830336:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143834.005691:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.006834:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624830336:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12468us (12599us total) trans 17179873879 rc 0/0 00000100:00100000:1.0:1746143834.006845:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2606 00002000:00100000:1.0:1746143834.006854:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4851231) req@ffff880129dc2a00 x1830963624830336/t17179873879(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:229/0 lens 488/448 e 0 to 0 dl 1746143844 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.006863:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2a00 with x1830963624830336 ext(4194304->4851231) 00010000:00010000:1.0:1746143834.006870:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 34 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.006881:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 34 pid: 9586 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143834.006887:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129dc2a00 00000100:00100000:0.0:1746143834.010271:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627409664:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143834.010291:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143834.010348:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963624830464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4346us (4664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143834.010358:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7836 00000100:00100000:0.0:1746143834.010387:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624830592 00000100:00100000:0.0:1746143834.010393:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624830592 00010000:00010000:0.0:1746143834.010432:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 34 pid: 9586 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143834.010465:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7837 00000100:00100000:0.0:1746143834.010472:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624830592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143834.010484:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143834.010502:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5304 -> 5392 00010000:00010000:0.0:1746143834.010508:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 34 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.010518:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 34 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.010541:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x87925e4cb73b4110 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841114b expref: 34 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.010574:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143834.010577:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143834.010584:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.010591:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.010625:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143834.010636:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627409792:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143834.010689:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.015229:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624830848 00000100:00100000:1.0:1746143834.015240:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624830848 00002000:00100000:1.0:1746143834.015295:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8801373baa00 x1830963624830848/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.015304:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373baa00 with x1830963624830848 ext(3145728->4194303) 00002000:00010000:1.0:1746143834.015310:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373baa00 00000100:00100000:1.0:1746143834.015343:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7002 00000100:00100000:1.0:1746143834.015351:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624830848:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143834.015357:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627409792:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143834.015381:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143834.015442:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624830592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4970us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143834.015450:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7837 00000100:00100000:0.0:1746143834.016089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143834.016658:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143834.022477:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624830848:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7119us (7303us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143834.022488:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7002 00002000:00100000:1.0:1746143834.022498:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8801373baa00 x1830963624830848/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.022506:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373baa00 with x1830963624830848 ext(3145728->4194303) 00002000:00010000:1.0:1746143834.022511:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373baa00 00000100:00100000:0.0:1746143834.028908:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.029138:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624831232 00000100:00100000:1.0:1746143834.029148:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624831232 00000100:00100000:1.0:1746143834.029201:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16160 00000100:00100000:1.0:1746143834.029209:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624831232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143834.029228:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.029247:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b416b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411198 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.030418:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627409920:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143834.030516:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.032509:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627409920:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143834.032542:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b416b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411198 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143834.032555:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b416b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411198 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143834.032579:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00000100:00100000:1.0:1746143834.032636:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624831232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3426us (3737us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143834.032644:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16160 00000100:00100000:0.0:1746143834.036312:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.036481:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624831488 00000100:00100000:1.0:1746143834.036494:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624831488 00002000:00100000:1.0:1746143834.036543:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4386816->4853759) req@ffff880095c39880 x1830963624831488/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.036553:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39880 with x1830963624831488 ext(4386816->4853759) 00002000:00010000:1.0:1746143834.036559:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39880 00000100:00100000:1.0:1746143834.036756:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7004 00000100:00100000:1.0:1746143834.036765:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624831488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.042507:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624831488:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5734us (6194us total) trans 0 rc 466944/466944 00000100:00100000:1.0:1746143834.042520:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7004 00002000:00100000:1.0:1746143834.042856:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4386816->4853759) req@ffff880095c39880 x1830963624831488/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.042867:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39880 with x1830963624831488 ext(4386816->4853759) 00002000:00010000:1.0:1746143834.042872:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c39880 00000100:00100000:0.0:1746143834.046765:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.046990:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624831616 00000100:00100000:1.0:1746143834.047059:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624831616 00000100:00100000:1.0:1746143834.047105:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16161 00000100:00100000:1.0:1746143834.047115:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963624831616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143834.047133:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.047151:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b4172 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841119f expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.047206:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627410048:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143834.048101:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.051759:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627410048:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143834.051803:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b4172 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841119f expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143834.051818:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b4172 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841119f expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143834.052555:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137400, rc 0) 00000100:00100000:0.0:1746143834.055434:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.111040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.120907:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.160781:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.161763:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.161940:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13890 00000100:00100000:1.0:1746143834.161949:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+297:2543:x1830963624832384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143834.161968:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.161984:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b41a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484111b4 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.162044:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162055:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162065:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162082:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162088:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162093:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162167:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b41b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162176:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b41b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162181:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b41b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143834.162188:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143834.162243:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162249:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162254:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162258:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162263:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143834.162266:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162271:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162279:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143834.162282:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143834.162285:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162289:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137e00/0x87925e4cb73b41aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162312:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162317:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162321:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162328:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143834.162330:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162334:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162339:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88007f167500) 00010000:00010000:1.0:1746143834.162341:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143834.162583:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162590:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b41b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.162623:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b41a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484111b4 expref: 300 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.162632:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136000/0x87925e4cb73b41b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484111b4 expref: 299 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.162637:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143834.162639:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143834.162641:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136000, rc 0) 00000100:00100000:1.0:1746143834.162675:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+299:2543:x1830963624832384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 727us (2307us total) trans 8589944917 rc 0/0 00000100:00100000:1.0:1746143834.162680:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13890 00000100:00100000:0.0:1746143834.167697:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.167730:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.168000:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624832640 00000100:00100000:1.0:1746143834.168006:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624832640 00010000:00010000:1.0:1746143834.168042:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841102c expref: 9 pid: 12327 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143834.168059:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624832768 00000100:00100000:1.0:1746143834.168061:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624832768 00000100:00100000:1.0:1746143834.168074:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7838 00000100:00100000:1.0:1746143834.168079:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624832640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.168089:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.168105:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841102c expref: 9 pid: 12327 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.168113:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841102c expref: 9 pid: 12327 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.168136:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b3f57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841102c expref: 9 pid: 12327 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.168145:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.168161:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624832640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 82us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.168167:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7838 00000100:00100000:1.0:1746143834.168424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.168449:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.168470:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.168718:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.168744:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.168763:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624833280 00000100:00100000:1.0:1746143834.168766:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624833280 00000100:00100000:1.0:1746143834.168816:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624833408 00000100:00100000:1.0:1746143834.168819:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624833408 00000100:00100000:1.0:1746143834.168834:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16165 00000100:00100000:1.0:1746143834.168839:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624833280:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143834.168846:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.168855:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086a00/0x87925e4cb73b41d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484111c9 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.168886:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627410688:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143834.169880:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.175188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.175212:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624833664 00000100:00100000:1.0:1746143834.175217:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624833664 00002000:00100000:1.0:1746143834.175250:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1310720->1314815) req@ffff880129dc3100 x1830963624833664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.175259:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3100 with x1830963624833664 ext(1310720->1314815) 00002000:00010000:1.0:1746143834.175263:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc3100 00000100:00100000:1.0:1746143834.175278:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7005 00000100:00100000:1.0:1746143834.175284:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624833664:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143834.175389:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624833664:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 104us (207us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143834.175395:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7005 00002000:00100000:1.0:1746143834.175413:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1310720->1314815) req@ffff880129dc3100 x1830963624833664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.175420:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc3100 with x1830963624833664 ext(1310720->1314815) 00002000:00010000:1.0:1746143834.175424:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129dc3100 00000100:00100000:0.0:1746143834.175710:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627410688:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143834.175738:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086a00/0x87925e4cb73b41d4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484111c9 expref: 34 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143834.175749:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086a00/0x87925e4cb73b41d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484111c9 expref: 34 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143834.175762:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086a00, rc 0) 00000100:00100000:0.0:1746143834.175794:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624833280:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6954us (7076us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143834.175800:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16165 00000100:00100000:0.0:1746143834.179377:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.183743:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.185696:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.185754:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624834432 00000100:00100000:1.0:1746143834.185760:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624834432 00002000:00100000:1.0:1746143834.185786:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880090e59180 x1830963624834432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 504/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.185793:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59180 with x1830963624834432 ext(1048576->2097151) 00002000:00010000:1.0:1746143834.185798:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59180 00000100:00100000:1.0:1746143834.186025:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7007 00000100:00100000:1.0:1746143834.186032:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963624834432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.188940:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963624834432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 2902us (3246us total) trans 0 rc 536576/536576 00000100:00100000:1.0:1746143834.188949:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7007 00002000:00100000:1.0:1746143834.188958:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880090e59180 x1830963624834432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 504/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 536576/536576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.188966:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59180 with x1830963624834432 ext(1048576->2097151) 00002000:00010000:1.0:1746143834.188970:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59180 00000100:00100000:0.0:1746143834.201139:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.209545:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.209778:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624834816 00000100:00100000:1.0:1746143834.209789:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624834816 00002000:00100000:1.0:1746143834.209836:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e5b800 x1830963624834816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.209845:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b800 with x1830963624834816 ext(2097152->4194303) 00002000:00010000:1.0:1746143834.209851:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5b800 00000100:00100000:1.0:1746143834.209890:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7008 00000100:00100000:1.0:1746143834.209897:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624834816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143834.210543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.223810:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624834816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13900us (14262us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143834.223823:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7008 00002000:00100000:1.0:1746143834.223836:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e5b800 x1830963624834816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.223846:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b800 with x1830963624834816 ext(2097152->4194303) 00002000:00010000:1.0:1746143834.223852:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5b800 00000100:00100000:0.0:1746143834.239864:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.244723:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.248023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.261317:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963624835456:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12954us (13290us total) trans 17179873880 rc 0/0 00000100:00100000:0.0:1746143834.261331:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2607 00002000:00100000:0.0:1746143834.261344:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4386815) req@ffff880090e58e00 x1830963624835456/t17179873880(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/448 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.261354:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58e00 with x1830963624835456 ext(4194304->4386815) 00010000:00010000:0.0:1746143834.261366:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 16 pid: 9585 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.261383:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b4164 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4386815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411191 expref: 16 pid: 9585 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143834.261390:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e58e00 00000100:00100000:0.0:1746143834.266891:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.296208:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.296238:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.296284:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624835712 00000100:00100000:1.0:1746143834.296291:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624835712 00000100:00100000:1.0:1746143834.296323:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624835840 00000100:00100000:1.0:1746143834.296325:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624835840 00000100:00100000:1.0:1746143834.296340:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16170 00000100:00100000:1.0:1746143834.296346:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963624835712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143834.296360:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.296380:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73b41f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484111ec expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.296423:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627411328:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143834.296474:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143834.297339:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:1.0:1746143834.312258:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143833 -> 1746143834 00002000:00010000:1.0:1746143834.312269:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143833 -> 1746143834 00002000:00010000:1.0:1746143834.312271:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143833 -> 1746143834 00000100:00100000:1.0:1746143834.312299:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627411328:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143834.312344:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73b41f7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484111ec expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143834.312366:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087200/0x87925e4cb73b41f7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484111ec expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143834.312417:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087200, rc 0) 00000100:00100000:1.0:1746143834.312478:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963624835712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 16128us (16273us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143834.312488:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16170 00000100:00100000:0.0:1746143834.323293:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.323789:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624836224 00000100:00100000:1.0:1746143834.323800:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624836224 00000100:00100000:0.0:1746143834.327419:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.327463:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624836480 00000100:00100000:0.0:1746143834.327473:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624836480 00000100:00100000:0.0:1746143834.327540:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5348 00000100:00100000:0.0:1746143834.327548:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+299:2543:x1830963624836480:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143834.327739:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+300:2543:x1830963624836480:12345-192.168.202.3@tcp:35:cat.0 Request processed in 192us (339us total) trans 8589944919 rc 0/0 00000100:00100000:0.0:1746143834.327746:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5348 00000100:00100000:0.0:1746143834.330586:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.330741:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624836736 00000100:00100000:1.0:1746143834.330748:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624836736 00000100:00100000:1.0:1746143834.330787:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13891 00000100:00100000:1.0:1746143834.330794:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2550:x1830963624836736:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143834.330814:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.330832:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73b420c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411201 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.330890:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.330902:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.330930:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.330944:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.330952:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.330957:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.331026:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.331036:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73b411e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411152 expref: 35 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.331042:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.331071:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73b411e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411152 expref: 35 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.331081:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73b411e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411152 expref: 35 pid: 6587 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.331093:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627411584:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143834.333172:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143834.334075:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143834.342213:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e505400/0x87925e4cb73b411e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411152 expref: 36 pid: 6587 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.342252:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627411584:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143834.342273:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342284:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342288:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143834.342330:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:1.0:1746143834.342334:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143834.342350:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342360:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342368:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342374:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342556:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342561:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342566:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143834.342569:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342575:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342586:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143834.342654:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143834.342659:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342664:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b4213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342673:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342678:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342682:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342685:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082087600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143834.342687:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342691:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342697:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88007f167a00) 00010000:00010000:1.0:1746143834.342699:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143834.342701:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342705:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087600/0x87925e4cb73b421a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.342733:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087800/0x87925e4cb73b420c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411201 expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.342746:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411201 expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.342751:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143834.342752:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143834.342754:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087c00, rc 0) 00000100:00100000:1.0:1746143834.342839:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2550:x1830963624836736:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 12044us (12260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.342846:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13891 00000100:00100000:0.0:1746143834.346323:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624836608:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12015us (12244us total) trans 21474841155 rc 0/0 00000100:00100000:0.0:1746143834.346334:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2608 00002000:00100000:0.0:1746143834.346344:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1310720->1822719) req@ffff88009610c380 x1830963624836608/t21474841155(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/448 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.346352:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610c380 with x1830963624836608 ext(1310720->1822719) 00010000:00010000:0.0:1746143834.346361:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x87925e4cb73b41c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484111bb expref: 32 pid: 9585 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.346373:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x87925e4cb73b41c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484111bb expref: 32 pid: 9585 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143834.346379:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009610c380 00000100:00100000:0.0:1746143834.346738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.348291:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.348387:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.356201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.357148:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.358991:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624837632 00000100:00100000:1.0:1746143834.359005:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624837632 00000100:00100000:1.0:1746143834.359086:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13892 00000100:00100000:1.0:1746143834.359096:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2550:x1830963624837632:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143834.359121:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143834.359206:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087200/0x87925e4cb73b423d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841121d expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.359331:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b4244 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.359350:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411201 expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.359358:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b4244 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143834.359396:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411201 expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.359421:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4221 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411201 expref: 18 pid: 10936 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.359432:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627411968:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143834.359528:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.369134:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627411968:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143834.369167:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b4244 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143834.369545:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.370213:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.370275:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624838016 00000100:00100000:0.0:1746143834.370279:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624838016 00002000:00100000:0.0:1746143834.370310:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009610c700 x1830963624838016/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.370319:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610c700 with x1830963624838016 ext(1048576->2097151) 00002000:00010000:0.0:1746143834.370323:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009610c700 00000100:00100000:0.0:1746143834.370335:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7011 00000100:00100000:0.0:1746143834.370341:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624838016:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143834.376717:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624838272 00000100:00100000:0.0:1746143834.376727:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624838272 00000100:00100000:0.0:1746143834.376773:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13893 00000100:00100000:0.0:1746143834.376780:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2550:x1830963624838272:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143834.376803:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143834.376806:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143834.376833:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082086200/0x87925e4cb73b4244 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841121d expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.376853:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143834.376857:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143834.376868:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4252 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411224 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.377000:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377014:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377023:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377035:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377041:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377047:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377054:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143834.377058:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377065:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377071:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143834.377074:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143834.377077:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377081:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4259 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.377103:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4252 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411224 expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.377110:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4252 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411224 expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.377117:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:0.0:1746143834.377155:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2550:x1830963624838272:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 374us (516us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143834.377161:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13893 00000100:00100000:0.0:1746143834.388553:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.391748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.392495:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624838656 00000100:00100000:1.0:1746143834.392501:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624838656 00000100:00100000:1.0:1746143834.392543:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5349 00000100:00100000:1.0:1746143834.392550:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2550:x1830963624838656:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143834.392736:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2550:x1830963624838656:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 186us (988us total) trans 8589944921 rc 0/0 00000100:00100000:1.0:1746143834.392743:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5349 00000100:00100000:0.0:1746143834.401562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.405750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.405801:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.410968:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.416791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.420894:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.421692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.425933:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.432256:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.432299:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.436441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.436486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.436498:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.436862:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.437078:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624840704 00000100:00100000:1.0:1746143834.437083:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624840704 00010000:00010000:1.0:1746143834.437102:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107c00/0x87925e4cb73b3fdc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841108e expref: 20 pid: 9839 timeout: 993 lvb_type: 1 00000100:00100000:1.0:1746143834.437120:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624840576 00000100:00100000:1.0:1746143834.437122:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624840576 00010000:00010000:1.0:1746143834.437130:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73b3ff8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110aa expref: 32 pid: 13436 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.437142:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624840832 00000100:00100000:1.0:1746143834.437143:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624840832 00010000:00010000:1.0:1746143834.437149:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73b3f81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411048 expref: 33 pid: 9585 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.437158:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7850 00000100:00100000:1.0:1746143834.437164:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624840448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.437176:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.437197:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b422f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411216 expref: 8 pid: 12327 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.437206:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b422f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411216 expref: 8 pid: 12327 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.437228:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b422f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411216 expref: 8 pid: 12327 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.437248:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.437288:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963624840448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 123us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.437294:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7850 00000100:00100000:1.0:1746143834.437310:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7851 00000100:00100000:1.0:1746143834.437314:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624840704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.437320:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.437329:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107c00/0x87925e4cb73b3fdc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841108e expref: 20 pid: 9839 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.437336:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107c00/0x87925e4cb73b3fdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841108e expref: 20 pid: 9839 timeout: 993 lvb_type: 1 00010000:00010000:1.0:1746143834.437347:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.437360:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624840704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.437365:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7851 00000100:00100000:1.0:1746143834.437376:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7852 00000100:00100000:1.0:1746143834.437380:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963624840576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.437385:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.437391:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73b3ff8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110aa expref: 33 pid: 13436 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.437414:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e505c00/0x87925e4cb73b3ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110aa expref: 33 pid: 13436 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.437425:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.437439:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963624840576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.437444:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7852 00000100:00100000:1.0:1746143834.437454:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7853 00000100:00100000:1.0:1746143834.437459:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624840832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.437466:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.437474:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73b3f81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411048 expref: 32 pid: 9585 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.437481:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2000/0x87925e4cb73b3f81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411048 expref: 32 pid: 9585 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.437489:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.437491:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.437498:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.437505:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.437537:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.437548:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627413504:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.438960:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143834.448971:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.449038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.449067:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624841088 00000100:00100000:0.0:1746143834.449075:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624841088 00010000:00010000:0.0:1746143834.449111:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d200/0x87925e4cb73b415d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841118a expref: 18 pid: 9586 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143834.449160:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7854 00000100:00100000:0.0:1746143834.449168:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624841088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143834.449184:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143834.449207:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d200/0x87925e4cb73b415d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841118a expref: 18 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.449218:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55d200/0x87925e4cb73b415d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841118a expref: 18 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.449242:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d200/0x87925e4cb73b415d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841118a expref: 18 pid: 9586 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.449262:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143834.449264:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143834.449271:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.449280:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.449313:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143834.449324:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627413632:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.449327:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627413504:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143834.449354:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.449712:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624840832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12247us (12844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.449720:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7853 00000100:00100000:1.0:1746143834.450955:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.450983:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624841344 00000100:00100000:1.0:1746143834.450988:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624841344 00002000:00100000:1.0:1746143834.451021:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1478656->1482751) req@ffff8800972eb100 x1830963624841344/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.451031:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb100 with x1830963624841344 ext(1478656->1482751) 00002000:00010000:1.0:1746143834.451035:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb100 00000100:00100000:1.0:1746143834.451050:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7014 00000100:00100000:1.0:1746143834.451056:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624841344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143834.451224:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627413632:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143834.451238:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.451420:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624841344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 363us (1402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143834.451427:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7014 00002000:00100000:1.0:1746143834.451433:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1478656->1482751) req@ffff8800972eb100 x1830963624841344/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.451440:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb100 with x1830963624841344 ext(1478656->1482751) 00002000:00010000:1.0:1746143834.451443:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb100 00000100:00100000:0.0:1746143834.451639:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963624841088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2471us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143834.451648:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7854 00000100:00100000:0.0:1746143834.453023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.453072:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624841600 00000100:00100000:1.0:1746143834.453079:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624841600 00002000:00100000:1.0:1746143834.453106:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2682880->2686975) req@ffff880129e6d180 x1830963624841600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.453115:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d180 with x1830963624841600 ext(2682880->2686975) 00010000:00010000:1.0:1746143834.453121:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.453134:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143834.453141:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6d180 00000100:00100000:1.0:1746143834.453153:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2609 00000100:00100000:1.0:1746143834.453159:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624841600:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143834.453263:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624841600:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 103us (243us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143834.453268:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2609 00002000:00100000:1.0:1746143834.453273:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2682880->2686975) req@ffff880129e6d180 x1830963624841600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.453279:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d180 with x1830963624841600 ext(2682880->2686975) 00010000:00010000:1.0:1746143834.453284:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.453293:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 29 pid: 1945 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143834.453299:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6d180 00000100:00100000:0.0:1746143834.455575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.457539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.457610:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.457708:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624842368 00000100:00100000:0.0:1746143834.457711:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624842368 00000100:00100000:0.0:1746143834.457740:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13895 00000100:00100000:0.0:1746143834.457745:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+302:2557:x1830963624842368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143834.457757:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143834.457774:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b429f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841124e expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.457841:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b42a6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.457855:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.457864:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143834.457873:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143834.457944:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b429f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841124e expref: 305 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.457966:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b42a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841124e expref: 304 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.457974:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143834.457977:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746143834.457980:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00000100:00100000:0.0:1746143834.458013:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+304:2557:x1830963624842368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 266us (401us total) trans 8589944924 rc 0/0 00000100:00100000:0.0:1746143834.458018:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13895 00000100:00100000:0.0:1746143834.459823:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.459860:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.459898:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.459968:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624843136 00000100:00100000:0.0:1746143834.459971:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624843136 00000100:00100000:0.0:1746143834.460007:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5351 00000100:00100000:0.0:1746143834.460013:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+304:2554:x1830963624843136:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143834.460124:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+305:2554:x1830963624843136:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 110us (224us total) trans 8589944925 rc 0/0 00000100:00100000:0.0:1746143834.460130:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5351 00000100:00100000:0.0:1746143834.461378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.461653:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.462520:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.470074:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624842624:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8607us (10205us total) trans 21474841156 rc 0/0 00000100:00100000:0.0:1746143834.470084:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2611 00002000:00100000:0.0:1746143834.470093:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2682880->2732031) req@ffff880129e6d880 x1830963624842624/t21474841156(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/448 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.470102:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d880 with x1830963624842624 ext(2682880->2732031) 00010000:00010000:0.0:1746143834.470110:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 32 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.470122:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 32 pid: 1945 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143834.470128:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6d880 00000100:00100000:0.0:1746143834.472093:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.472179:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624843520 00000100:00100000:1.0:1746143834.472187:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624843520 00010000:00010000:1.0:1746143834.472561:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 32 pid: 1945 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.472699:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7855 00000100:00100000:1.0:1746143834.472708:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624843520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.472722:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.472742:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 32 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.472753:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 32 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.472776:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4291 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2682880->2732031) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411240 expref: 32 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.472805:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.472808:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.472815:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.472823:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.472859:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 17 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.472872:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627414272:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.472970:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.477696:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627414272:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143834.477715:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.477758:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963624843520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5050us (5672us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.477770:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7855 00000100:00100000:0.0:1746143834.479104:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.479148:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.479577:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7015 00000100:00100000:1.0:1746143834.479584:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624844160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.489951:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624844160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10353us (10836us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143834.489964:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7015 00002000:00100000:1.0:1746143834.489977:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880129e6e680 x1830963624844160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.489986:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6e680 with x1830963624844160 ext(3145728->4194303) 00002000:00010000:1.0:1746143834.489992:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e6e680 00000100:00100000:0.0:1746143834.495184:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963624844032:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15788us (16027us total) trans 17179873881 rc 0/0 00000100:00100000:0.0:1746143834.495195:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2612 00002000:00100000:0.0:1746143834.495206:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (638976->1048575) req@ffff880092b4aa00 x1830963624844032/t17179873881(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/448 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.495214:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4aa00 with x1830963624844032 ext(638976->1048575) 00010000:00010000:0.0:1746143834.495223:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73b4260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841122b expref: 18 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.495237:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73b4260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841122b expref: 18 pid: 9839 timeout: 993 lvb_type: 0 00002000:00010000:0.0:1746143834.495243:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b4aa00 00000100:00100000:0.0:1746143834.496733:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.500560:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.500620:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624844416 00000100:00100000:1.0:1746143834.500632:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624844416 00010000:00010000:1.0:1746143834.500669:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73b4260 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841122b expref: 20 pid: 9839 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.500705:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7856 00000100:00100000:1.0:1746143834.500713:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963624844416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.500726:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.500747:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73b4260 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841122b expref: 20 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.500759:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3c400/0x87925e4cb73b4260 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 638976->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841122b expref: 20 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.500784:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.500785:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.500793:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b42d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411271 expref: 34 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.500805:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b42d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411271 expref: 34 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.500836:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b42d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411271 expref: 34 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.500847:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627414656:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.500934:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.504690:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627414656:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143834.504715:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.504772:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963624844416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4058us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.504783:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7856 00000100:00100000:1.0:1746143834.505728:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.505770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.505828:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624844800 00000100:00100000:0.0:1746143834.505836:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624844800 00002000:00100000:0.0:1746143834.505874:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880129dc0700 x1830963624844800/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.505883:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0700 with x1830963624844800 ext(4194304->4853759) 00002000:00010000:0.0:1746143834.505887:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0700 00000100:00100000:0.0:1746143834.505906:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624844928 00000100:00100000:0.0:1746143834.505907:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624844928 00002000:00100000:0.0:1746143834.505931:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129dc0380 x1830963624844928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.505937:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0380 with x1830963624844928 ext(0->1048575) 00002000:00010000:0.0:1746143834.505940:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0380 00000100:00100000:1.0:1746143834.506871:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7017 00000100:00100000:1.0:1746143834.506878:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624844928:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.518846:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624844928:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11959us (13064us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143834.518858:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7017 00002000:00100000:1.0:1746143834.518869:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129dc0380 x1830963624844928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.518878:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0380 with x1830963624844928 ext(0->1048575) 00002000:00010000:1.0:1746143834.518884:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc0380 00000100:00100000:0.0:1746143834.522192:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.528698:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.531098:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.531335:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624845312 00000100:00100000:1.0:1746143834.531343:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624845312 00002000:00100000:1.0:1746143834.531386:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1482751) req@ffff880092b4a680 x1830963624845312/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.531395:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4a680 with x1830963624845312 ext(1048576->1482751) 00010000:00010000:1.0:1746143834.531412:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 18 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.531425:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 18 pid: 9839 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143834.531432:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b4a680 00000100:00100000:1.0:1746143834.531449:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2613 00000100:00100000:1.0:1746143834.531456:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963624845312:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143834.541595:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624845312:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10127us (10491us total) trans 21474841157 rc 0/0 00000100:00100000:1.0:1746143834.541611:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2613 00002000:00100000:1.0:1746143834.541625:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1482751) req@ffff880092b4a680 x1830963624845312/t21474841157(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/448 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.541634:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4a680 with x1830963624845312 ext(1048576->1482751) 00010000:00010000:1.0:1746143834.541645:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 20 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.541660:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 20 pid: 9839 timeout: 993 lvb_type: 0 00002000:00010000:1.0:1746143834.541668:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b4a680 00000100:00100000:0.0:1746143834.544798:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.544868:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624845440 00000100:00100000:1.0:1746143834.544878:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624845440 00010000:00010000:1.0:1746143834.545088:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b428a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411239 expref: 20 pid: 9839 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143834.552218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.552264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.552349:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624845696 00000100:00100000:1.0:1746143834.552356:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624845696 00002000:00100000:1.0:1746143834.552394:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092b49c00 x1830963624845696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.552414:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49c00 with x1830963624845696 ext(1048576->2097151) 00002000:00010000:1.0:1746143834.552418:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49c00 00000100:00100000:1.0:1746143834.552432:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624845952 00000100:00100000:1.0:1746143834.552434:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624845952 00002000:00100000:1.0:1746143834.552445:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092b4b100 x1830963624845952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.552450:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b100 with x1830963624845952 ext(1048576->2097151) 00002000:00010000:1.0:1746143834.552453:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4b100 00000100:00100000:1.0:1746143834.552480:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7018 00000100:00100000:1.0:1746143834.552486:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624845696:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.564966:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624845696:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12479us (12748us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143834.564972:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7018 00002000:00100000:1.0:1746143834.564978:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092b49c00 x1830963624845696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.564985:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49c00 with x1830963624845696 ext(1048576->2097151) 00002000:00010000:1.0:1746143834.564988:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49c00 00000100:00100000:0.0:1746143834.580631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.589119:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.589247:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.589282:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624846464 00000100:00100000:0.0:1746143834.589288:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624846464 00010000:00010000:0.0:1746143834.589317:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73b427c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411232 expref: 305 pid: 6587 timeout: 993 lvb_type: 0 00000100:00100000:0.0:1746143834.589358:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7858 00000100:00100000:0.0:1746143834.589365:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+305:2008:x1830963624846464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143834.589375:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143834.589380:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73b427c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411232 expref: 305 pid: 6587 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.589389:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f800/0x87925e4cb73b427c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411232 expref: 305 pid: 6587 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.589417:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143834.589421:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.589429:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.589434:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143834.589450:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143834.589484:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+305:2008:x1830963624846464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143834.589490:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7858 00000100:00100000:0.0:1746143834.592805:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.604964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.605039:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624846976 00000100:00100000:1.0:1746143834.605046:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624846976 00002000:00100000:1.0:1746143834.605078:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b48700 x1830963624846976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.605086:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963624846976 ext(2097152->4194303) 00002000:00010000:1.0:1746143834.605091:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b48700 00000100:00100000:1.0:1746143834.605118:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7020 00000100:00100000:1.0:1746143834.605123:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624846976:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143834.607864:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.613243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.614233:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624847232 00000100:00100000:1.0:1746143834.614240:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624847232 00010000:00010000:1.0:1746143834.614267:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095d6d400/0x87925e4cb73b42e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411286 expref: 36 pid: 9839 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.614612:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7859 00000100:00100000:0.0:1746143834.615151:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963624847232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143834.615164:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143834.615181:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095d6d400/0x87925e4cb73b42e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411286 expref: 36 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.615192:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095d6d400/0x87925e4cb73b42e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411286 expref: 36 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.615210:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095d6d400/0x87925e4cb73b42e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411286 expref: 36 pid: 9839 timeout: 993 lvb_type: 0 00010000:00010000:0.0:1746143834.615236:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143834.615238:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143834.615244:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.615251:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143834.615282:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143834.617275:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627415296:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143834.617365:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143834.627158:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624846976:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22034us (22200us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143834.627166:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7020 00002000:00100000:0.0:1746143834.627175:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b48700 x1830963624846976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.627185:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963624846976 ext(2097152->4194303) 00002000:00010000:0.0:1746143834.627189:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b48700 00000100:00100000:0.0:1746143834.627466:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624847488 00000100:00100000:0.0:1746143834.627472:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624847488 00002000:00100000:0.0:1746143834.627496:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (2023424->2027519) req@ffff8800972e8700 x1830963624847488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.627503:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963624847488 ext(2023424->2027519) 00002000:00010000:0.0:1746143834.627506:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:0.0:1746143834.627531:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7021 00000100:00100000:0.0:1746143834.627537:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624847488:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143834.627631:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624847488:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 94us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143834.627636:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7021 00002000:00100000:0.0:1746143834.627641:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (2023424->2027519) req@ffff8800972e8700 x1830963624847488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/4536 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.627648:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963624847488 ext(2023424->2027519) 00002000:00010000:0.0:1746143834.627650:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:0.0:1746143834.639469:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.641518:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.645755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.645793:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.645821:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.645866:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.649296:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.649371:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624848512 00000100:00100000:1.0:1746143834.649378:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624848512 00010000:00010000:1.0:1746143834.649411:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73b41f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484111e5 expref: 34 pid: 1945 timeout: 993 lvb_type: 0 00000100:00100000:1.0:1746143834.649630:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7864 00000100:00100000:1.0:1746143834.649637:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624848512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.649648:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.649661:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73b41f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484111e5 expref: 34 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.649671:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73b41f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484111e5 expref: 34 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.649687:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097369e00/0x87925e4cb73b41f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484111e5 expref: 34 pid: 1945 timeout: 993 lvb_type: 0 00010000:00010000:1.0:1746143834.649967:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.649970:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.649976:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.649984:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.650011:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 16 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.650022:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627416064:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.650930:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.658009:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627416064:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143834.658030:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.658081:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624848512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8444us (8789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.658093:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7864 00000100:00100000:0.0:1746143834.662430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.753808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.754141:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.765767:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.783234:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.789298:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.798006:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.798272:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624849920 00000100:00100000:1.0:1746143834.798373:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624849920 00010000:00010000:1.0:1746143834.798412:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143834.798453:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7865 00000100:00100000:1.0:1746143834.798460:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624849920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.798472:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.798490:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.799230:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.799252:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b431d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a2 expref: 35 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.799267:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.799268:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.799274:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.799280:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.799306:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.799320:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627416576:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.799388:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143834.807755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.831617:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.844428:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963624850432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12509us (12810us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143834.844439:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7027 00002000:00100000:0.0:1746143834.844450:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880136ac9c00 x1830963624850432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143834.844458:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9c00 with x1830963624850432 ext(2097152->3145727) 00002000:00010000:0.0:1746143834.844463:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9c00 00000100:00100000:0.0:1746143834.854591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.861136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.861166:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624850688 00000100:00100000:1.0:1746143834.861173:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624850688 00002000:00100000:1.0:1746143834.861205:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3526656->4030463) req@ffff880136ac8700 x1830963624850688/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.861213:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8700 with x1830963624850688 ext(3526656->4030463) 00010000:00010000:1.0:1746143834.861219:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.861230:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143834.861236:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136ac8700 00000100:00100000:1.0:1746143834.861264:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2615 00000100:00100000:1.0:1746143834.861270:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624850688:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143834.868353:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624850688:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7076us (7593us total) trans 17179873882 rc 0/0 00000100:00100000:1.0:1746143834.868363:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2615 00002000:00100000:1.0:1746143834.868373:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3526656->4030463) req@ffff880136ac8700 x1830963624850688/t17179873882(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/448 e 0 to 0 dl 1746143845 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.868381:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8700 with x1830963624850688 ext(3526656->4030463) 00010000:00010000:1.0:1746143834.868492:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 20 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.868507:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 20 pid: 9839 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143834.868513:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136ac8700 00000100:00100000:0.0:1746143834.872384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.872433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.872511:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.872946:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624850944 00000100:00100000:1.0:1746143834.872950:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624850944 00010000:00010000:1.0:1746143834.872967:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 20 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143834.872992:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7866 00000100:00100000:1.0:1746143834.872997:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624850944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143834.873005:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143834.873024:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 20 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.873033:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4324 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3526656->18446744073709551615] (req 3526656->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112a9 expref: 20 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143834.873047:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.873049:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143834.873053:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.873059:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143834.873077:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143834.873084:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627416960:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143834.873113:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143834.877198:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627416960:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143834.877213:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143834.877235:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963624850944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4238us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143834.877243:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7866 00000100:00100000:1.0:1746143834.880583:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624851328 00000100:00100000:1.0:1746143834.880591:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624851328 00002000:00100000:1.0:1746143834.880936:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8801373bb800 x1830963624851328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.880945:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963624851328 ext(3145728->4194303) 00002000:00010000:1.0:1746143834.880950:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373bb800 00000100:00100000:1.0:1746143834.880978:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7028 00000100:00100000:1.0:1746143834.880985:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963624851328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.890514:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963624851328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9521us (10168us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143834.890525:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7028 00002000:00100000:1.0:1746143834.890536:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8801373bb800 x1830963624851328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.890550:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963624851328 ext(3145728->4194303) 00002000:00010000:1.0:1746143834.890556:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373bb800 00000100:00100000:0.0:1746143834.896316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.896456:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624851584 00000100:00100000:1.0:1746143834.896464:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624851584 00002000:00100000:1.0:1746143834.896500:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880136ac9180 x1830963624851584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.896509:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963624851584 ext(1048576->2097151) 00002000:00010000:1.0:1746143834.896513:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:0.0:1746143834.896854:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143834.897164:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624851840 00000100:00100000:1.0:1746143834.897168:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624851840 00002000:00100000:1.0:1746143834.897184:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880136ac9500 x1830963624851840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/0 e 0 to 0 dl 1746143845 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.897191:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9500 with x1830963624851840 ext(4194304->4853759) 00002000:00010000:1.0:1746143834.897195:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9500 00000100:00100000:1.0:1746143834.897216:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7030 00000100:00100000:1.0:1746143834.897222:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963624851840:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143834.903186:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963624851840:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5952us (6321us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143834.903198:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7030 00002000:00100000:1.0:1746143834.903212:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880136ac9500 x1830963624851840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:230/0 lens 488/440 e 0 to 0 dl 1746143845 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143834.903221:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9500 with x1830963624851840 ext(4194304->4853759) 00002000:00010000:1.0:1746143834.903226:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac9500 00000100:00100000:0.0:1746143834.923760:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.932642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.961023:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.977317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.992976:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143834.993012:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.010134:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.015726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.015814:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.015851:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624853248 00000100:00100000:0.0:1746143835.015858:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624853248 00010000:00010000:0.0:1746143835.015891:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b4347 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112cc expref: 35 pid: 1945 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.015946:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7869 00000100:00100000:0.0:1746143835.015954:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963624853248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.015965:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.015980:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b4347 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112cc expref: 35 pid: 1945 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.015990:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b4347 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112cc expref: 35 pid: 1945 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.016011:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.016041:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963624853248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.016047:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7869 00000100:00100000:1.0:1746143835.019042:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624853376 00000100:00100000:1.0:1746143835.019048:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624853376 00010000:00010000:1.0:1746143835.019070:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 21 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.019092:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7870 00000100:00100000:1.0:1746143835.019098:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963624853376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.019108:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.019122:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 21 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.019131:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 21 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.019147:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52400/0x87925e4cb73b4339 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112be expref: 21 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.019161:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.019162:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.019167:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049600/0x87925e4cb73b4363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e8 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.019173:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049600/0x87925e4cb73b4363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e8 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.019195:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082049600/0x87925e4cb73b4363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e8 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.019209:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627418112:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.019257:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.021672:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627418112:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.021683:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.021698:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624853376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2601us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.021704:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7870 00000100:00100000:0.0:1746143835.023239:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.023818:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624853632 00000100:00100000:1.0:1746143835.023825:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624853632 00010000:00010000:1.0:1746143835.023855:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504600/0x87925e4cb73b3ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484110a3 expref: 19 pid: 9585 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.024286:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.024304:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.024605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.024937:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624853504 00000100:00100000:1.0:1746143835.024940:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624853504 00010000:00010000:1.0:1746143835.024953:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.024966:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624853760 00000100:00100000:1.0:1746143835.024967:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624853760 00010000:00010000:1.0:1746143835.024974:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b4355 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112da expref: 34 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.024986:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7872 00000100:00100000:1.0:1746143835.024990:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963624853504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.024995:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.025004:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.025011:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.025021:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53200/0x87925e4cb73b4340 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112c5 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.025032:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.025048:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963624853504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.025052:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7872 00000100:00100000:1.0:1746143835.025060:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7873 00000100:00100000:1.0:1746143835.025063:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624853760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.025068:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.025073:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b4355 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112da expref: 34 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.025079:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b4355 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112da expref: 34 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.025087:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b4355 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112da expref: 34 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.025093:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.025095:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.025100:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.025106:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.025127:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 33 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.025136:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627418240:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.025174:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.027843:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627418240:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.027862:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.027893:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624853760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2827us (3587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.027902:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7873 00000100:00100000:0.0:1746143835.027982:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.036303:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.047952:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143835.048930:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143835.050863:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.050896:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.051037:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624854912 00000100:00100000:1.0:1746143835.051042:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624854912 00000100:00100000:1.0:1746143835.051427:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5353 00000100:00100000:1.0:1746143835.051434:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+306:30523:x1830963624854912:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746143835.051894:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143835.052629:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+307:30523:x1830963624854912:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 1197us (1767us total) trans 8589944929 rc 0/0 00000100:00100000:1.0:1746143835.052634:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5353 00000100:00100000:0.0:1746143835.054865:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.055044:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624855296 00000100:00100000:1.0:1746143835.055051:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624855296 00010000:00010000:1.0:1746143835.055079:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841128d expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.055117:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7874 00000100:00100000:1.0:1746143835.055124:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+39:2008:x1830963624855296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.055135:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.055139:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841128d expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.055148:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841128d expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.055166:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b42f3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841128d expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.055176:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.055180:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.055187:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.055191:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.055196:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.055227:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+38:2008:x1830963624855296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.055233:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7874 00000100:00100000:0.0:1746143835.055355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.060193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.060229:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.060257:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.060283:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.060335:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624855680 00000100:00100000:1.0:1746143835.060342:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624855680 00000100:00100000:1.0:1746143835.060379:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624855552 00000100:00100000:1.0:1746143835.060382:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624855552 00000100:00100000:1.0:1746143835.060407:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16201 00000100:00100000:1.0:1746143835.060415:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624855680:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143835.060428:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.060441:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2200/0x87925e4cb73b4394 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411304 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.060478:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627418624:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143835.060534:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.061976:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.063729:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627418624:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143835.063754:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2200/0x87925e4cb73b4394 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411304 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.063765:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2200/0x87925e4cb73b4394 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411304 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.063773:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2200, rc 0) 00000100:00100000:1.0:1746143835.063808:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624855680:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3394us (3626us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143835.063814:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16201 00000100:00100000:0.0:1746143835.073720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.073793:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624856448 00000100:00100000:1.0:1746143835.073800:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624856448 00010000:00010000:1.0:1746143835.073826:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112f6 expref: 21 pid: 6587 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.073860:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7876 00000100:00100000:1.0:1746143835.073867:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+21:2008:x1830963624856448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.073878:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.073883:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112f6 expref: 21 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.073892:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112f6 expref: 21 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.073909:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b4386 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112f6 expref: 21 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.073943:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.073947:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b43b7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.073954:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b43b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.073959:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b43b7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.073981:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.074009:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+20:2008:x1830963624856448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.074014:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7876 00000100:00100000:0.0:1746143835.077329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.079107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083010:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083047:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083096:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083110:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.083155:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624857600 00000100:00100000:0.0:1746143835.083157:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624857600 00000100:00100000:0.0:1746143835.083373:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16209 00000100:00100000:0.0:1746143835.083380:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624857088:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143835.083386:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16211 00000100:00100000:1.0:1746143835.083401:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624857600:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143835.083407:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73b43ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.083417:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.083418:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049600/0x87925e4cb73b4363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e8 expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.083424:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143835.083426:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143835.083428:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c200/0x87925e4cb73b43ef lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.083430:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.083437:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73b43a9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411319 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.083443:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.083446:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049600/0x87925e4cb73b4363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e8 expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.083447:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.083448:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.083450:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.083453:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049600/0x87925e4cb73b4363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e8 expref: 19 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.083461:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627419392:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.083464:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.083471:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.083477:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627419648:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143835.083481:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00010000:00010000:1.0:1746143835.083505:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73b43a9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411319 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.083512:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73b43a9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411319 expref: 11 pid: 9839 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143835.083522:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627419776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.083541:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.083547:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 19 pid: 1945 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.083553:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627419904:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.083565:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.089887:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.089904:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.089941:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.089959:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624857856 00000100:00100000:0.0:1746143835.089964:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624857856 00010000:00010000:0.0:1746143835.089985:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048a00/0x87925e4cb73b43a9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411319 expref: 12 pid: 9839 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.090002:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624858368 00000100:00100000:0.0:1746143835.090003:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624858368 00010000:00010000:0.0:1746143835.090011:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411033 expref: 11 pid: 12327 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143835.090030:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627419648:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.090036:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627419776:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.090042:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627419904:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.090060:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143835.090600:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7878 00000100:00100000:0.0:1746143835.090607:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624857984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.090613:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.090622:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b42c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411263 expref: 34 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.090629:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b42c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411263 expref: 34 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.090639:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b42c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411263 expref: 34 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.090656:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.090682:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624857984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.090688:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7879 00000100:00100000:0.0:1746143835.090695:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7878 00000100:00100000:1.0:1746143835.090909:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624858368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.090934:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.090946:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411033 expref: 11 pid: 12327 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.090954:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411033 expref: 11 pid: 12327 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.090965:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b3f5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411033 expref: 11 pid: 12327 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.090981:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.091051:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.091071:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.091085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.091096:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.091107:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624858624 00000100:00100000:0.0:1746143835.091110:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624858624 00010000:00010000:0.0:1746143835.091121:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.091134:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7881 00000100:00100000:0.0:1746143835.091139:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624858624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.091144:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.091151:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.091158:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.091168:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b4301 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411294 expref: 33 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.091176:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.091191:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624858624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.091196:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7881 00000100:00100000:0.0:1746143835.091219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.091259:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624858368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 565us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.091264:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7879 00000100:00100000:1.0:1746143835.092214:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.092266:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.092486:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.092529:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624859008 00000100:00100000:0.0:1746143835.092532:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624859008 00010000:00010000:0.0:1746143835.092545:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7600/0x87925e4cb73b3e38 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410f99 expref: 19 pid: 12327 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.092564:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7883 00000100:00100000:0.0:1746143835.092569:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624858880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.092575:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.092584:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 22 pid: 1945 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.092592:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 22 pid: 1945 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.092603:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b4298 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411247 expref: 22 pid: 1945 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.092610:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.092612:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.092616:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.092623:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.092639:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.092655:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963624858880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143835.092690:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092697:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092710:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092717:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092723:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092729:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800913b6a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143835.092733:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092739:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092749:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.092754:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6a00/0x87925e4cb73b43fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.092786:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624857600:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 9394us (9651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.092793:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16211 00000100:00100000:0.0:1746143835.092825:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7883 00000100:00100000:0.0:1746143835.100046:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.103748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.103837:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624859392 00000100:00100000:0.0:1746143835.103843:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624859392 00010000:00010000:0.0:1746143835.103862:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b435c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e1 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.103889:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7887 00000100:00100000:0.0:1746143835.103894:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963624859392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.103902:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.103938:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b435c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e1 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.103946:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b435c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e1 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.103958:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b435c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 483328->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112e1 expref: 18 pid: 9839 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.103971:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.103973:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.103976:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b43e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.103983:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b43e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.103997:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.104014:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963624859392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 121us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.104020:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7887 00000100:00100000:0.0:1746143835.110044:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624859520 00000100:00100000:0.0:1746143835.110053:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624859520 00010000:00010000:0.0:1746143835.110080:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 34 pid: 9587 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.110214:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7888 00000100:00100000:0.0:1746143835.110221:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963624859520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.110234:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.110250:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 34 pid: 9587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.110261:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 34 pid: 9587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.110278:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8e00/0x87925e4cb73b436a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->3047423) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484112ef expref: 34 pid: 9587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.110289:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.110291:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.110295:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d66800/0x87925e4cb73b4404 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.110303:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d66800/0x87925e4cb73b4404 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.110330:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.110371:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963624859520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.110377:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7888 00000100:00100000:0.0:1746143835.114138:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.117085:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.117116:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.117143:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.117147:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624860032 00000100:00100000:1.0:1746143835.117154:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624860032 00000100:00100000:0.0:1746143835.117156:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.117171:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624860544 00000100:00100000:0.0:1746143835.117173:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624860544 00010000:00010000:0.0:1746143835.117187:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c9e expref: 307 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.117198:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5355 00000100:00100000:1.0:1746143835.117204:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+307:30523:x1830963624860288:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143835.117341:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+308:30523:x1830963624860288:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 136us (223us total) trans 8589944932 rc 0/0 00000100:00100000:1.0:1746143835.117346:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5355 00000100:00100000:0.0:1746143835.117838:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624860416 00000100:00100000:0.0:1746143835.117841:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624860416 00010000:00010000:0.0:1746143835.117853:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b38d5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ca5 expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.117876:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7889 00000100:00100000:0.0:1746143835.117881:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+307:2009:x1830963624860544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.117889:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.117893:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c9e expref: 307 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.117903:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b38ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c9e expref: 307 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.117945:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.117949:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b440b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.117957:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.117973:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+307:2009:x1830963624860544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.117978:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7889 00000100:00100000:0.0:1746143835.118012:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7890 00000100:00100000:0.0:1746143835.118017:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+39:2009:x1830963624860416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.118022:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.118026:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b38d5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ca5 expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.118033:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b38d5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410ca5 expref: 39 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.118041:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.118043:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b440b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.118048:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.118060:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+39:2009:x1830963624860416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 42us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.118065:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7890 00000100:00100000:0.0:1746143835.119611:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.119635:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624860800 00000100:00100000:1.0:1746143835.119640:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624860800 00010000:00010000:1.0:1746143835.119656:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b3a02 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d3f expref: 38 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.121309:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7891 00000100:00100000:1.0:1746143835.121321:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+38:2009:x1830963624860800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.121336:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.121342:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b3a02 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d3f expref: 38 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121351:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b3a02 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d3f expref: 38 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121366:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b3a02 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d3f expref: 38 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121376:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.121380:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b440b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.121387:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.121434:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+37:2009:x1830963624860800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.121440:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7891 00000100:00100000:1.0:1746143835.121478:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.121492:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624860672 00000100:00100000:1.0:1746143835.121496:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624860672 00010000:00010000:1.0:1746143835.121507:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c97 expref: 37 pid: 7243 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.121538:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7892 00000100:00100000:1.0:1746143835.121544:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+37:2009:x1830963624860672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.121550:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.121553:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c97 expref: 37 pid: 7243 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121560:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c97 expref: 37 pid: 7243 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121568:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b38c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410c97 expref: 37 pid: 7243 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121576:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.121579:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b440b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.121584:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.121596:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963624860672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.121601:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7892 00000100:00100000:1.0:1746143835.121642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.121652:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624860928 00000100:00100000:1.0:1746143835.121655:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624860928 00010000:00010000:1.0:1746143835.121675:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d00 expref: 306 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.121694:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7893 00000100:00100000:1.0:1746143835.121698:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+306:2008:x1830963624860928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.121703:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.121707:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d00 expref: 306 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121714:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d00 expref: 306 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121723:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b396f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248410d00 expref: 306 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.121731:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.121734:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b440b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.121738:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.121751:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+305:2008:x1830963624860928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.121756:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7893 00000100:00100000:0.0:1746143835.121968:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.123083:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000001:00080000:1.0:1746143835.126077:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944934 is committed 00000004:00080000:1.0:1746143835.126084:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2406 committed 00000004:00080000:1.0:1746143835.126097:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2409 committed 00000004:00080000:1.0:1746143835.126101:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2408 committed 00000004:00080000:1.0:1746143835.126103:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2407 committed 00000004:00080000:1.0:1746143835.126104:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2406 committed 00000004:00080000:1.0:1746143835.126106:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2405 committed 00000004:00080000:1.0:1746143835.126107:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2405 committed 00000004:00080000:1.0:1746143835.126109:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2404 committed 00000004:00080000:1.0:1746143835.126110:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2404 committed 00000004:00080000:1.0:1746143835.126111:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2403 committed 00000004:00080000:1.0:1746143835.126112:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2402 committed 00000004:00080000:1.0:1746143835.126116:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2401 committed 00000004:00080000:1.0:1746143835.126118:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2403 committed 00000004:00080000:1.0:1746143835.126119:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2402 committed 00000004:00080000:1.0:1746143835.126121:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2400 committed 00000004:00080000:1.0:1746143835.126122:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2399 committed 00000004:00080000:1.0:1746143835.126123:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2401 committed 00000001:00080000:1.0:1746143835.126128:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944933 is committed 00000001:00080000:1.0:1746143835.126133:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944932 is committed 00000100:00100000:1.0:1746143835.126245:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627421696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126263:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.126274:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627422208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126285:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.126295:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143835.126298:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627421568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126316:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627421824 00000100:00100000:1.0:1746143835.126321:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627421824 00000100:00100000:1.0:1746143835.126350:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627422336 00000100:00100000:1.0:1746143835.126352:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627422336 00000100:00100000:1.0:1746143835.126361:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627421952 00000100:00100000:1.0:1746143835.126362:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627421952 00000100:00100000:1.0:1746143835.126374:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16212 00000100:00100000:1.0:1746143835.126379:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3773:x1830963627421824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126466:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16214 00000100:00100000:1.0:1746143835.126470:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627422336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126521:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627422336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (243us total) trans 21474841162 rc 0/0 00000100:00100000:1.0:1746143835.126526:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16214 00000100:00100000:1.0:1746143835.126534:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16216 00000100:00100000:1.0:1746143835.126538:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3773:x1830963627421952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126548:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16217 00000100:00100000:1.0:1746143835.126552:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627422464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.126592:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627422464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (264us total) trans 21474841164 rc 0/0 00000100:00100000:1.0:1746143835.126596:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16217 00000100:00100000:1.0:1746143835.126607:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746143835.126643:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143835.126698:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627422592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.126719:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.126730:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627423104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.126743:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.126752:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143835.126756:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627422720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.126769:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.126775:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627423232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.126786:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.126797:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627422720 00000100:00100000:0.0:1746143835.126800:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627422720 00000100:00100000:0.0:1746143835.126810:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627423232 00000100:00100000:0.0:1746143835.126811:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627423232 00000100:00100000:0.0:1746143835.126817:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16220 00000100:00100000:0.0:1746143835.126821:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e0d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627423104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.126869:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963627423104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (124us total) trans 17179873886 rc 0/0 00000100:00100000:0.0:1746143835.126874:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16220 00000100:00100000:0.0:1746143835.126883:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16222 00000100:00100000:0.0:1746143835.126886:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627423232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.126948:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627423232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (161us total) trans 17179873888 rc 0/0 00000100:00100000:0.0:1746143835.126952:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16222 00000100:00080000:0.0:1746143835.126962:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143835.126973:0:3771:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873863 gen 2 00000004:00080000:0.0:1746143835.126975:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094195880, transno 17179873795 00000004:00080000:0.0:1746143835.126980:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094194700, transno 17179873796 00000004:00080000:0.0:1746143835.126982:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e492d80, transno 17179873797 00000004:00080000:0.0:1746143835.126984:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094196a00, transno 17179873798 00000004:00080000:0.0:1746143835.126986:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491c00, transno 17179873799 00000004:00080000:0.0:1746143835.126988:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094197100, transno 17179873800 00000004:00080000:0.0:1746143835.126990:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094195500, transno 17179873801 00000004:00080000:0.0:1746143835.126991:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491500, transno 17179873802 00000004:00080000:0.0:1746143835.126993:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e308a80, transno 17179873803 00000004:00080000:0.0:1746143835.126996:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e30aa00, transno 17179873804 00000004:00080000:0.0:1746143835.126998:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e30b800, transno 17179873805 00000004:00080000:0.0:1746143835.127000:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e309f80, transno 17179873806 00000004:00080000:0.0:1746143835.127002:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e30b100, transno 17179873807 00000004:00080000:0.0:1746143835.127004:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e493800, transno 17179873808 00000004:00080000:0.0:1746143835.127007:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78380, transno 17179873809 00000004:00080000:0.0:1746143835.127009:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e309c00, transno 17179873810 00000004:00080000:0.0:1746143835.127010:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e308700, transno 17179873811 00000004:00080000:0.0:1746143835.127012:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e308000, transno 17179873812 00000004:00080000:0.0:1746143835.127015:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009322e300, transno 17179873818 00000004:00080000:0.0:1746143835.127017:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931c5180, transno 17179873819 00000004:00080000:0.0:1746143835.127019:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931c4a80, transno 17179873820 00000004:00080000:0.0:1746143835.127021:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931c5c00, transno 17179873821 00000004:00080000:0.0:1746143835.127023:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931c7800, transno 17179873822 00000004:00080000:0.0:1746143835.127025:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009322e680, transno 17179873823 00000004:00080000:0.0:1746143835.127027:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931c7480, transno 17179873824 00000004:00080000:0.0:1746143835.127029:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800931c4700, transno 17179873825 00000004:00080000:0.0:1746143835.127031:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457f800, transno 17179873826 00000004:00080000:0.0:1746143835.127034:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35bb80, transno 17179873827 00000004:00080000:0.0:1746143835.127036:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391f100, transno 17179873828 00000004:00080000:0.0:1746143835.127038:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391d500, transno 17179873829 00000004:00080000:0.0:1746143835.127040:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35a680, transno 17179873830 00000004:00080000:0.0:1746143835.127042:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e359c00, transno 17179873831 00000004:00080000:0.0:1746143835.127044:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358a80, transno 17179873832 00000004:00080000:0.0:1746143835.127046:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ed80, transno 17179873833 00000004:00080000:0.0:1746143835.127048:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bde300, transno 17179873834 00000004:00080000:0.0:1746143835.127050:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009391ea00, transno 17179873835 00000004:00080000:0.0:1746143835.127052:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d7100, transno 17179873846 00000004:00080000:0.0:1746143835.127054:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136335180, transno 17179873847 00000004:00080000:0.0:1746143835.127056:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d4000, transno 17179873848 00000004:00080000:0.0:1746143835.127058:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d6680, transno 17179873849 00000004:00080000:0.0:1746143835.127060:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136337100, transno 17179873850 00000004:00080000:0.0:1746143835.127061:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d4700, transno 17179873851 00000004:00080000:0.0:1746143835.127063:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d6d80, transno 17179873852 00000004:00080000:0.0:1746143835.127064:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136335500, transno 17179873853 00000004:00080000:0.0:1746143835.127066:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136334e00, transno 17179873854 00000004:00080000:0.0:1746143835.127068:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136334000, transno 17179873855 00000004:00080000:0.0:1746143835.127069:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136337480, transno 17179873856 00000004:00080000:0.0:1746143835.127071:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136337b80, transno 17179873857 00000004:00080000:0.0:1746143835.127073:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef0e00, transno 17179873858 00000004:00080000:0.0:1746143835.127074:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef2a00, transno 17179873859 00000004:00080000:0.0:1746143835.127076:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136335880, transno 17179873860 00000004:00080000:0.0:1746143835.127078:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef3b80, transno 17179873861 00000004:00080000:0.0:1746143835.127080:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ef3480, transno 17179873862 00000004:00080000:0.0:1746143835.127082:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4d180, transno 17179873863 00000100:00100000:0.0:1746143835.127086:0:3771:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880095cb4380 x1830963627422720/t17179873887(17179873887) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143851 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746143835.127094:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4380/2, rc 0, transno 17179873887 00000100:00100000:0.0:1746143835.127098:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627422720:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143835.127106:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdd180/2, rc 0, transno 17179873888 00000100:00100000:0.0:1746143835.127108:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627423232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143835.127112:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb5880/2, rc 0, transno 17179873885 00000100:00100000:0.0:1746143835.127114:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627422592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143835.127119:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdc380/2, rc 0, transno 17179873886 00000100:00100000:0.0:1746143835.127122:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627423104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143835.127300:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 54 done 00000100:00100000:0.0:1746143835.127320:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627423616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.127336:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.128076:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627423616 00000100:00100000:0.0:1746143835.128080:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627423616 00000100:00100000:0.0:1746143835.128098:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16223 00000100:00100000:0.0:1746143835.128103:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627423616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.128170:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3771:x1830963627423616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (832us total) trans 17179873889 rc 0/0 00000100:00100000:0.0:1746143835.128175:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16223 00000100:00100000:0.0:1746143835.128220:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627421824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1841us (1974us total) trans 21474841160 rc 0/0 00000100:00100000:0.0:1746143835.128224:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16212 00000004:00080000:0.0:1746143835.128244:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bde300/2, rc 0, transno 17179873889 00000100:00100000:0.0:1746143835.128247:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627423616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.128430:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.128451:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143835.128468:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9f80/2, rc 0, transno 21474841161 00000100:00100000:1.0:1746143835.128471:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627421696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143835.128477:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9500/2, rc 0, transno 21474841163 00000100:00100000:1.0:1746143835.128479:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627422208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143835.128487:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b8a80/2, rc 0, transno 21474841165 00000100:00100000:1.0:1746143835.128489:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627421568:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143835.128546:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143835.128548:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.128550:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143835.128552:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.128553:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:1.0:1746143835.128570:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627421952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2031us (2263us total) trans 21474841166 rc 0/0 00000100:00100000:1.0:1746143835.128575:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16216 00000100:00100000:1.0:1746143835.128664:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627422080 00000100:00100000:1.0:1746143835.128666:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627422080 00000100:00100000:1.0:1746143835.128678:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627423360 00000100:00100000:1.0:1746143835.128680:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627423360 00000100:00100000:1.0:1746143835.128690:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16224 00000100:00100000:1.0:1746143835.128694:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963627422080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.128742:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627422080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (289us total) trans 21474841167 rc 0/0 00000100:00100000:1.0:1746143835.128746:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16224 00000004:00080000:1.0:1746143835.129363:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bb480/2, rc 0, transno 21474841167 00000100:00100000:1.0:1746143835.129367:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627422080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143835.131088:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.142622:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.146414:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.149189:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.172625:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.173826:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624862208 00000100:00100000:1.0:1746143835.173835:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624862208 00000100:00100000:1.0:1746143835.174539:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13904 00000100:00100000:1.0:1746143835.174546:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2589:x1830963624862208:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143835.174563:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.174578:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b4419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841133c expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.174635:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174646:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174653:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174662:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174670:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174674:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174744:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b442e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174751:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b442e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174756:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b442e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143835.174762:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143835.174816:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174821:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174826:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174830:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174834:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082049000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143835.174837:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174842:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174852:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143835.174854:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143835.174858:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174862:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b4420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174881:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174886:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174890:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174894:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143835.174895:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174899:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174905:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093e20200) 00010000:00010000:1.0:1746143835.174907:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143835.174909:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174927:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b4427 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.174955:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b4419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841133c expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.174965:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b442e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841133c expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.174970:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.174972:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143835.174974:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048a00, rc 0) 00000100:00100000:1.0:1746143835.175013:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2589:x1830963624862208:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 468us (2394us total) trans 8589944937 rc 0/0 00000100:00100000:1.0:1746143835.175019:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13904 00000100:00100000:0.0:1746143835.181427:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.189511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.189986:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.191040:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.191063:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.191079:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.191117:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.191141:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624862720 00000100:00100000:1.0:1746143835.191146:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624862720 00000100:00100000:1.0:1746143835.191167:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624862848 00000100:00100000:1.0:1746143835.191169:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624862848 00000100:00100000:1.0:1746143835.191177:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624862976 00000100:00100000:1.0:1746143835.191179:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624862976 00000100:00100000:1.0:1746143835.191186:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624863104 00000100:00100000:1.0:1746143835.191188:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624863104 00000100:00100000:1.0:1746143835.191195:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624863232 00000100:00100000:1.0:1746143835.191197:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624863232 00000100:00100000:1.0:1746143835.191207:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16230 00000100:00100000:1.0:1746143835.191212:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963624862720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.191222:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.191234:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096f6d600/0x87925e4cb73b4458 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411351 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143835.191248:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a5b, atime: 0x68140a5b, ctime: 0x68140a5b, blocks: 0x808 00010000:00010000:1.0:1746143835.191259:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.191261:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.191265:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096f6d600/0x87925e4cb73b4458 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411351 expref: 22 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.191276:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096f6d600/0x87925e4cb73b4458 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411351 expref: 22 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.191284:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f6d600, rc 0) 00000100:00100000:1.0:1746143835.191306:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624862720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 93us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.191310:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16230 00000100:00100000:1.0:1746143835.191321:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16231 00000100:00100000:1.0:1746143835.191325:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963624862848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.191330:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.191336:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411358 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143835.191345:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a5a, atime: 0x68140a5a, ctime: 0x68140a5a, blocks: 0x808 00000100:00100000:0.0:1746143835.191348:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16232 00010000:00010000:1.0:1746143835.191351:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.191352:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.191356:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 22 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143835.191360:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963624862976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.191369:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 22 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.191376:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00010000:00010000:0.0:1746143835.191377:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143835.191400:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624862848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143835.191401:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73b4466 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841135f expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.191405:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16231 00000100:00100000:1.0:1746143835.191414:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16233 00000100:00100000:1.0:1746143835.191419:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963624863104:12345-192.168.202.3@tcp:101:cat.0 00002000:00010000:0.0:1746143835.191421:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a59, atime: 0x68140a59, ctime: 0x68140a59, blocks: 0x808 00010000:00010000:1.0:1746143835.191424:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.191433:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73b446d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411366 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.191437:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.191438:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746143835.191443:0:1945:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a5b, atime: 0x68140a5a, ctime: 0x68140a5b, blocks: 0x1510 00010000:00010000:0.0:1746143835.191445:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73b4466 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841135f expref: 20 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.191450:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.191451:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.191454:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73b446d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411366 expref: 21 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.191464:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049c00/0x87925e4cb73b446d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411366 expref: 21 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.191469:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049c00, rc 0) 00000100:00100000:1.0:1746143835.191483:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963624863104:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.191490:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16233 00010000:00010000:0.0:1746143835.191830:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7fc00/0x87925e4cb73b4466 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841135f expref: 20 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.191839:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fc00, rc 0) 00000100:00100000:0.0:1746143835.191864:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963624862976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 508us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.192499:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16232 00000100:00100000:0.0:1746143835.211578:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.211624:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.212443:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7037 00000100:00100000:0.0:1746143835.212455:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624863616:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.216267:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.216305:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.216324:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624864256 00000100:00100000:1.0:1746143835.216332:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624864256 00002000:00100000:1.0:1746143835.216363:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800939a5180 x1830963624864256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.216371:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5180 with x1830963624864256 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.216375:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5180 00000100:00100000:1.0:1746143835.216401:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7038 00000100:00100000:1.0:1746143835.216408:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624864256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.223735:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624863616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11275us (12100us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.223747:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7037 00002000:00100000:1.0:1746143835.223757:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880135b0a300 x1830963624863616/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.223766:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0a300 with x1830963624863616 ext(0->1048575) 00002000:00010000:1.0:1746143835.223771:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0a300 00000100:00100000:0.0:1746143835.230963:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.242039:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.242077:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.242112:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.242403:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624864256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25982us (26122us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.242413:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7038 00002000:00100000:1.0:1746143835.242422:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800939a5180 x1830963624864256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.242436:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5180 with x1830963624864256 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.242441:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a5180 00000100:00100000:0.0:1746143835.243201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.243215:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.243226:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.243239:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624865024 00000100:00100000:0.0:1746143835.243243:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624865024 00000100:00100000:0.0:1746143835.243264:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624865280 00000100:00100000:0.0:1746143835.243266:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624865280 00000100:00100000:0.0:1746143835.243276:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624865536 00000100:00100000:0.0:1746143835.243277:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624865536 00000100:00100000:0.0:1746143835.243287:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16236 00000100:00100000:0.0:1746143835.243292:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624865152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.243300:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.243309:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411390 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.243321:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.243323:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.243327:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 35 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.243336:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 35 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.243343:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ec00, rc 0) 00000100:00100000:0.0:1746143835.243358:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624865152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 67us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.243363:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16236 00000100:00100000:0.0:1746143835.243373:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16238 00000100:00100000:0.0:1746143835.243377:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624865024:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.243384:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.243400:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73b44c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411389 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.243410:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.243411:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.243415:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73b44c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411389 expref: 35 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.243422:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73b44c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411389 expref: 35 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.243428:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e600, rc 0) 00000100:00100000:0.0:1746143835.243442:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624865024:12345-192.168.202.3@tcp:101:cat.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.243447:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16238 00000100:00100000:0.0:1746143835.243457:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16240 00000100:00100000:0.0:1746143835.243461:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624865536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.243466:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.243471:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b44cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484113a5 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.243478:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.243479:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.243483:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b44cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113a5 expref: 35 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.243489:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b44cf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113a5 expref: 35 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.243496:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ea00, rc 0) 00000100:00100000:0.0:1746143835.243507:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624865536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.243511:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16240 00000100:00100000:0.0:1746143835.243598:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.243619:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.243632:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624865792 00000100:00100000:0.0:1746143835.243635:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624865792 00010000:00010000:0.0:1746143835.243651:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b4490 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411374 expref: 262 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.243667:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624865664 00000100:00100000:0.0:1746143835.243669:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624865664 00010000:00010000:0.0:1746143835.243676:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b4412 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411335 expref: 9 pid: 6587 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.243688:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7896 00000100:00100000:0.0:1746143835.243691:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2008:x1830963624865792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.243699:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.243703:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b4490 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411374 expref: 262 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.243711:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b4490 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411374 expref: 262 pid: 10936 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.243726:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.243731:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.243738:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.243743:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.243756:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2008:x1830963624865792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.243761:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7896 00000100:00100000:0.0:1746143835.243770:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7897 00000100:00100000:0.0:1746143835.243774:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624865664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.243779:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.243783:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b4412 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411335 expref: 9 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.243790:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b4412 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411335 expref: 9 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.243799:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.243802:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.243807:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.243813:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.243824:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.243837:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624865664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.243843:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7897 00000100:00100000:0.0:1746143835.243905:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624864512:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27492us (27599us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143835.243931:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7039 00002000:00100000:0.0:1746143835.243938:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800939a4700 x1830963624864512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.243945:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a4700 with x1830963624864512 ext(1048576->2097151) 00002000:00010000:0.0:1746143835.243949:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a4700 00000100:00100000:0.0:1746143835.244008:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.244026:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624865920 00000100:00100000:0.0:1746143835.244029:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624865920 00000100:00100000:0.0:1746143835.244051:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13908 00000100:00100000:0.0:1746143835.244056:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2590:x1830963624865920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.244064:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.244070:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484113ac expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.244101:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.244107:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.244119:0:10936:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143835.244127:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.244134:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.244137:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143835.244139:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.244144:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fa00, rc 0) 00000100:00100000:0.0:1746143835.244159:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2590:x1830963624865920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 103us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.244164:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13908 00010000:00010000:1.0:1746143835.244513:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634a00/0x87925e4cb73b4412 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411335 expref: 8 pid: 6587 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.244530:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627423744:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.244540:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b4490 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411374 expref: 261 pid: 10936 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.244547:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627423872:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.244561:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.244567:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143835.244743:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000040:00080000:1.0:1746143835.245276:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3193, 88 off268832 00000004:00080000:1.0:1746143835.245282:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894469369228ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246711:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3193, 88 off268480 00000004:00080000:1.0:1746143835.246715:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470803181ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246742:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3194, 88 off268568 00000004:00080000:1.0:1746143835.246745:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470832509ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246755:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3194, 88 off268920 00000004:00080000:1.0:1746143835.246758:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470845746ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246765:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3195, 88 off269008 00000004:00080000:1.0:1746143835.246767:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470854979ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246773:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3195, 88 off268656 00000004:00080000:1.0:1746143835.246776:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470863842ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246783:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3196, 88 off268744 00000004:00080000:1.0:1746143835.246786:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470873771ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246793:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3197, 88 off268832 00000004:00080000:1.0:1746143835.246795:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470882909ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246802:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3196, 88 off269096 00000004:00080000:1.0:1746143835.246804:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470891854ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246810:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3198, 88 off268920 00000004:00080000:1.0:1746143835.246812:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470900401ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246819:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3197, 88 off269184 00000004:00080000:1.0:1746143835.246821:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470909476ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246828:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3199, 88 off269008 00000004:00080000:1.0:1746143835.246830:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470917989ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143835.246836:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3198, 88 off269272 00000004:00080000:1.0:1746143835.246838:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470926232ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246845:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3199, 88 off269360 00000004:00080000:1.0:1746143835.246847:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470935279ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246854:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3200, 88 off269448 00000004:00080000:1.0:1746143835.246856:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470944304ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246864:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3201, 88 off269536 00000004:00080000:1.0:1746143835.246866:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 894470954262ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143835.246873:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3200, 88 off269096 00000004:00080000:1.0:1746143835.246876:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 894470963584ns, next at 850789974850ns, rc = 0 00000100:00100000:1.0:1746143835.251755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.251794:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624866048 00000100:00100000:0.0:1746143835.251808:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624866048 00000100:00100000:0.0:1746143835.251866:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13909 00000100:00100000:0.0:1746143835.251874:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:2593:x1830963624866048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.251901:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.251945:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484113b3 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.252010:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.252022:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.252033:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.252036:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143835.252039:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.252046:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7f400, rc 0) 00000100:00100000:0.0:1746143835.252097:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:2593:x1830963624866048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 223us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.252104:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13909 00000001:00080000:0.0:1746143835.254196:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944940 is committed 00000004:00080000:0.0:1746143835.254205:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2414 committed 00000004:00080000:0.0:1746143835.254231:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2418 committed 00000004:00080000:0.0:1746143835.254248:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2417 committed 00000004:00080000:0.0:1746143835.254250:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2416 committed 00000004:00080000:0.0:1746143835.254252:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2415 committed 00000004:00080000:0.0:1746143835.254254:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2413 committed 00000004:00080000:0.0:1746143835.254255:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2414 committed 00000004:00080000:0.0:1746143835.254257:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2412 committed 00000004:00080000:0.0:1746143835.254258:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2413 committed 00000004:00080000:0.0:1746143835.254260:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2411 committed 00000004:00080000:0.0:1746143835.254265:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2410 committed 00000004:00080000:0.0:1746143835.254266:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2409 committed 00000004:00080000:0.0:1746143835.254268:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2412 committed 00000004:00080000:0.0:1746143835.254269:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2411 committed 00000004:00080000:0.0:1746143835.254270:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2408 committed 00000004:00080000:0.0:1746143835.254272:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2407 committed 00000004:00080000:0.0:1746143835.254273:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2410 committed 00000001:00080000:0.0:1746143835.254282:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944939 is committed 00000001:00080000:0.0:1746143835.254291:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944936 is committed 00010000:00010000:1.0:1746143835.254418:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254429:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.254432:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143835.254436:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254445:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254450:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254456:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 260 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254462:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 260 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254467:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 260 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.254500:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 260 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.254510:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627425024:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.254588:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.254734:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627425152:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143835.254782:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.254962:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.254983:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.254999:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143835.255019:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.255032:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143835.255036:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143835.255049:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.255067:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143835.255079:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.255447:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627424768 00000100:00100000:1.0:1746143835.255453:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627424768 00000100:00100000:1.0:1746143835.255481:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627424000 00000100:00100000:1.0:1746143835.255483:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627424000 00000100:00100000:1.0:1746143835.255493:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627424512 00000100:00100000:1.0:1746143835.255495:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627424512 00000100:00100000:1.0:1746143835.255504:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627424384 00000100:00100000:1.0:1746143835.255506:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627424384 00000100:00100000:1.0:1746143835.255514:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627424896 00000100:00100000:1.0:1746143835.255516:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627424896 00000100:00100000:1.0:1746143835.255528:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16241 00000100:00100000:1.0:1746143835.255534:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963627424768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.255664:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3774:x1830963627424768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (799us total) trans 21474841168 rc 0/0 00000100:00100000:1.0:1746143835.255669:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16241 00000100:00100000:1.0:1746143835.255683:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16242 00000100:00100000:1.0:1746143835.255687:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627424000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143835.255729:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143835.255732:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143835 -> 1746143835 00002000:00010000:1.0:1746143835.255734:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143835 -> 1746143835 00002000:00010000:1.0:1746143835.255735:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143835 -> 1746143835 00002000:00010000:1.0:1746143835.255737:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143835.255758:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627424000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (776us total) trans 21474841169 rc 0/0 00000100:00100000:1.0:1746143835.255766:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16242 00000100:00100000:1.0:1746143835.255775:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16243 00000100:00100000:1.0:1746143835.255778:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627424512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.256239:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627424512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 459us (1218us total) trans 21474841170 rc 0/0 00000100:00100000:1.0:1746143835.256244:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16243 00000100:00100000:1.0:1746143835.256254:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16244 00000100:00100000:1.0:1746143835.256258:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627424384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143835.256297:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143835.256300:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.256301:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143835.256303:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.256304:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:1.0:1746143835.256322:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627424384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1272us total) trans 21474841171 rc 0/0 00000100:00100000:1.0:1746143835.256327:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16244 00000100:00100000:1.0:1746143835.256335:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16245 00000100:00100000:1.0:1746143835.256339:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627424896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.256387:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627424896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (1306us total) trans 21474841172 rc 0/0 00000100:00100000:1.0:1746143835.256401:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16245 00000004:00080000:1.0:1746143835.256477:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972eaa00/2, rc 0, transno 21474841168 00000100:00100000:1.0:1746143835.256482:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627424768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.256555:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627425664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.256578:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.256591:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627426176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.256601:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.256612:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143835.256615:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627425280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.256627:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.256752:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627425792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.256773:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.256792:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627425664 00000100:00100000:1.0:1746143835.256795:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627425664 00000100:00100000:1.0:1746143835.256809:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627426176 00000100:00100000:1.0:1746143835.256811:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627426176 00000100:00100000:1.0:1746143835.256816:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627425280 00000100:00100000:1.0:1746143835.256818:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627425280 00000100:00100000:1.0:1746143835.256824:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627425792 00000100:00100000:1.0:1746143835.256825:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627425792 00000100:00100000:1.0:1746143835.256833:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16246 00000100:00100000:1.0:1746143835.256837:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3771:x1830963627425664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.256908:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3771:x1830963627425664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (330us total) trans 17179873894 rc 0/0 00000100:00100000:1.0:1746143835.256928:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16246 00000100:00100000:1.0:1746143835.256936:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16247 00000100:00100000:1.0:1746143835.256940:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3771:x1830963627426176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143835.256973:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:1.0:1746143835.256976:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.256977:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143835.256979:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.256980:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:1.0:1746143835.256996:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3771:x1830963627426176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (393us total) trans 17179873895 rc 0/0 00000100:00100000:1.0:1746143835.257001:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16247 00000100:00100000:1.0:1746143835.257011:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16249 00000100:00100000:1.0:1746143835.257015:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3771:x1830963627425792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257060:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3771:x1830963627425792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (286us total) trans 17179873896 rc 0/0 00000100:00100000:1.0:1746143835.257065:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16249 00000100:00100000:1.0:1746143835.257073:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16250 00000100:00100000:1.0:1746143835.257077:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3774:x1830963627424256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143835.257114:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143835.257116:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143834 -> 1746143834 00002000:00010000:1.0:1746143835.257118:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143834 -> 1746143834 00002000:00010000:1.0:1746143835.257119:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143834 -> 1746143834 00002000:00010000:1.0:1746143835.257121:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143835.257141:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963627424256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (2321us total) trans 21474841173 rc 0/0 00000100:00100000:1.0:1746143835.257147:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16250 00000004:00080000:1.0:1746143835.257178:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096940700/2, rc 0, transno 17179873897 00000100:00100000:1.0:1746143835.257184:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627425280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143835.257190:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096941180/2, rc 0, transno 17179873896 00000100:00100000:1.0:1746143835.257193:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627425792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143835.257198:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096941500/2, rc 0, transno 17179873894 00000100:00100000:1.0:1746143835.257200:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627425664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143835.257206:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096941c00/2, rc 0, transno 17179873895 00000100:00100000:1.0:1746143835.257209:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627426176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257222:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627425536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257237:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.257261:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627426048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257274:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143835.257303:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972ea680/2, rc 0, transno 21474841173 00000100:00100000:1.0:1746143835.257307:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627424256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143835.257313:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746143835.257317:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627425408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257331:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.257341:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627425920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257351:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.257367:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627425408 00000100:00100000:1.0:1746143835.257370:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627425408 00000100:00100000:1.0:1746143835.257402:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627425920 00000100:00100000:1.0:1746143835.257404:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627425920 00000100:00100000:1.0:1746143835.257416:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16252 00000100:00100000:1.0:1746143835.257423:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627426048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143835.257475:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143835.257477:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.257479:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143835.257481:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.257483:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:1.0:1746143835.257505:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963627426048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (228us total) trans 17179873899 rc 0/0 00000100:00100000:1.0:1746143835.257513:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16252 00000100:00100000:1.0:1746143835.257526:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16256 00000100:00100000:1.0:1746143835.257531:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627424640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143835.257572:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:1.0:1746143835.257575:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.257577:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143835.257579:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143835.257580:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:1.0:1746143835.257607:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627424640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (134us total) trans 21474841175 rc 0/0 00000100:00100000:1.0:1746143835.257613:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16256 00000100:00100000:1.0:1746143835.257634:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746143835.257641:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627426304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143835.257657:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143835.257694:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096942680/2, rc 0, transno 17179873900 00000100:00100000:1.0:1746143835.257698:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627425408:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143835.257705:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096941880/2, rc 0, transno 17179873901 00000100:00100000:1.0:1746143835.257707:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627425920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143835.257715:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096942d80/2, rc 0, transno 17179873898 00000100:00100000:1.0:1746143835.257717:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627425536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143835.257722:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096943b80/2, rc 0, transno 17179873899 00000100:00100000:1.0:1746143835.257724:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627426048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143835.257843:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972eb800/2, rc 0, transno 21474841171 00000100:00100000:0.0:1746143835.257847:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143835.257855:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972e9f80/2, rc 0, transno 21474841172 00000100:00100000:0.0:1746143835.257858:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143835.257865:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972e9c00/2, rc 0, transno 21474841169 00000100:00100000:0.0:1746143835.257868:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143835.257874:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972e9880/2, rc 0, transno 21474841170 00000100:00100000:0.0:1746143835.257877:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627424512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143835.259564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.259590:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624866176 00000100:00100000:0.0:1746143835.259594:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624866176 00000100:00100000:0.0:1746143835.259643:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5358 00000100:00100000:0.0:1746143835.259650:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:2593:x1830963624866176:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:0.0:1746143835.259747:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:2593:x1830963624866176:12345-192.168.202.3@tcp:49:cat.0 Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.259753:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5358 00000004:00080000:1.0:1746143835.260056:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6c700/2, rc 0, transno 17179873902 00000100:00100000:1.0:1746143835.260062:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627426304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143835.263203:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.264869:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.264941:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624866432 00000100:00100000:1.0:1746143835.264946:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624866432 00000100:00100000:1.0:1746143835.264982:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5360 00000100:00100000:1.0:1746143835.264988:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2589:x1830963624866432:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:1.0:1746143835.265375:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2589:x1830963624866432:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 385us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.265381:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5360 00000100:00100000:0.0:1746143835.277579:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.280928:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.280963:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.281000:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.292957:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624867712 00000100:00100000:1.0:1746143835.292966:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624867712 00002000:00100000:1.0:1746143835.293006:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6dc00 x1830963624867712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.293017:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6dc00 with x1830963624867712 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.293023:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6dc00 00000100:00100000:1.0:1746143835.293043:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624867584 00000100:00100000:1.0:1746143835.293045:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624867584 00002000:00100000:1.0:1746143835.293053:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129e6e300 x1830963624867584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.293059:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6e300 with x1830963624867584 ext(0->1048575) 00002000:00010000:1.0:1746143835.293061:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6e300 00000100:00100000:1.0:1746143835.293071:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7042 00000100:00100000:1.0:1746143835.293076:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963624867712:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143835.310118:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.330113:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963624868864:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 33591us (33796us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143835.330125:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7046 00002000:00100000:0.0:1746143835.330139:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6c380 x1830963624868864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.330150:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6c380 with x1830963624868864 ext(1048576->2097151) 00002000:00010000:0.0:1746143835.330157:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6c380 00000100:00100000:1.0:1746143835.330557:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963624867712:12345-192.168.202.3@tcp:3:cat.0 Request processed in 37479us (38022us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.330564:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7042 00002000:00100000:1.0:1746143835.330570:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6dc00 x1830963624867712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.330577:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6dc00 with x1830963624867712 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.330580:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6dc00 00000100:00100000:0.0:1746143835.330747:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.335431:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.338185:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624869632 00000100:00100000:1.0:1746143835.338202:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624869632 00000100:00100000:1.0:1746143835.338257:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5361 00000100:00100000:1.0:1746143835.338265:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137359850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2589:x1830963624869632:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143835.338504:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137359850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2589:x1830963624869632:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 239us (3082us total) trans 8589944942 rc 0/0 00000100:00100000:1.0:1746143835.338512:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5361 00000100:00100000:0.0:1746143835.341407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.354721:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.354760:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.354835:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.359008:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.359062:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.359153:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624870400 00000100:00100000:1.0:1746143835.359163:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624870400 00010000:00010000:1.0:1746143835.359193:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b4474 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841136d expref: 22 pid: 3135 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143835.359227:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7901 00000100:00100000:1.0:1746143835.359234:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624870400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.359245:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.359263:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b4474 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841136d expref: 22 pid: 3135 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.359273:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b4474 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841136d expref: 22 pid: 3135 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.359410:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b4474 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841136d expref: 22 pid: 3135 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.359436:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.359439:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.359446:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77a00/0x87925e4cb73b451c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2109440->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113d6 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.359454:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77a00/0x87925e4cb73b451c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2109440->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113d6 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.359486:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77a00/0x87925e4cb73b451c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2109440->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113d6 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.359498:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627427200:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.359563:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.362441:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627427200:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143835.362445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143835.362456:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.362491:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136337480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963624870400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3257us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.362498:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7901 00000100:00100000:0.0:1746143835.362518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.362889:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624870784 00000100:00100000:1.0:1746143835.362893:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624870784 00010000:00010000:1.0:1746143835.363047:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73b4507 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c1 expref: 23 pid: 3135 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.363072:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7902 00000100:00100000:1.0:1746143835.363077:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624870784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.363085:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.363096:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73b4507 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3387392->3891199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c1 expref: 23 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.363110:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73b4507 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3387392->3891199) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c1 expref: 23 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.363128:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b47aa00/0x87925e4cb73b4507 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3387392->3891199) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c1 expref: 23 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.363140:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.363142:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.363148:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.363155:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.363162:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.363163:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.363167:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.363173:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.363199:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.363215:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627427328:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.363435:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.363444:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627427456:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.363463:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.366565:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627427328:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.366576:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627427456:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.366591:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.366681:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.366931:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624870784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3832us (4390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.366942:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7902 00000100:00100000:0.0:1746143835.376766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.377234:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.379170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.382446:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13911 00000100:00100000:1.0:1746143835.382461:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2598:x1830963624871680:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143835.382488:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.382509:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b4523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484113dd expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.382573:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382587:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382598:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382611:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382616:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382620:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382699:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382708:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382713:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143835.382752:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:1.0:1746143835.382756:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143835.382772:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382781:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382789:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382794:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382799:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382807:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382812:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84e000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143835.382815:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382821:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382832:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143835.382834:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143835.382838:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382843:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e000/0x87925e4cb73b452a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382871:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382982:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382987:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382990:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84f200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143835.382992:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.382996:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.383006:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880096d83d00) 00010000:00010000:1.0:1746143835.383008:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143835.383010:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.383014:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.383042:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b4523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.383053:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.383058:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.383060:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143835.383062:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:1.0:1746143835.383111:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2598:x1830963624871680:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 655us (3945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.383118:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13911 00000100:00100000:0.0:1746143835.386074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.397101:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.397439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.397645:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.397667:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.398103:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.398126:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.398151:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16264 00000100:00100000:0.0:1746143835.398158:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624872448:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143835.398164:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.398171:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b454d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411407 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.398179:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.398180:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.398184:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b454d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411407 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.398191:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b454d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411407 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.398196:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ce00, rc 0) 00000100:00100000:1.0:1746143835.398313:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16267 00000100:00100000:1.0:1746143835.398321:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624872576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143835.398329:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.398338:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73b4562 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841140e expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.398371:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627427712:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143835.398520:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624872448:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 362us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.398525:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16264 00000100:00100000:1.0:1746143835.398760:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114a80 going to sleep for 11 seconds 00002000:00010000:1.0:1746143835.401050:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143834 -> 1746143835 00002000:00010000:1.0:1746143835.401056:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143834 -> 1746143835 00002000:00010000:1.0:1746143835.401057:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143834 -> 1746143835 00000100:00100000:1.0:1746143835.401073:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627427712:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143835.401095:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73b4562 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841140e expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.401105:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551200/0x87925e4cb73b4562 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841140e expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.401130:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00000100:00100000:1.0:1746143835.401164:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624872576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2844us (3036us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143835.401170:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16267 00000100:00100000:0.0:1746143835.407139:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.407247:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624872704 00000100:00100000:1.0:1746143835.407256:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624872704 00000100:00100000:1.0:1746143835.407307:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16269 00000100:00100000:1.0:1746143835.407314:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2593:x1830963624872704:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.407330:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.407345:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b4570 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411415 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.407369:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143835.407374:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b4570 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411415 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.407397:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b4570 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411415 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.407406:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00000100:00100000:1.0:1746143835.407456:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2593:x1830963624872704:12345-192.168.202.3@tcp:101:cat.0 Request processed in 141us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.407461:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16269 00000100:00100000:0.0:1746143835.408996:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.409073:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624872960 00000100:00100000:1.0:1746143835.409079:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624872960 00000100:00100000:1.0:1746143835.409110:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13912 00000100:00100000:1.0:1746143835.409116:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2598:x1830963624872960:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143835.409201:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.409215:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73b4577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841141c expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.409285:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.409296:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.409302:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.409307:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.409331:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.409340:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 8 pid: 7245 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.409349:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627427840:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.410104:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.410112:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 262 pid: 6587 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.410120:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627427968:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.410437:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.410694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.410725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.411567:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627427840:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.411579:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627427968:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.411596:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143835.411752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.411810:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624873600 00000100:00100000:1.0:1746143835.411813:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624873600 00010000:00010000:1.0:1746143835.411828:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 265 pid: 6587 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.411844:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7903 00000100:00100000:1.0:1746143835.411848:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2010:x1830963624873600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.411856:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.411860:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 265 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.411867:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 265 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.411882:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77c00/0x87925e4cb73b44f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ba expref: 265 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.411902:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.411906:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.411934:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.411939:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.412195:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2010:x1830963624873600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 344us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.412200:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7903 00000100:00100000:1.0:1746143835.415773:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624873728 00000100:00100000:1.0:1746143835.415784:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624873728 00010000:00010000:1.0:1746143835.415825:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 9 pid: 7245 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.415875:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7904 00000100:00100000:1.0:1746143835.415884:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624873728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.415898:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.415905:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 9 pid: 7245 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.415945:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 9 pid: 7245 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.415967:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b4538 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113dd expref: 9 pid: 7245 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.415982:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.415987:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.415995:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.416001:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.416022:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.416059:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963624873728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 177us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.416065:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7904 00010000:00010000:0.0:1746143835.417322:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.417333:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143835.417353:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143835.417493:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550a00/0x87925e4cb73b4577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841141c expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.417515:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841141c expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.417522:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.417525:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143835.417528:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:0.0:1746143835.417768:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2598:x1830963624872960:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8650us (8773us total) trans 8589944944 rc 0/0 00000100:00100000:0.0:1746143835.417775:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13912 00000100:00100000:0.0:1746143835.421611:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.424902:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.425023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.425040:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624874112 00000100:00100000:0.0:1746143835.425044:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624874112 00010000:00010000:0.0:1746143835.425061:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841141c expref: 10 pid: 7245 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.425080:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7906 00000100:00100000:0.0:1746143835.425084:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624874112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.425096:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.425100:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841141c expref: 10 pid: 7245 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.425107:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b457e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841141c expref: 10 pid: 7245 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.425120:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.425124:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b4593 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.425132:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b4593 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.425138:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b4593 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.425153:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.425191:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624874112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.425196:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7906 00000100:00100000:0.0:1746143835.433090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.433144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.436497:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.436664:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.436675:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624875008 00000100:00100000:1.0:1746143835.436678:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624875008 00002000:00100000:1.0:1746143835.436698:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092b44000 x1830963624875008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.436705:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44000 with x1830963624875008 ext(3145728->4194303) 00002000:00010000:1.0:1746143835.436709:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b44000 00000100:00100000:1.0:1746143835.436730:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7055 00000100:00100000:1.0:1746143835.436735:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624875008:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.437500:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.463619:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624875008:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26872us (26944us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.463632:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7055 00002000:00100000:1.0:1746143835.463645:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092b44000 x1830963624875008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.463655:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44000 with x1830963624875008 ext(3145728->4194303) 00002000:00010000:1.0:1746143835.463661:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b44000 00000100:00100000:0.0:1746143835.467657:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.467761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.467785:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.467807:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.467887:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624875392 00000100:00100000:1.0:1746143835.467896:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624875392 00000100:00100000:0.0:1746143835.467901:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.467937:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.467959:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624875520 00000100:00100000:1.0:1746143835.467962:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624875520 00000100:00100000:1.0:1746143835.468522:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16272 00000100:00100000:1.0:1746143835.468528:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624875520:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143835.468548:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092b24600/0x87925e4cb73b45bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.468558:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096f6d600/0x87925e4cb73b4458 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411351 expref: 21 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.468566:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b4554 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113f2 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.468573:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73b44c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411389 expref: 36 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.468579:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.468581:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.468583:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24600/0x87925e4cb73b45bd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.468597:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73b44c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411389 expref: 36 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.468605:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e600/0x87925e4cb73b44c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411389 expref: 36 pid: 13436 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143835.468614:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627428608:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143835.468749:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16273 00000100:00100000:0.0:1746143835.468757:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624875648:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143835.468773:0:13436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.468782:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 21 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.468789:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b4569 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113f9 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.468795:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.468800:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.468801:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.468803:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.468817:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.468824:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.468831:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627428736:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.468940:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16275 00000100:00100000:1.0:1746143835.468946:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963624875904:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143835.468961:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b45d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.468970:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.468975:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ce00/0x87925e4cb73b454d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411407 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.468981:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.468990:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.468991:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.468992:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b45d2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469004:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469010:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 21 pid: 3135 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.469017:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627428992:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.469044:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16276 00000100:00100000:1.0:1746143835.469049:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624876032:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143835.469061:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b45d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469069:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77400/0x87925e4cb73b453f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113e4 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469074:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b459a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841142a expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.469080:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b4570 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411415 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469088:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.469089:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.469090:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b45d9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469101:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b4570 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411415 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469107:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b4570 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411415 expref: 36 pid: 9586 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.469113:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627429120:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.469170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.469255:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624876288 00000100:00100000:1.0:1746143835.469258:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624876288 00002000:00100000:1.0:1746143835.469280:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880092b45500 x1830963624876288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.469288:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45500 with x1830963624876288 ext(4194304->4853759) 00010000:00010000:1.0:1746143835.469293:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.469300:0:20386:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143835.469305:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b45500 00000100:00100000:1.0:1746143835.469320:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2621 00000100:00100000:1.0:1746143835.469324:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963624876288:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143835.477146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.479954:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.479992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.480516:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.481833:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624877056 00000100:00100000:1.0:1746143835.481837:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624877056 00002000:00100000:1.0:1746143835.481862:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012457ed80 x1830963624877056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.481871:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ed80 with x1830963624877056 ext(4194304->4853759) 00010000:00010000:1.0:1746143835.481876:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.481885:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143835.481890:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457ed80 00000100:00100000:1.0:1746143835.481902:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2622 00000100:00100000:1.0:1746143835.481907:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624877056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.483673:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624876288:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14345us (14499us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143835.483682:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2621 00002000:00100000:1.0:1746143835.483690:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880092b45500 x1830963624876288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.483698:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45500 with x1830963624876288 ext(4194304->4853759) 00010000:00010000:1.0:1746143835.483705:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 35 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.483718:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 35 pid: 3135 timeout: 994 lvb_type: 0 00002000:00010000:1.0:1746143835.483723:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b45500 00000100:00100000:0.0:1746143835.487069:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.487089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.487126:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627430272:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143835.487154:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096943100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627430528:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143835.487175:0:13436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143835.487199:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.487208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.487228:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627430784:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143835.487239:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143835.487262:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.487276:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624877312 00000100:00100000:0.0:1746143835.487280:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624877312 00010000:00010000:0.0:1746143835.487300:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.487315:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624877440 00000100:00100000:0.0:1746143835.487316:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624877440 00010000:00010000:0.0:1746143835.487323:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b4546 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113eb expref: 13 pid: 9839 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.487329:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624877696 00000100:00100000:0.0:1746143835.487331:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624877696 00010000:00010000:0.0:1746143835.487336:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b455b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411400 expref: 14 pid: 9839 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.487343:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624877568 00000100:00100000:0.0:1746143835.487344:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624877568 00010000:00010000:0.0:1746143835.487351:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b4569 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113f9 expref: 13 pid: 12327 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.487356:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624877952 00000100:00100000:0.0:1746143835.487358:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624877952 00010000:00010000:0.0:1746143835.487363:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e29a00/0x87925e4cb73b45a8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411431 expref: 10 pid: 6587 timeout: 994 lvb_type: 0 00000100:00100000:0.0:1746143835.487372:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7909 00000100:00100000:0.0:1746143835.487376:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963624877312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.487385:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.487409:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487417:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487433:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b44b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411390 expref: 36 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487448:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.487471:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963624877312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.487477:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7909 00000100:00100000:0.0:1746143835.487504:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7910 00000100:00100000:0.0:1746143835.487507:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963624877440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.487513:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.487521:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b4546 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113eb expref: 14 pid: 9839 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487529:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b4546 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113eb expref: 14 pid: 9839 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487539:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.487551:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963624877440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 43us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.487556:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7910 00000100:00100000:0.0:1746143835.487565:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7911 00000100:00100000:0.0:1746143835.487569:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963624877696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.487574:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.487581:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b455b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411400 expref: 13 pid: 9839 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487588:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b455b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411400 expref: 13 pid: 9839 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487598:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.487608:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963624877696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.487613:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7911 00000100:00100000:0.0:1746143835.487620:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7912 00000100:00100000:0.0:1746143835.487623:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963624877568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.487627:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.487632:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b4569 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113f9 expref: 13 pid: 12327 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487638:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b4569 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113f9 expref: 13 pid: 12327 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487646:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b4569 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113f9 expref: 13 pid: 12327 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.487652:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.487661:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963624877568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 38us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.487665:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7912 00000100:00100000:0.0:1746143835.487671:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7913 00000100:00100000:0.0:1746143835.487674:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963624877952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.487679:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.487682:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130e29a00/0x87925e4cb73b45a8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411431 expref: 10 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.487688:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130e29a00/0x87925e4cb73b45a8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411431 expref: 10 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.487702:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e29a00/0x87925e4cb73b45a8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411431 expref: 10 pid: 6587 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.487711:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.487714:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487722:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487727:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487738:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.487746:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624877952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 71us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.487750:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7913 00010000:00010000:0.0:1746143835.487759:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487764:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143835.487774:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143835.487834:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487839:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487844:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487849:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c529600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143835.487852:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487857:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487863:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.487865:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143835.487867:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487871:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b45f5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487885:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487889:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487894:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487897:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487900:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4d85200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143835.487902:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487906:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487929:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143835.487931:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143835.487934:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487938:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b45e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487945:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487949:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487954:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487958:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c528200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143835.487959:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487964:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487969:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7100) 00010000:00010000:0.0:1746143835.487971:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143835.487972:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.487976:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b45ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.488005:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b45e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411438 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.488011:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b45e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411438 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.488018:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e522e00, rc 0) 00000100:00100000:0.0:1746143835.488036:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2601:x1830963624876544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10401us (10896us total) trans 8589944946 rc 301/301 00000100:00100000:0.0:1746143835.488041:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13915 00000100:00100000:1.0:1746143835.488986:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627430144:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.489008:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b4546 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113eb expref: 11 pid: 9839 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143835.489026:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627429248:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.492070:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624878080 00000100:00100000:1.0:1746143835.492078:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624878080 00010000:00010000:1.0:1746143835.492104:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 22 pid: 1945 timeout: 994 lvb_type: 1 00000100:00100000:1.0:1746143835.492128:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7914 00000100:00100000:1.0:1746143835.492133:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624878080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.492143:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.492157:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 22 pid: 1945 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.492167:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 22 pid: 1945 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.492183:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048e00/0x87925e4cb73b445f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411358 expref: 22 pid: 1945 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.492195:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.492197:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.492201:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492208:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492227:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.492257:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963624878080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 123us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.492264:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7914 00010000:00010000:1.0:1746143835.492324:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492331:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492345:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492353:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492358:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492368:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84fe00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143835.492371:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492376:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492384:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.492400:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b45c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.492442:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624875648:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 23687us (24655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.492449:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16273 00010000:00010000:0.0:1746143835.496987:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73b4451 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841134a expref: 22 pid: 13436 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.496996:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627429376:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143835.497015:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497021:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497027:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497038:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497043:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497052:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497057:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143835.497059:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497065:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497073:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.497079:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76a00/0x87925e4cb73b45b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143835.497112:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624875392:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 28976us (29464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.497117:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16271 00000100:00100000:1.0:1746143835.497594:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624878976 00000100:00100000:1.0:1746143835.497598:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624878976 00010000:00010000:1.0:1746143835.497613:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77400/0x87925e4cb73b453f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113e4 expref: 20 pid: 3135 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.497629:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7923 00000100:00100000:1.0:1746143835.497634:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963624878976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.497641:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.497648:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e77400/0x87925e4cb73b453f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113e4 expref: 20 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.497656:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e77400/0x87925e4cb73b453f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113e4 expref: 20 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.497667:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77400/0x87925e4cb73b453f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113e4 expref: 20 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.497674:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.497676:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.497678:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b45d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.497684:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b45d9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143835.498285:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963624877056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16372us (17763us total) trans 0 rc 659456/659456 00000100:00100000:0.0:1746143835.498295:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2622 00002000:00100000:0.0:1746143835.498304:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012457ed80 x1830963624877056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.498311:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ed80 with x1830963624877056 ext(4194304->4853759) 00010000:00010000:0.0:1746143835.498317:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 20 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:0.0:1746143835.498434:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 20 pid: 3135 timeout: 994 lvb_type: 0 00002000:00010000:0.0:1746143835.498441:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457ed80 00010000:00010000:1.0:1746143835.498830:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.498851:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963624878976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1216us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.498857:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7923 00000100:00100000:0.0:1746143835.499404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.499429:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.499451:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.499473:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.499483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.499500:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.499620:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16279 00000100:00100000:1.0:1746143835.499625:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963624879360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.499630:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.499636:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841144d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143835.499645:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a5a, atime: 0x68140a5a, ctime: 0x68140a5a, blocks: 0x808 00010000:00010000:1.0:1746143835.499651:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.499652:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.499655:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 38 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.499663:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 38 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.499669:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d400, rc 0) 00000100:00100000:1.0:1746143835.499679:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963624879360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 55us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.499684:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16279 00000100:00100000:1.0:1746143835.499692:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16282 00000100:00100000:1.0:1746143835.499695:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963624879744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.499699:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.499705:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4626 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411462 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143835.499711:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a5b, atime: 0x68140a5a, ctime: 0x68140a5b, blocks: 0x1008 00010000:00010000:1.0:1746143835.499716:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.499717:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.499721:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411462 expref: 37 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.499728:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411462 expref: 37 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143835.499733:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d200, rc 0) 00000100:00100000:1.0:1746143835.499743:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963624879744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 47us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.499748:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16282 00000100:00100000:0.0:1746143835.503888:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.504121:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624879872 00000100:00100000:1.0:1746143835.504129:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624879872 00010000:00010000:1.0:1746143835.504156:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 36 pid: 3135 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.504191:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7924 00000100:00100000:1.0:1746143835.504431:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963624879872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.504444:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.504463:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 36 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.504473:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 36 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.504492:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53800/0x87925e4cb73b450e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113c8 expref: 36 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.504573:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.504732:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963624879872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 533us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.504739:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7924 00000100:00100000:0.0:1746143835.510303:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.510978:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.511005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.511020:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.511292:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624880000 00000100:00100000:1.0:1746143835.511301:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624880000 00000100:00100000:1.0:1746143835.511330:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624880512 00000100:00100000:1.0:1746143835.511333:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624880512 00000100:00100000:0.0:1746143835.511333:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.511400:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.511417:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16283 00000100:00100000:0.0:1746143835.511424:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624880000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.511437:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.511449:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411469 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.511466:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.511468:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.511474:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.511486:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.511495:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f400, rc 0) 00000100:00100000:0.0:1746143835.511527:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963624880000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 104us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.511532:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16283 00000100:00100000:0.0:1746143835.511545:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16285 00000100:00100000:0.0:1746143835.511549:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624880512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.511554:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.511559:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b463b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411485 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.511567:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.511574:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b463b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411485 expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.511581:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b463b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411485 expref: 23 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.511593:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:0.0:1746143835.511602:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624880512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 54us (597us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143835.511610:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16285 00000100:00100000:0.0:1746143835.511616:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16288 00000100:00100000:0.0:1746143835.511619:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963624880640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143835.511624:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.511629:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841148c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.511634:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.511635:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.511639:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841148c expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.511646:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841148c expref: 22 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143835.512465:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f200, rc 0) 00000100:00100000:0.0:1746143835.512496:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624880640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 874us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.512500:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16288 00000100:00100000:0.0:1746143835.514805:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.515579:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.516031:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624880768 00000100:00100000:1.0:1746143835.516035:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624880768 00010000:00010000:1.0:1746143835.516054:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.516074:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7925 00000100:00100000:1.0:1746143835.516081:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624880768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.516092:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.516107:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.516117:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.516135:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b4515 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113cf expref: 22 pid: 3135 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.517068:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.517089:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963624880768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1008us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.517095:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7925 00000100:00100000:0.0:1746143835.517173:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.522283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.522326:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.523625:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624881280 00000100:00100000:1.0:1746143835.523631:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624881280 00002000:00100000:1.0:1746143835.523662:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff8800931c7b80 x1830963624881280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.523671:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c7b80 with x1830963624881280 ext(4849664->4853759) 00002000:00010000:1.0:1746143835.523676:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931c7b80 00000100:00100000:1.0:1746143835.523690:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624881536 00000100:00100000:1.0:1746143835.523692:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624881536 00002000:00100000:1.0:1746143835.523701:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff8800931c4000 x1830963624881536/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.523707:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c4000 with x1830963624881536 ext(4849664->4853759) 00002000:00010000:1.0:1746143835.523710:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931c4000 00000100:00100000:1.0:1746143835.523719:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7056 00000100:00100000:1.0:1746143835.523724:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624881280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.523811:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963624881280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 87us (1536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143835.523817:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7056 00002000:00100000:1.0:1746143835.523821:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff8800931c7b80 x1830963624881280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.523827:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c7b80 with x1830963624881280 ext(4849664->4853759) 00002000:00010000:1.0:1746143835.523830:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931c7b80 00000100:00100000:1.0:1746143835.523839:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7057 00000100:00100000:1.0:1746143835.523843:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963624881536:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.523876:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963624881536:12345-192.168.202.3@tcp:3:cat.0 Request processed in 32us (1549us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143835.523881:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7057 00002000:00100000:1.0:1746143835.523885:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff8800931c4000 x1830963624881536/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/4536 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.523891:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c4000 with x1830963624881536 ext(4849664->4853759) 00002000:00010000:1.0:1746143835.523894:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931c4000 00000100:00100000:0.0:1746143835.533631:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.534994:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.535069:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.535084:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624882048 00000100:00100000:1.0:1746143835.535090:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624882048 00000100:00100000:1.0:1746143835.535117:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624882304 00000100:00100000:1.0:1746143835.535119:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624882304 00000100:00100000:1.0:1746143835.535134:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5363 00000100:00100000:1.0:1746143835.535140:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2590:x1830963624882048:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143835.535207:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5364 00000100:00100000:0.0:1746143835.535214:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:2593:x1830963624882304:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143835.535703:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2590:x1830963624882048:12345-192.168.202.3@tcp:35:cat.0 Request processed in 562us (711us total) trans 8589944948 rc 0/0 00000100:00100000:1.0:1746143835.535709:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5363 00000100:00100000:1.0:1746143835.536249:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+264:2593:x1830963624882304:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1035us (1179us total) trans 8589944947 rc 0/0 00000100:00100000:1.0:1746143835.536301:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5364 00000100:00100000:0.0:1746143835.540799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.541986:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624882560 00000100:00100000:1.0:1746143835.541997:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624882560 00000100:00100000:1.0:1746143835.542046:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5365 00000100:00100000:1.0:1746143835.542055:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2598:x1830963624882560:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143835.542273:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2598:x1830963624882560:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 219us (1486us total) trans 8589944949 rc 0/0 00000100:00100000:1.0:1746143835.542280:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5365 00000100:00100000:0.0:1746143835.547229:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624882816 00000100:00100000:0.0:1746143835.547238:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624882816 00000100:00100000:0.0:1746143835.547660:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13917 00000100:00100000:0.0:1746143835.547669:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:2603:x1830963624882816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143835.547691:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143835.547709:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484114a1 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.547783:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.547796:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.547806:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.547817:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.547822:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.547827:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549241:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549253:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549260:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746143835.549270:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143835.549352:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549358:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549363:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549368:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549374:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84fc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143835.549377:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549384:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549405:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143835.549408:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143835.549411:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549416:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b466c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549431:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549440:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549444:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549448:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143835.549450:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549455:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549460:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030d00) 00010000:00010000:0.0:1746143835.549462:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143835.549464:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549469:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ea00/0x87925e4cb73b4673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143835.549822:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fa00/0x87925e4cb73b4665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a1 expref: 267 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.549836:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a1 expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.549843:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143835.549845:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143835.549848:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d85200, rc 0) 00000100:00100000:0.0:1746143835.551267:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:2603:x1830963624882816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3590us (4176us total) trans 8589944950 rc 0/0 00000100:00100000:0.0:1746143835.551278:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13917 00000100:00100000:1.0:1746143835.552131:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624883072 00000100:00100000:1.0:1746143835.552140:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624883072 00000100:00100000:1.0:1746143835.552503:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5366 00000100:00100000:1.0:1746143835.552512:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2598:x1830963624883072:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143835.553938:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2598:x1830963624883072:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1421us (2428us total) trans 8589944951 rc 0/0 00000100:00100000:1.0:1746143835.553946:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5366 00000100:00100000:0.0:1746143835.569419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.569452:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.569472:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624883328 00000100:00100000:0.0:1746143835.569478:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624883328 00000100:00100000:1.0:1746143835.569492:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624883456 00000100:00100000:1.0:1746143835.569502:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624883456 00010000:00010000:0.0:1746143835.569505:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841148c expref: 22 pid: 9585 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.569531:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4626 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411462 expref: 39 pid: 13436 timeout: 994 lvb_type: 1 00000100:00100000:0.0:1746143835.569542:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7926 00000100:00100000:1.0:1746143835.569638:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7927 00000100:00100000:1.0:1746143835.569644:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963624883456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.569657:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.569678:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4626 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411462 expref: 39 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.569689:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411462 expref: 39 pid: 13436 timeout: 994 lvb_type: 1 00010000:00010000:1.0:1746143835.569716:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.569778:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963624883456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.569784:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7927 00000100:00100000:0.0:1746143835.570373:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624883328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143835.570384:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143835.570411:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841148c expref: 22 pid: 9585 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.570421:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841148c expref: 22 pid: 9585 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.570438:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b4650 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841148c expref: 22 pid: 9585 timeout: 994 lvb_type: 1 00010000:00010000:0.0:1746143835.570461:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.570462:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143835.570467:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 36 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.570475:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 36 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143835.570499:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 36 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143835.570509:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627431296:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143835.570559:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.573971:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.579306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.583041:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.583122:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624884224 00000100:00100000:1.0:1746143835.583131:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624884224 00000100:00100000:1.0:1746143835.583181:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5367 00000100:00100000:1.0:1746143835.583188:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137359450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:2603:x1830963624884224:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143835.583427:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137359450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+267:2603:x1830963624884224:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 240us (394us total) trans 8589944952 rc 0/0 00000100:00100000:1.0:1746143835.583435:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5367 00000100:00100000:0.0:1746143835.627073:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.630217:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.632565:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.633053:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624884608 00000100:00100000:1.0:1746143835.633060:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624884608 00010000:00010000:1.0:1746143835.633084:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b4657 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411493 expref: 36 pid: 9585 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.633118:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7929 00000100:00100000:1.0:1746143835.633125:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963624884608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.633136:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.633155:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b4657 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411493 expref: 36 pid: 9585 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.633165:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b4657 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411493 expref: 36 pid: 9585 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.633185:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24600/0x87925e4cb73b4657 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411493 expref: 36 pid: 9585 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.633207:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.633209:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.633217:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c528e00/0x87925e4cb73b468f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114af expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.633225:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c528e00/0x87925e4cb73b468f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114af expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.633254:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c528e00/0x87925e4cb73b468f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4038656->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114af expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.633266:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627431680:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.633315:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.635702:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627431680:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.635722:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.635771:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963624884608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2645us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.635781:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7929 00000100:00100000:0.0:1746143835.636737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.644164:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.655949:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.656006:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624885248 00000100:00100000:1.0:1746143835.656019:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624885248 00010000:00010000:1.0:1746143835.656064:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 39 pid: 13430 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.656117:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7930 00000100:00100000:1.0:1746143835.656124:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963624885248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.656138:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143835.656163:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143835 -> 1746143836 00002000:00010000:1.0:1746143835.656166:0:7229:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143835 -> 1746143836 00010000:00010000:1.0:1746143835.656171:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 39 pid: 13430 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.656182:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 39 pid: 13430 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.656211:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25c00/0x87925e4cb73b4688 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3379200->3551231) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a8 expref: 39 pid: 13430 timeout: 994 lvb_type: 0 00010000:00010000:1.0:1746143835.656243:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.656245:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.656252:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4696 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114b6 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.656258:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4696 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114b6 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.656293:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4696 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3862527) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114b6 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.656304:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627431936:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.656406:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.662601:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627431936:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.662625:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.662689:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963624885248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6565us (6746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.662701:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7930 00000100:00100000:0.0:1746143835.667565:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.674587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.681616:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.684538:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.684581:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624886272 00000100:00100000:1.0:1746143835.684591:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624886272 00000100:00100000:1.0:1746143835.684640:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13919 00000100:00100000:1.0:1746143835.684648:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+267:2613:x1830963624886272:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143835.684674:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.684696:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b46c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484114c4 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.684809:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.684822:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143835.684832:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746143835.684842:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143835.684972:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7cc00/0x87925e4cb73b46c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 270 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.684996:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 269 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.685003:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.685006:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143835.685008:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ce00, rc 0) 00000100:00100000:1.0:1746143835.685050:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+269:2613:x1830963624886272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 404us (523us total) trans 8589944954 rc 0/0 00000100:00100000:1.0:1746143835.685057:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13919 00000100:00100000:0.0:1746143835.688152:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746143835.688178:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627432064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143835.688405:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.689292:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627432064 00000100:00100000:1.0:1746143835.689300:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627432064 00000100:00100000:1.0:1746143835.689344:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1746143835.689351:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963627432064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746143835.689379:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:1.0:1746143835.689462:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963627432064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.689467:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1746143835.689632:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627432064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143835.694030:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.694061:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.694081:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.694476:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7063 00000100:00100000:1.0:1746143835.694489:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963624887040:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143835.697483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.718633:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963624887040:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24137us (24558us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.718643:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7063 00002000:00100000:1.0:1746143835.718654:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092ef3480 x1830963624887040/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.718661:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3480 with x1830963624887040 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.718666:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef3480 00000100:00100000:0.0:1746143835.719772:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3772:1830963627432704:0@lo:400:kworker.0 00000100:00100000:1.0:1746143835.720372:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627432576:0@lo:400:kworker.0 00000100:00100000:0.0:1746143835.723345:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.723384:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3772:1830963627433216:0@lo:400:kworker.0 00000100:00100000:0.0:1746143835.723416:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143835.723453:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627432704 00000100:00100000:0.0:1746143835.723459:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627432704 00000100:00100000:0.0:1746143835.723488:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627433216 00000100:00100000:0.0:1746143835.723490:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627433216 00000100:00100000:0.0:1746143835.723519:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1746143835.723525:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3772:x1830963627432704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143835.723565:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3772:x1830963627432704:12345-0@lo:400:kworker.0 Request processed in 40us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.723571:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1746143835.723582:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1746143835.723587:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3772:x1830963627433216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143835.723611:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3772:x1830963627433216:12345-0@lo:400:kworker.0 Request processed in 23us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.723616:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1746143835.723644:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3772:1830963627432704:0@lo:400:kworker.0 00000100:00100000:0.0:1746143835.723652:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3772:1830963627433216:0@lo:400:kworker.0 00000100:00100000:1.0:1746143835.724780:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.724815:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3771:1830963627433088:0@lo:400:kworker.0 00000100:00100000:1.0:1746143835.724837:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.724863:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3771:1830963627433600:0@lo:400:kworker.0 00000100:00100000:1.0:1746143835.724882:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143835.725288:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3771:1830963627433088:0@lo:400:kworker.0 00000100:00100000:1.0:1746143835.725297:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3771:1830963627433600:0@lo:400:kworker.0 00000100:00100000:1.0:1746143835.725940:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627432576:0@lo:400:kworker.0 00000100:00100000:0.0:1746143835.732404:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.732439:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.732464:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.732487:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.732514:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624887936 00000100:00100000:0.0:1746143835.732524:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624887936 00002000:00100000:0.0:1746143835.732570:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092b73480 x1830963624887936/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.732581:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73480 with x1830963624887936 ext(0->1048575) 00002000:00010000:0.0:1746143835.732587:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b73480 00000100:00100000:0.0:1746143835.732603:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624888064 00000100:00100000:0.0:1746143835.732605:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624888064 00002000:00100000:0.0:1746143835.732613:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b70380 x1830963624888064/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.732620:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70380 with x1830963624888064 ext(1048576->2097151) 00002000:00010000:0.0:1746143835.732623:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70380 00000100:00100000:0.0:1746143835.732630:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624888448 00000100:00100000:0.0:1746143835.732631:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624888448 00002000:00100000:0.0:1746143835.732643:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092b72d80 x1830963624888448/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.732649:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72d80 with x1830963624888448 ext(1048576->2097151) 00002000:00010000:0.0:1746143835.732651:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72d80 00000100:00100000:0.0:1746143835.732659:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624888320 00000100:00100000:0.0:1746143835.732661:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624888320 00002000:00100000:0.0:1746143835.732670:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092b72300 x1830963624888320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/0 e 0 to 0 dl 1746143846 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.732676:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72300 with x1830963624888320 ext(1048576->2097151) 00002000:00010000:0.0:1746143835.732679:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72300 00000100:00100000:0.0:1746143835.732689:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7066 00000100:00100000:0.0:1746143835.732696:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963624887936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143835.733507:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7068 00000100:00100000:0.0:1746143835.733514:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963624888448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.734118:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7069 00000100:00100000:1.0:1746143835.734127:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624888320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143835.735015:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963624887552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 37112us (37539us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.735022:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7065 00002000:00100000:1.0:1746143835.735031:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092ef0700 x1830963624887552/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.735041:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0700 with x1830963624887552 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.735048:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0700 00000100:00100000:0.0:1746143835.739279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.741763:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13920 00000100:00100000:1.0:1746143835.741783:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b71c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+269:2616:x1830963624888832:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143835.741817:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.741840:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b46e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484114d9 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.741982:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.741996:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a1 expref: 270 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.742004:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b46b2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114bd expref: 14 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.742011:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143835.742046:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114bd expref: 14 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.742063:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b46b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114bd expref: 14 pid: 7245 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.742082:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627433728:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.742198:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a1 expref: 270 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.742205:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b467a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114a1 expref: 270 pid: 7245 timeout: 994 lvb_type: 0 00000100:00100000:1.0:1746143835.742213:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627433856:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.742233:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78b780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.756496:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963624888320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22365us (24001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.756506:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7069 00002000:00100000:1.0:1746143835.756516:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092b72300 x1830963624888320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.756524:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72300 with x1830963624888320 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.756529:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72300 00000100:00100000:0.0:1746143835.759236:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.759275:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.759579:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627433728:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.759591:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627433856:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.759615:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143835.760522:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963624888448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27007us (28055us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143835.760532:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7068 00002000:00100000:1.0:1746143835.760542:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092b72d80 x1830963624888448/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143835.760551:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72d80 with x1830963624888448 ext(1048576->2097151) 00002000:00010000:1.0:1746143835.760555:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72d80 00000100:00100000:0.0:1746143835.769270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.770651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.789369:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.789409:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.792642:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963624889344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21540us (23377us total) trans 0 rc 1941504/1941504 00000100:00100000:0.0:1746143835.792655:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7070 00002000:00100000:0.0:1746143835.792668:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4038655) req@ffff880092b70a80 x1830963624889344/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:231/0 lens 488/440 e 0 to 0 dl 1746143846 ref 1 fl Complete:/200/0 rc 1941504/1941504 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143835.792678:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70a80 with x1830963624889344 ext(2097152->4038655) 00002000:00010000:0.0:1746143835.792683:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70a80 00000100:00100000:0.0:1746143835.810340:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.814054:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.831341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.831401:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.831564:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624890496 00000100:00100000:1.0:1746143835.831574:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624890496 00000100:00100000:1.0:1746143835.831619:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5369 00000100:00100000:1.0:1746143835.831626:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2612:x1830963624890496:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143835.833077:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2612:x1830963624890496:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1450us (1746us total) trans 8589944957 rc 0/0 00000100:00100000:1.0:1746143835.833085:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5369 00000100:00100000:0.0:1746143835.853825:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.889791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.895344:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627434752 00000100:00100000:0.0:1746143835.895361:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627434752 00000100:00100000:0.0:1746143835.895416:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1746143835.895424:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627434752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746143835.895460:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445232640 avail 1315770368 00000100:00100000:0.0:1746143835.895502:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627434752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.895509:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1746143835.900504:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.906544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.915995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.928301:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.934242:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627435136:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143835.934264:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143835.934319:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963624891776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5511us (6028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143835.934330:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7934 00000100:00100000:0.0:1746143835.944193:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.944885:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.948390:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624892416 00000100:00100000:1.0:1746143835.948404:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624892416 00000100:00100000:1.0:1746143835.948480:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16301 00000100:00100000:1.0:1746143835.948488:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2616:x1830963624892416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143835.948507:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.948525:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841150a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.948554:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.948562:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.948563:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.948566:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->3563519] (req 3145728->3563519) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.948601:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.948611:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143835.948623:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627435264:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.948725:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.952270:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627435264:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143835.952300:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->3563519] (req 3145728->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 37 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.953465:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76e00, rc 0) 00000100:00100000:1.0:1746143835.953545:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2616:x1830963624892416:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5054us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.953557:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16301 00000100:00100000:1.0:1746143835.955646:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624892544 00000100:00100000:1.0:1746143835.955653:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624892544 00010000:00010000:1.0:1746143835.955678:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143835.955714:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7935 00000100:00100000:1.0:1746143835.955721:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963624892544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.955734:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.955753:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143835.955762:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143835.955785:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408d400/0x87925e4cb73b4706 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114ee expref: 37 pid: 13430 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143835.955815:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.955817:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.955823:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.955831:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.955862:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.955874:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627435392:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.955953:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143835.959974:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627435392:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.959995:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.961595:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963624892544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5872us (6132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.961610:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7935 00000100:00100000:1.0:1746143835.961647:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624892672 00000100:00100000:1.0:1746143835.961653:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624892672 00010000:00010000:1.0:1746143835.961681:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b4730 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114fc expref: 42 pid: 13430 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143835.961712:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7936 00000100:00100000:1.0:1746143835.961719:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963624892672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.961731:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.961753:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b4730 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114fc expref: 42 pid: 13430 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143835.961772:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b4730 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114fc expref: 42 pid: 13430 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143835.961797:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b4730 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2899968->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114fc expref: 42 pid: 13430 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143835.961811:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.961814:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143835.961821:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b4737 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411503 expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.961834:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b4737 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411503 expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.961865:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b4737 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411503 expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143835.961877:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627435520:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143835.961951:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.963626:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.968207:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627435520:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143835.968228:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.968267:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963624892672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6548us (6871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.968275:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7936 00000100:00100000:0.0:1746143835.969890:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.969982:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.973022:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624893312 00000100:00100000:1.0:1746143835.973036:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624893312 00000100:00100000:1.0:1746143835.973096:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16302 00000100:00100000:1.0:1746143835.973104:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2618:x1830963624893312:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143835.973636:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143835.973663:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4745 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411511 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.973695:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.973703:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143835.973705:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143835.973709:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4745 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3833856->4194303] (req 3833856->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411511 expref: 24 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.973742:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.973754:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76e00/0x87925e4cb73b473e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3563519) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841150a expref: 35 pid: 9585 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143835.973766:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627435648:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143835.973879:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143835.979047:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.984680:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.984690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143835.989512:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624893952 00000100:00100000:1.0:1746143835.989522:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624893952 00000100:00100000:1.0:1746143835.989664:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 970 00000100:00100000:1.0:1746143835.989673:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963624893952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143835.989690:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143835.989717:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b4768 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411518 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143835.989746:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143835.989750:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143835.989796:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963624893952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 124us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143835.989802:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 970 00000100:00100000:0.0:1746143835.990593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.990635:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.991487:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143835.993652:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.003754:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.003813:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143836.003865:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143836.004061:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143836.005440:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.010748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.012071:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.012109:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624895360 00000100:00100000:1.0:1746143836.012112:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624895360 00010000:00010000:1.0:1746143836.012126:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b4737 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411503 expref: 41 pid: 13430 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143836.013531:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.017206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.024108:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624896000 00000100:00100000:1.0:1746143836.024117:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624896000 00002000:00100000:1.0:1746143836.024167:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800939a5f80 x1830963624896000/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.024177:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5f80 with x1830963624896000 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.024182:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5f80 00000100:00100000:1.0:1746143836.024202:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7077 00000100:00100000:1.0:1746143836.024208:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963624896000:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143836.025412:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.033510:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624896256 00000100:00100000:1.0:1746143836.033528:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624896256 00000100:00100000:1.0:1746143836.033595:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5370 00000100:00100000:1.0:1746143836.033603:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2618:x1830963624896256:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143836.033862:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2618:x1830963624896256:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 258us (8448us total) trans 8589944960 rc 0/0 00000100:00100000:1.0:1746143836.033869:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5370 00000100:00100000:1.0:1746143836.038775:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963624896000:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 14554us (14734us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143836.038788:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7077 00002000:00100000:1.0:1746143836.038801:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800939a5f80 x1830963624896000/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.038818:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5f80 with x1830963624896000 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.038824:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5f80 00000100:00100000:0.0:1746143836.043591:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.044601:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.046661:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.058942:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.062441:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624897024 00000100:00100000:1.0:1746143836.062453:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624897024 00002000:00100000:1.0:1746143836.062494:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3620863) req@ffff880091d4c380 x1830963624897024/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.062504:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c380 with x1830963624897024 ext(3145728->3620863) 00010000:00010000:1.0:1746143836.062513:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 26 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.062527:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 26 pid: 9585 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143836.062534:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4c380 00000100:00100000:1.0:1746143836.062576:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2631 00000100:00100000:1.0:1746143836.062584:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624897024:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143836.073245:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624897024:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10653us (14327us total) trans 21474841180 rc 0/0 00000100:00100000:1.0:1746143836.073255:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2631 00002000:00100000:1.0:1746143836.073265:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3620863) req@ffff880091d4c380 x1830963624897024/t21474841180(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/448 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.073273:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c380 with x1830963624897024 ext(3145728->3620863) 00010000:00010000:1.0:1746143836.073281:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 26 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.073295:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 26 pid: 9585 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143836.073301:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4c380 00000100:00100000:0.0:1746143836.076518:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.077446:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624897280 00000100:00100000:1.0:1746143836.077453:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624897280 00002000:00100000:1.0:1746143836.077488:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880091d4e300 x1830963624897280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.077497:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4e300 with x1830963624897280 ext(4194304->4853759) 00002000:00010000:1.0:1746143836.077502:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4e300 00000100:00100000:1.0:1746143836.077531:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7080 00000100:00100000:1.0:1746143836.077541:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624897280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143836.084813:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.085491:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.085517:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624897536 00000100:00100000:0.0:1746143836.085520:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624897536 00010000:00010000:0.0:1746143836.085535:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 28 pid: 9585 timeout: 995 lvb_type: 0 00000100:00100000:0.0:1746143836.085563:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7941 00000100:00100000:0.0:1746143836.085568:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624897536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143836.085576:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143836.085591:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 28 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.085602:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 28 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.085616:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4784 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3620863) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411534 expref: 28 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.085629:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143836.085631:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143836.085636:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b4792 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411542 expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.085642:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b4792 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411542 expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.085647:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143836.085648:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143836.085650:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da200/0x87925e4cb73b4799 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411549 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.085655:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2da200/0x87925e4cb73b4799 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411549 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.085677:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2da200/0x87925e4cb73b4799 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411549 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.085686:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627436928:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143836.085754:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b4792 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411542 expref: 40 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.085762:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627437056:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143836.085778:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143836.086016:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624897280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8478us (9502us total) trans 0 rc 659456/659456 00000100:00100000:0.0:1746143836.086023:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7080 00002000:00100000:0.0:1746143836.086031:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880091d4e300 x1830963624897280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.086038:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4e300 with x1830963624897280 ext(4194304->4853759) 00002000:00010000:0.0:1746143836.086042:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4e300 00000100:00100000:0.0:1746143836.092682:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624897792 00000100:00100000:0.0:1746143836.092689:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624897792 00002000:00100000:0.0:1746143836.092722:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800939a7b80 x1830963624897792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.092731:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7b80 with x1830963624897792 ext(3145728->4194303) 00002000:00010000:0.0:1746143836.092735:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7b80 00000100:00100000:0.0:1746143836.092759:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7081 00000100:00100000:0.0:1746143836.092765:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963624897792:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143836.098426:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.105784:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963624897792:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13011us (13781us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143836.105795:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7081 00002000:00100000:0.0:1746143836.105804:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800939a7b80 x1830963624897792/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.105814:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7b80 with x1830963624897792 ext(3145728->4194303) 00002000:00010000:0.0:1746143836.105819:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7b80 00000100:00100000:0.0:1746143836.121185:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.139954:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.178823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.188279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.208570:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.210602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.210940:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624899456 00000100:00100000:1.0:1746143836.210946:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624899456 00000100:00100000:1.0:1746143836.210981:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5372 00000100:00100000:1.0:1746143836.210987:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+272:2630:x1830963624899456:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143836.211106:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:2630:x1830963624899456:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 119us (506us total) trans 8589944964 rc 0/0 00000100:00100000:1.0:1746143836.211112:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5372 00000100:00100000:0.0:1746143836.258038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.265273:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.270023:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.285256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.293501:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.293553:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.294269:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.301055:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.307508:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.307558:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.307650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.313558:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.321203:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.327468:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.327513:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.328311:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624902272 00000100:00100000:1.0:1746143836.328316:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624902272 00000100:00100000:1.0:1746143836.328342:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16314 00000100:00100000:1.0:1746143836.328348:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2635:x1830963624902272:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143836.328356:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.328367:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b482c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411588 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.328401:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28000/0x87925e4cb73b4810 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841156c expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.328409:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143836.328411:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746143836.328412:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143836.328414:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b482c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411588 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.328431:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624902400 00000100:00100000:0.0:1746143836.328434:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624902400 00010000:00010000:1.0:1746143836.328447:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28000/0x87925e4cb73b4810 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841156c expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.328458:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e28000/0x87925e4cb73b4810 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3055616->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841156c expref: 37 pid: 13436 timeout: 995 lvb_type: 0 00002000:00100000:0.0:1746143836.328460:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3252224->3862527) req@ffff880135b08a80 x1830963624902400/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143836.328469:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627438080:192.168.202.3@tcp:104: 00002000:00100000:0.0:1746143836.328469:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08a80 with x1830963624902400 ext(3252224->3862527) 00010000:00010000:0.0:1746143836.328476:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b47e6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841155e expref: 26 pid: 13436 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.328485:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b47e6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841155e expref: 26 pid: 13436 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746143836.328494:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b08a80 00000100:00100000:0.0:1746143836.328506:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2632 00000100:00100000:0.0:1746143836.328511:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624902400:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143836.328539:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143836.336045:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627438080:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.336070:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b482c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411588 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.336085:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:1.0:1746143836.336135:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2635:x1830963624902272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7786us (8620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.336142:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16314 00000100:00100000:0.0:1746143836.336420:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.337269:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624902784 00000100:00100000:1.0:1746143836.337275:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624902784 00000100:00100000:1.0:1746143836.337317:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5374 00000100:00100000:1.0:1746143836.337322:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+275:2638:x1830963624902784:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143836.337627:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+277:2638:x1830963624902784:12345-192.168.202.3@tcp:35:cat.0 Request processed in 303us (1205us total) trans 8589944968 rc 0/0 00000100:00100000:1.0:1746143836.337633:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5374 00000100:00100000:0.0:1746143836.338992:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963624902400:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10471us (10570us total) trans 21474841181 rc 0/0 00000100:00100000:0.0:1746143836.339002:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2632 00002000:00100000:0.0:1746143836.339011:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3252224->3862527) req@ffff880135b08a80 x1830963624902400/t21474841181(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/448 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.339020:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08a80 with x1830963624902400 ext(3252224->3862527) 00010000:00010000:0.0:1746143836.339028:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841155e expref: 28 pid: 13436 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.339039:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b47e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3862527) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841155e expref: 28 pid: 13436 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746143836.339045:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b08a80 00000100:00100000:0.0:1746143836.340720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.340776:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.341339:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624903040 00000100:00100000:1.0:1746143836.341350:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624903040 00000100:00100000:1.0:1746143836.341420:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16315 00000100:00100000:1.0:1746143836.341429:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963624903040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143836.341444:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.341461:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73b484f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841158f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143836.341510:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627438336:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143836.341990:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143836.342342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.345229:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627438336:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143836.345263:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73b484f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841158f expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.345275:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d550a00/0x87925e4cb73b484f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841158f expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.345301:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550a00, rc 0) 00000100:00100000:1.0:1746143836.345357:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963624903040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3928us (4637us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143836.345365:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16315 00000100:00100000:0.0:1746143836.345712:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.350060:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624903680 00000100:00100000:1.0:1746143836.350069:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624903680 00002000:00100000:1.0:1746143836.350115:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2584576->2588671) req@ffff8800939a7800 x1830963624903680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.350126:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7800 with x1830963624903680 ext(2584576->2588671) 00002000:00010000:1.0:1746143836.350131:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7800 00000100:00100000:1.0:1746143836.350160:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624903936 00000100:00100000:1.0:1746143836.350163:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624903936 00002000:00100000:1.0:1746143836.350175:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800939a6d80 x1830963624903936/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.350182:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6d80 with x1830963624903936 ext(2097152->3145727) 00002000:00010000:1.0:1746143836.350185:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a6d80 00000100:00100000:1.0:1746143836.350204:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7088 00000100:00100000:1.0:1746143836.350209:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624903936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143836.363430:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624903936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13213us (13430us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143836.363454:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7088 00002000:00100000:1.0:1746143836.363463:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800939a6d80 x1830963624903936/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.363471:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a6d80 with x1830963624903936 ext(2097152->3145727) 00002000:00010000:1.0:1746143836.363475:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a6d80 00000100:00100000:0.0:1746143836.364529:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.368728:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.372079:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.372526:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624904320 00000100:00100000:1.0:1746143836.372534:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624904320 00002000:00100000:1.0:1746143836.372570:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2588671) req@ffff880135b0ad80 x1830963624904320/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.372577:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0ad80 with x1830963624904320 ext(2097152->2588671) 00010000:00010000:1.0:1746143836.372584:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b481e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841157a expref: 41 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.372594:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b481e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841157a expref: 41 pid: 9585 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143836.372600:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b0ad80 00000100:00100000:1.0:1746143836.372622:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2634 00000100:00100000:1.0:1746143836.372629:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963624904320:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143836.374002:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.376150:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.381967:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963624904320:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9324us (9882us total) trans 21474841182 rc 0/0 00000100:00100000:1.0:1746143836.381981:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2634 00002000:00100000:1.0:1746143836.381996:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2588671) req@ffff880135b0ad80 x1830963624904320/t21474841182(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/448 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.382007:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0ad80 with x1830963624904320 ext(2097152->2588671) 00010000:00010000:1.0:1746143836.382017:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b481e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841157a expref: 45 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.382032:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b481e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2588671) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841157a expref: 45 pid: 9585 timeout: 995 lvb_type: 0 00002000:00010000:1.0:1746143836.382039:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b0ad80 00000100:00100000:0.0:1746143836.393973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.398989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.399033:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.404446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.404501:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.404883:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624905600 00000100:00100000:1.0:1746143836.404894:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624905600 00002000:00100000:1.0:1746143836.404977:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096e54700 x1830963624905600/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.404988:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54700 with x1830963624905600 ext(2097152->4194303) 00002000:00010000:1.0:1746143836.404994:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e54700 00000100:00100000:1.0:1746143836.405149:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624905856 00000100:00100000:1.0:1746143836.405153:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624905856 00002000:00100000:1.0:1746143836.405168:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880096e54a80 x1830963624905856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.405174:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54a80 with x1830963624905856 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.405177:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e54a80 00000100:00100000:1.0:1746143836.405189:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7092 00000100:00100000:1.0:1746143836.405193:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624905856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143836.408105:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.416948:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624905856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11714us (12407us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143836.416962:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7092 00002000:00100000:1.0:1746143836.416975:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880096e54a80 x1830963624905856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.416985:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54a80 with x1830963624905856 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.416991:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e54a80 00000100:00100000:0.0:1746143836.430476:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.451618:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.458053:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.460571:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.482108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.486966:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.487006:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.495567:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.501041:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.501125:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.501390:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624907904 00000100:00100000:1.0:1746143836.501397:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624907904 00010000:00010000:1.0:1746143836.501429:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73b486b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ab expref: 43 pid: 9585 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143836.501453:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624908032 00000100:00100000:1.0:1746143836.501455:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624908032 00010000:00010000:1.0:1746143836.501464:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b4864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115a4 expref: 30 pid: 9585 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143836.501485:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7949 00000100:00100000:1.0:1746143836.501490:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963624907904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.501503:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.501525:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73b486b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ab expref: 43 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.501536:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73b486b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ab expref: 43 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.501557:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7d800/0x87925e4cb73b486b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ab expref: 43 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.501577:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.501595:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624907904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.501604:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7949 00000100:00100000:1.0:1746143836.501619:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7950 00000100:00100000:1.0:1746143836.501623:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624908032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.501630:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.501636:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b4864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115a4 expref: 30 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.501644:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b4864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115a4 expref: 30 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.501654:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b4864 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115a4 expref: 30 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:1.0:1746143836.501662:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.501663:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.501670:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73b48b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2940927) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115c0 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.501679:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73b48b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2940927) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115c0 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.501707:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801368da200/0x87925e4cb73b48b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->2940927) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115c0 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143836.501719:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627439232:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143836.501769:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143836.504885:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.505349:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627439232:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143836.505367:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.505401:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963624908032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3777us (4276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.505409:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7950 00000100:00100000:0.0:1746143836.511458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.514251:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.640201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.641298:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624909056 00000100:00100000:1.0:1746143836.641314:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624909056 00000100:00100000:1.0:1746143836.641414:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13929 00000100:00100000:1.0:1746143836.641423:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2649:x1830963624909056:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143836.641450:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.641475:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b48bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484115c7 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.641558:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641570:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641580:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641592:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641598:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641603:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641698:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b48d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641707:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b48d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641712:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b48d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143836.641724:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143836.641804:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641811:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641816:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641821:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641826:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143836.641830:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641836:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641845:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143836.641848:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143836.641851:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641855:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b48c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641887:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641892:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641900:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641904:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143836.641906:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641951:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641959:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5be3d00) 00010000:00010000:1.0:1746143836.641961:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143836.641963:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.641968:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b48cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.642009:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b48bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115c7 expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.642019:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b48d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115c7 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.642025:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143836.642026:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143836.642028:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1400, rc 0) 00000100:00100000:1.0:1746143836.642094:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2649:x1830963624909056:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 672us (1904us total) trans 8589944974 rc 0/0 00000100:00100000:1.0:1746143836.642100:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13929 00000100:00100000:0.0:1746143836.644192:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.644549:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624909184 00000100:00100000:1.0:1746143836.644558:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624909184 00000100:00100000:1.0:1746143836.644607:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 976 00000100:00100000:1.0:1746143836.644614:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624909184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.644630:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.644654:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b48d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115c7 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.644816:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143836.644820:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.645479:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963624909184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 864us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.645486:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 976 00000100:00100000:0.0:1746143836.687656:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.695532:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.696396:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624909696 00000100:00100000:1.0:1746143836.696404:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624909696 00000100:00100000:1.0:1746143836.696517:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13931 00000100:00100000:1.0:1746143836.696525:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2655:x1830963624909696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143836.696560:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.696574:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484115d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.696664:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696675:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696683:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696697:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696702:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696707:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696811:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b491a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696819:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b491a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696825:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b491a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143836.696832:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143836.696940:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696946:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696950:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696954:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696958:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143836.696961:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696967:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696975:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143836.696977:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143836.696981:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.696985:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b490c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697001:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697006:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697011:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697014:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143836.697016:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697020:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697025:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5be3100) 00010000:00010000:1.0:1746143836.697027:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143836.697028:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697033:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4913 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143836.697061:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115d5 expref: 30 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.697070:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b491a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115d5 expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.697075:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143836.697077:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143836.697078:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0600, rc 0) 00000100:00100000:1.0:1746143836.697120:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2655:x1830963624909696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 595us (1595us total) trans 8589944976 rc 0/0 00000100:00100000:1.0:1746143836.697126:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13931 00000100:00100000:0.0:1746143836.697150:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.699499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.699539:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.699621:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624909952 00000100:00100000:1.0:1746143836.699626:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624909952 00000100:00100000:1.0:1746143836.699654:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 977 00000100:00100000:1.0:1746143836.699660:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+279:2010:x1830963624909952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.699668:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.699684:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b48f7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ce expref: 279 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.699696:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143836.699699:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.699721:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+278:2010:x1830963624909952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.699727:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 977 00000100:00100000:0.0:1746143836.702646:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.702860:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624910464 00000100:00100000:1.0:1746143836.702865:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624910464 00000100:00100000:1.0:1746143836.702890:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16322 00000100:00100000:1.0:1746143836.702895:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624910464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143836.702906:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.702931:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b492f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484115e3 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143836.702968:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627439488:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143836.703018:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143836.703139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.703165:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624910592 00000100:00100000:0.0:1746143836.703168:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624910592 00000100:00100000:0.0:1746143836.703189:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 978 00000100:00100000:0.0:1746143836.703193:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624910592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143836.703202:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143836.703218:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b491a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115d5 expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.703234:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143836.703238:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143836.703253:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624910592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143836.703258:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 978 00000100:00100000:1.0:1746143836.706285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.708072:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627439488:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143836.708095:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b492f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115e3 expref: 30 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143836.708105:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b492f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115e3 expref: 30 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143836.708113:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0c00, rc 0) 00000100:00100000:0.0:1746143836.708149:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624910464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5253us (5506us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143836.708156:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16322 00000100:00100000:0.0:1746143836.708210:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.708226:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624910720 00000100:00100000:0.0:1746143836.708229:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624910720 00000100:00100000:0.0:1746143836.708251:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16323 00000100:00100000:0.0:1746143836.708256:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963624910720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143836.708266:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143836.708276:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73b4936 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484115ea expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.708312:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627439616:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143836.708355:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143836.716183:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627439616:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143836.716210:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73b4936 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ea expref: 44 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143836.716223:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73b4936 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ea expref: 44 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143836.716232:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eca00, rc 0) 00000100:00100000:0.0:1746143836.717405:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963624910720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9144us (9190us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143836.717414:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16323 00000100:00100000:1.0:1746143836.717550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.717651:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624910848 00000100:00100000:0.0:1746143836.717656:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624910848 00000100:00100000:0.0:1746143836.717689:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16324 00000100:00100000:0.0:1746143836.717695:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2655:x1830963624910848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143836.717706:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143836.717717:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73b493d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484115f1 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.717736:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143836.717740:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73b4928 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115dc expref: 42 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.717745:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143836.717748:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73b493d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f1 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.717771:0:3134:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73b4928 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115dc expref: 42 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.717779:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73b493d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f1 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.717786:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7c200, rc 0) 00000100:00100000:0.0:1746143836.719462:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2655:x1830963624910848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1761us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143836.719471:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16324 00000100:00100000:0.0:1746143836.731787:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.738982:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.739057:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.739083:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624911360 00000100:00100000:0.0:1746143836.739086:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624911360 00002000:00100000:0.0:1746143836.739109:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2588672->2592767) req@ffff880136637480 x1830963624911360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.739116:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136637480 with x1830963624911360 ext(2588672->2592767) 00010000:00010000:0.0:1746143836.739122:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73b4928 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115dc expref: 45 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.739131:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73b4928 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115dc expref: 45 pid: 9585 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746143836.739137:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136637480 00000100:00100000:0.0:1746143836.739156:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2637 00000100:00100000:0.0:1746143836.739160:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963624911360:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143836.739250:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963624911360:12345-192.168.202.3@tcp:3:cat.0 Request processed in 88us (191us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143836.739256:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2637 00002000:00100000:0.0:1746143836.739261:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2588672->2592767) req@ffff880136637480 x1830963624911360/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.739268:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136637480 with x1830963624911360 ext(2588672->2592767) 00010000:00010000:0.0:1746143836.739272:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73b4928 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115dc expref: 44 pid: 9585 timeout: 995 lvb_type: 0 00010000:00010000:0.0:1746143836.739280:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880123269200/0x87925e4cb73b4928 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115dc expref: 44 pid: 9585 timeout: 995 lvb_type: 0 00002000:00010000:0.0:1746143836.739285:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136637480 00000100:00100000:0.0:1746143836.752933:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.753000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.753499:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624911744 00000100:00100000:1.0:1746143836.753507:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624911744 00000100:00100000:1.0:1746143836.753623:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16326 00000100:00100000:1.0:1746143836.753630:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2646:x1830963624911744:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143836.753645:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.753700:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484115ff expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.753725:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b482c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411588 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.753733:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b485d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841159d expref: 41 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.753738:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.753740:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.753743:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3616767] (req 3145728->3616767) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.753767:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b485d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841159d expref: 41 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.753775:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b485d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841159d expref: 41 pid: 9585 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143836.753784:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627440000:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.754427:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b482c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411588 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.754437:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d550600/0x87925e4cb73b482c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411588 expref: 25 pid: 13436 timeout: 995 lvb_type: 0 00000100:00100000:1.0:1746143836.754445:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627440128:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143836.754822:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143836.760210:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627440000:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143836.761672:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627440128:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.761696:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3616767] (req 3145728->3616767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.761711:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1000, rc 0) 00000100:00100000:1.0:1746143836.761746:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:2646:x1830963624911744:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8116us (8745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.761757:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16326 00000100:00100000:0.0:1746143836.774027:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.775605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.775703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.782048:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627440256:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143836.782065:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143836.784181:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963624912000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8337us (8566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143836.784192:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7953 00000100:00100000:0.0:1746143836.785597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.785991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.786021:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.797067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.797400:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624913024 00000100:00100000:1.0:1746143836.797409:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624913024 00000100:00100000:1.0:1746143836.797445:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16327 00000100:00100000:1.0:1746143836.797451:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2649:x1830963624913024:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143836.797470:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.797485:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411606 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.797510:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 46 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.797518:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73b4634 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411477 expref: 33 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.797524:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.797526:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.797529:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 33 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.797552:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73b4634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411477 expref: 33 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.797563:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73b4634 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411477 expref: 33 pid: 1945 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.797579:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627440640:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.797646:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 46 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.797655:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 46 pid: 13436 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.797662:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627440768:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143836.797678:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143836.807431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.807467:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.807509:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.807535:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624913408 00000100:00100000:0.0:1746143836.807542:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624913408 00010000:00010000:0.0:1746143836.807576:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 45 pid: 13436 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143836.807600:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624913152 00000100:00100000:0.0:1746143836.807602:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624913152 00010000:00010000:0.0:1746143836.807610:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73b4634 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411477 expref: 32 pid: 1945 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143836.807624:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7955 00000100:00100000:0.0:1746143836.807630:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963624913408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143836.807984:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143836.807993:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 45 pid: 13436 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143836.808006:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 45 pid: 13436 timeout: 996 lvb_type: 1 00010000:00010000:0.0:1746143836.808148:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143836.808149:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143836.808155:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 31 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.808267:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25200/0x87925e4cb73b4634 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411477 expref: 31 pid: 1945 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.808288:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627440640:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.808297:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4611 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841144d expref: 45 pid: 13436 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.808304:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627440768:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143836.808328:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.808638:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.808648:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627440896:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143836.808691:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00010000:00010000:1.0:1746143836.808754:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.808763:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3800, rc 0) 00000100:00100000:1.0:1746143836.808784:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2649:x1830963624913024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11334us (11725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.808793:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16327 00000100:00100000:0.0:1746143836.816202:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.816230:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.816250:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.816258:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624914048 00000100:00100000:1.0:1746143836.816264:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624914048 00000100:00100000:0.0:1746143836.816278:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624914176 00000100:00100000:0.0:1746143836.816280:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624914176 00002000:00100000:1.0:1746143836.816297:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3616767) req@ffff88009719d500 x1830963624914048/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.816297:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009719f800 x1830963624914176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.816305:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d500 with x1830963624914048 ext(3145728->3616767) 00002000:00100000:0.0:1746143836.816305:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f800 with x1830963624914176 ext(3145728->4194303) 00002000:00010000:0.0:1746143836.816309:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719f800 00010000:00010000:1.0:1746143836.816312:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 42 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.816322:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 42 pid: 3134 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143836.816324:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624914304 00000100:00100000:0.0:1746143836.816326:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624914304 00002000:00010000:1.0:1746143836.816328:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719d500 00002000:00100000:0.0:1746143836.816336:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1564672->1568767) req@ffff88009719c000 x1830963624914304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143836.816342:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c000 with x1830963624914304 ext(1564672->1568767) 00000100:00100000:1.0:1746143836.816343:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2640 00002000:00010000:0.0:1746143836.816344:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719c000 00000100:00100000:1.0:1746143836.816349:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624914048:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143836.816354:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7100 00000100:00100000:0.0:1746143836.816357:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624914176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143836.816471:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7101 00000100:00100000:1.0:1746143836.816477:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624914304:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143836.816536:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624914304:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 58us (284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143836.816541:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7101 00002000:00100000:1.0:1746143836.816546:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1564672->1568767) req@ffff88009719c000 x1830963624914304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.816553:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c000 with x1830963624914304 ext(1564672->1568767) 00002000:00010000:1.0:1746143836.816555:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719c000 00000100:00100000:1.0:1746143836.817357:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963624913664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6920us (7119us total) trans 0 rc 577536/577536 00000100:00100000:1.0:1746143836.817363:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2639 00002000:00100000:1.0:1746143836.817368:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3616768->4194303) req@ffff880091d4d180 x1830963624913664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 577536/577536 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.817374:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d180 with x1830963624913664 ext(3616768->4194303) 00010000:00010000:1.0:1746143836.817390:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 42 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.817398:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 42 pid: 3134 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746143836.817403:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4d180 00000100:00100000:1.0:1746143836.819534:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624914560 00000100:00100000:1.0:1746143836.819538:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624914560 00002000:00100000:1.0:1746143836.819562:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880091d4dc00 x1830963624914560/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.819568:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4dc00 with x1830963624914560 ext(4194304->4853759) 00010000:00010000:1.0:1746143836.819573:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 44 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.819582:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1000/0x87925e4cb73b494b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3616767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115ff expref: 44 pid: 3134 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746143836.819588:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4dc00 00000100:00100000:1.0:1746143836.819606:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2641 00000100:00100000:1.0:1746143836.819612:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963624914560:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143836.832070:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963624914176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15709us (15836us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143836.832078:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7100 00002000:00100000:1.0:1746143836.832083:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009719f800 x1830963624914176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.832091:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f800 with x1830963624914176 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.832094:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719f800 00000100:00100000:0.0:1746143836.833710:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.836206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.840958:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.840994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.841045:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624915200 00000100:00100000:1.0:1746143836.841051:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624915200 00010000:00010000:1.0:1746143836.841071:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411454 expref: 42 pid: 9586 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.841486:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7959 00000100:00100000:1.0:1746143836.841493:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963624915200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.841500:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.841509:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411454 expref: 42 pid: 9586 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.841517:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411454 expref: 42 pid: 9586 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.841528:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4618 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411454 expref: 42 pid: 9586 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.841545:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.841546:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.841551:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.841558:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.841581:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143836.841590:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627441664:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143836.843554:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143836.844902:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.847903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.848012:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624915840 00000100:00100000:1.0:1746143836.848019:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624915840 00002000:00100000:1.0:1746143836.848049:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009719f480 x1830963624915840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.848058:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f480 with x1830963624915840 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.848062:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719f480 00000100:00100000:1.0:1746143836.848089:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7103 00000100:00100000:1.0:1746143836.848096:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624915840:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143836.858866:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c73100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627441664:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143836.858884:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.858900:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963624915200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 17409us (17944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.858907:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7959 00000100:00100000:1.0:1746143836.858976:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963624915840:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10880us (11079us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143836.858982:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7103 00002000:00100000:1.0:1746143836.858986:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009719f480 x1830963624915840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/440 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.858992:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f480 with x1830963624915840 ext(3145728->4194303) 00002000:00010000:1.0:1746143836.858995:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719f480 00000100:00100000:1.0:1746143836.859006:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7105 00000100:00100000:1.0:1746143836.859011:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624916224:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143836.859058:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624916224:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 47us (387us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143836.859063:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7105 00002000:00100000:1.0:1746143836.859067:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1257472->1261567) req@ffff880136635880 x1830963624916224/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/4536 e 0 to 0 dl 1746143847 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.859073:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635880 with x1830963624916224 ext(1257472->1261567) 00002000:00010000:1.0:1746143836.859076:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635880 00000100:00100000:0.0:1746143836.866220:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.866248:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.866271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.874505:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.876325:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.877689:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7106 00000100:00100000:0.0:1746143836.877697:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624916992:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143836.888986:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.889028:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.891178:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.894804:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.894846:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.916420:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.920769:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.924766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.924835:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624918528 00000100:00100000:1.0:1746143836.924842:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624918528 00010000:00010000:1.0:1746143836.924876:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114d9 expref: 280 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143836.924939:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7960 00000100:00100000:1.0:1746143836.924946:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+280:2009:x1830963624918528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.924957:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.924962:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114d9 expref: 280 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.924970:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114d9 expref: 280 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.924987:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b46ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114d9 expref: 280 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.925011:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143836.925015:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b49ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143836.925023:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b49ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143836.925030:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b49ad lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143836.925048:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.925083:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+279:2009:x1830963624918528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 137us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.925088:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7960 00000100:00100000:0.0:1746143836.930162:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.930196:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.930220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.930410:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.930529:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.930550:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143836.930561:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143836.930629:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143836.930798:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16338 00000100:00100000:1.0:1746143836.930805:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624918784:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143836.930816:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.930829:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841165a expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.930849:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.930851:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.930859:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.930873:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.930883:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00000100:00100000:1.0:1746143836.930942:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963624918784:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 137us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.930948:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16338 00000100:00100000:1.0:1746143836.930962:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16340 00000100:00100000:1.0:1746143836.930967:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624919040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143836.930972:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.930980:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30c00/0x87925e4cb73b49c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411668 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143836.931003:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627442816:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143836.932398:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143836.932858:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627442816:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143836.932878:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30c00/0x87925e4cb73b49c2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411668 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.932888:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30c00/0x87925e4cb73b49c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411668 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.932899:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30c00, rc 0) 00000100:00100000:1.0:1746143836.932934:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624919040:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1966us (2523us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143836.932940:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16340 00000100:00100000:0.0:1746143836.939266:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.943227:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.951591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143836.951731:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143836.951734:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143836.951755:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b49e5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841167d expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.951780:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143836.951783:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143836.951792:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b49f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411684 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.951859:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b49fa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143836.951868:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b49fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143836.951875:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b49fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143836.951883:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143836.951973:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b49f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411684 expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.951982:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b49fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411684 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.951987:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143836.951989:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143836.951990:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96200, rc 0) 00000100:00100000:3.0:1746143836.952021:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2660:x1830963624919936:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 309us (437us total) trans 8589944982 rc 0/0 00000100:00100000:3.0:1746143836.952026:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13934 00000100:00100000:0.0:1746143836.958732:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.959094:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624920064 00000100:00100000:1.0:1746143836.959102:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624920064 00000100:00100000:1.0:1746143836.959158:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13935 00000100:00100000:1.0:1746143836.959166:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2660:x1830963624920064:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143836.959186:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143836.959202:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b4a08 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841168b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.959347:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b4a08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841168b expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.959359:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b4a08 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841168b expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.959383:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143836.959386:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143836.959389:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31e00, rc 0) 00000100:00100000:1.0:1746143836.960055:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2660:x1830963624920064:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 889us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.960065:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13935 00000100:00100000:0.0:1746143836.962112:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143836.962192:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624920192 00000100:00100000:3.0:1746143836.962201:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624920192 00000100:00100000:3.0:1746143836.962285:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16343 00000100:00100000:3.0:1746143836.962293:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624920192:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143836.962328:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b4a0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.962344:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73b4603 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841143f expref: 40 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143836.962351:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143836.962357:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143836.962362:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143836.962364:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143836.962366:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b4a0f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.962404:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143836.962415:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 25 pid: 9585 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.962426:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627443072:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143836.962518:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143836.962526:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 9 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.962534:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627443200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143836.962559:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73b4603 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841143f expref: 40 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143836.962566:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b25a00/0x87925e4cb73b4603 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841143f expref: 40 pid: 9586 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.962573:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627443328:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143836.962589:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143836.962708:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.962938:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624920320 00000100:00100000:1.0:1746143836.962944:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624920320 00000100:00100000:1.0:1746143836.962979:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16344 00000100:00100000:1.0:1746143836.962985:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624920320:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143836.963007:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.963016:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b460a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411446 expref: 43 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.963021:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.963031:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.963036:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.963038:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.963040:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.963059:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.963071:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 29 pid: 1945 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143836.963082:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.963084:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627443456:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143836.963145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.963164:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624920576 00000100:00100000:0.0:1746143836.963170:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624920576 00000100:00100000:0.0:1746143836.963196:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624920832 00000100:00100000:0.0:1746143836.963203:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624920832 00000100:00100000:0.0:1746143836.963218:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16345 00000100:00100000:0.0:1746143836.963224:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624920576:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:0.0:1746143836.963257:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b4a1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.963271:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.963278:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143836.963280:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143836.963283:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b4a1d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.963307:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.963317:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 25 pid: 9585 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143836.963328:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627443584:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.964017:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.964025:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 11 pid: 3134 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.964032:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627444096:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.964076:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b460a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411446 expref: 43 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143836.964082:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b460a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411446 expref: 43 pid: 1945 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.964088:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627444224:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143836.964100:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ac780 going to sleep for 11 seconds 00010000:00010000:0.0:1746143836.964887:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b49d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411676 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143836.964897:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b49d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411676 expref: 11 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143836.964905:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094196300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627444352:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143836.964990:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73b493d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f1 expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.964998:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c200/0x87925e4cb73b493d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f1 expref: 29 pid: 3134 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143836.965005:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094195880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627444480:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143836.965020:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746143836.965384:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b49d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841166f expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143836.965393:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b49d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841166f expref: 11 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143836.965401:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627444608:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143836.965436:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73b4959 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841160d expref: 25 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.965443:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73b4959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841160d expref: 25 pid: 9585 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143836.965449:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627444736:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143836.965461:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143836.976498:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627443200:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143836.976507:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627443712:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143836.976511:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627443328:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143836.976548:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627443840:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143836.976550:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627443968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143836.976567:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.976580:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.976597:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.976612:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.976627:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.976639:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143836.976654:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624921088 00000100:00100000:0.0:1746143836.976659:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624921088 00002000:00100000:0.0:1746143836.976692:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1261567) req@ffff880094195500 x1830963624921088/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143836.976820:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624920960 00000100:00100000:3.0:1746143836.976824:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624920960 00010000:00010000:3.0:1746143836.976842:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 12 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.976865:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624921600 00000100:00100000:3.0:1746143836.976867:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624921600 00010000:00010000:3.0:1746143836.976875:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b4960 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411614 expref: 42 pid: 13436 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746143836.976888:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7962 00000100:00100000:3.0:1746143836.976893:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624920960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143836.976905:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143836.977194:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627443456:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143836.977201:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627444096:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143836.977206:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627444224:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143836.977219:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143836.977264:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.977272:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624921472 00000100:00100000:1.0:1746143836.977274:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624921472 00010000:00010000:1.0:1746143836.977282:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 12 pid: 3134 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.977292:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7966 00000100:00100000:1.0:1746143836.977296:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963624921472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.977301:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.977309:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 12 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977316:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 12 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977326:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30400/0x87925e4cb73b49b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841165a expref: 12 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977341:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.977352:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624921472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.977357:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7966 00000100:00100000:1.0:1746143836.977385:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.977393:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624921856 00000100:00100000:1.0:1746143836.977396:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624921856 00010000:00010000:1.0:1746143836.977404:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 30 pid: 1945 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.977415:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7967 00000100:00100000:1.0:1746143836.977419:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624921856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.977424:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.977430:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 30 pid: 1945 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977437:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 30 pid: 1945 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977446:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b4642 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411470 expref: 30 pid: 1945 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977454:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.977466:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2009:x1830963624921856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.977471:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7967 00000100:00100000:1.0:1746143836.977517:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.977523:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624921984 00000100:00100000:1.0:1746143836.977526:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624921984 00010000:00010000:1.0:1746143836.977534:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b49d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411676 expref: 11 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.977543:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7968 00000100:00100000:1.0:1746143836.977547:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624921984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.977552:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.977558:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b49d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411676 expref: 11 pid: 13430 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977565:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b49d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411676 expref: 11 pid: 13430 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977575:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.977586:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624921984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 38us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.977590:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7968 00000100:00100000:1.0:1746143836.977625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.977633:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624922240 00000100:00100000:1.0:1746143836.977636:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624922240 00010000:00010000:1.0:1746143836.977645:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73b4944 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f8 expref: 45 pid: 9585 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143836.977655:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7969 00000100:00100000:1.0:1746143836.977658:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963624922240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.977663:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.977669:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73b4944 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f8 expref: 45 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.977676:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73b4944 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f8 expref: 45 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.977685:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268a00/0x87925e4cb73b4944 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484115f8 expref: 45 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143836.977688:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 12 pid: 13430 timeout: 996 lvb_type: 1 00010000:00010000:1.0:1746143836.977693:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143836.977697:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 12 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.977706:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963624922240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (81us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143836.977707:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b49c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411653 expref: 12 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:1.0:1746143836.977710:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7969 00010000:00010000:3.0:1746143836.977717:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.977733:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627443072:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143836.977734:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624920960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 840us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143836.977739:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7962 00010000:00010000:1.0:1746143836.977746:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b4a0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.977767:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b49d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411676 expref: 10 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.977775:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624921216 00000100:00100000:1.0:1746143836.977775:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094196300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627444352:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143836.977777:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624921216 00000100:00100000:1.0:1746143836.977781:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094195880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627444480:192.168.202.3@tcp:104: 00002000:00100000:3.0:1746143836.977789:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1564672->2097151) req@ffff880094194380 x1830963624921216/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/0 e 0 to 0 dl 1746143847 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143836.977792:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143836.977801:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194380 with x1830963624921216 ext(1564672->2097151) 00010000:00010000:3.0:1746143836.977805:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 29 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143836.977812:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 29 pid: 3134 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143836.977817:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094194380 00000100:00100000:3.0:1746143836.977827:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2642 00000100:00100000:3.0:1746143836.977831:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963624921216:12345-192.168.202.3@tcp:4:multiop.0 00002000:00100000:0.0:1746143836.978327:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963624921088 ext(1048576->1261567) 00010000:00010000:0.0:1746143836.978333:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143836.978371:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 996 lvb_type: 0 00002000:00010000:0.0:1746143836.978386:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195500 00000100:00100000:3.0:1746143836.978509:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2643 00000100:00100000:3.0:1746143836.978516:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624921088:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143836.978643:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627444608:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143836.978651:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978658:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978670:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978677:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978683:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978689:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143836.978692:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978703:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978712:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.978717:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b4a16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.978769:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624920320:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 15784us (16062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143836.978776:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16344 00000100:00100000:3.0:1746143836.978828:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094196a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627444736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143836.978843:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b4a32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.988529:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.990500:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.990707:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143836.990728:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624922112 00000100:00100000:3.0:1746143836.990732:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624922112 00010000:00010000:0.0:1746143836.991082:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991089:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991103:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991108:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991114:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991120:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082086c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143836.991122:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991129:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991137:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143836.991142:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b4a24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143836.991474:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624920832:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 28045us (28329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143836.991481:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16346 00000100:00100000:1.0:1746143836.991535:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963624921088:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 13019us (14920us total) trans 17179873909 rc 0/0 00000100:00100000:1.0:1746143836.991542:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2643 00002000:00100000:1.0:1746143836.991549:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1261567) req@ffff880094195500 x1830963624921088/t17179873909(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/448 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.991562:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963624921088 ext(1048576->1261567) 00010000:00010000:1.0:1746143836.991569:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 29 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.991578:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 29 pid: 9585 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746143836.991589:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195500 00000100:00100000:1.0:1746143836.991667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.991736:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624922624 00000100:00100000:1.0:1746143836.991740:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624922624 00000100:00100000:0.0:1746143836.991897:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624922496 00000100:00100000:0.0:1746143836.991901:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624922496 00010000:00010000:3.0:1746143836.992147:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 29 pid: 9585 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.992165:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7971 00000100:00100000:3.0:1746143836.992171:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2009:x1830963624922112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143836.992179:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143836.992189:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 29 pid: 9585 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143836.992197:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 29 pid: 9585 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143836.992209:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b462d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411469 expref: 29 pid: 9585 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143836.992221:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143836.992223:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143836.992226:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b4a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.992232:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b4a0f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.992247:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143836.992265:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963624922112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143836.992270:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7971 00010000:00010000:1.0:1746143836.992515:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73b4959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841160d expref: 27 pid: 9585 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143836.992531:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7972 00000100:00100000:1.0:1746143836.992537:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624922624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.992543:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.992551:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73b4959 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841160d expref: 27 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.992559:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73b4959 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841160d expref: 27 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.992569:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77200/0x87925e4cb73b4959 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841160d expref: 27 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.992586:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.992602:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963624922624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.992608:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7972 00000100:00100000:1.0:1746143836.992672:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963624921216:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 14839us (16031us total) trans 21474841185 rc 0/0 00000100:00100000:1.0:1746143836.992677:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2642 00002000:00100000:1.0:1746143836.992682:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1564672->2097151) req@ffff880094194380 x1830963624921216/t21474841185(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:232/0 lens 488/448 e 0 to 0 dl 1746143847 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143836.992689:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194380 with x1830963624921216 ext(1564672->2097151) 00010000:00010000:1.0:1746143836.992695:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.992702:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00002000:00010000:1.0:1746143836.992707:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094194380 00010000:00010000:0.0:1746143836.992968:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b49d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841166f expref: 10 pid: 13430 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143836.993035:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7973 00000100:00100000:3.0:1746143836.993042:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624922496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143836.993048:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143836.993060:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b49d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841166f expref: 10 pid: 13430 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143836.993073:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b49d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841166f expref: 10 pid: 13430 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143836.993083:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b49d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841166f expref: 10 pid: 13430 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143836.993091:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143836.993093:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143836.993095:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b4a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.993101:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b4a32 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143836.993126:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143836.993142:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624922496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143836.993147:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7973 00000100:00100000:0.0:1746143836.997419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143836.998029:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624922752 00000100:00100000:1.0:1746143836.998037:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624922752 00010000:00010000:1.0:1746143836.998067:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143836.998621:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7974 00000100:00100000:1.0:1746143836.998628:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624922752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143836.998643:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143836.998828:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.998839:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.998859:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123268e00/0x87925e4cb73b4967 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841161b expref: 26 pid: 9585 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143836.998879:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.998880:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143836.998884:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b4a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.998890:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3e00/0x87925e4cb73b4a1d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143836.999601:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143836.999642:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963624922752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1014us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143836.999649:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7974 00000100:00100000:3.0:1746143836.999783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.000026:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624922880 00000100:00100000:1.0:1746143837.000030:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624922880 00010000:00010000:1.0:1746143837.000046:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.000060:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7975 00000100:00100000:1.0:1746143837.000066:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624922880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143837.000072:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143837.000082:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.000090:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.000101:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b4952 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411606 expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.000109:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.000111:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.000113:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.000119:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.000142:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143837.000159:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624922880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.000164:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7975 00010000:00010000:3.0:1746143837.001998:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002010:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002029:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002036:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002042:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002047:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143837.002050:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002056:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002070:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.002076:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b4a2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.002136:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2008:x1830963624920448:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 38516us (38557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.002144:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16347 00000100:00100000:0.0:1746143837.007891:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.007977:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624923136 00000100:00100000:1.0:1746143837.007986:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624923136 00000100:00100000:1.0:1746143837.008038:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13936 00000100:00100000:1.0:1746143837.008045:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2660:x1830963624923136:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:1.0:1746143837.008085:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143837.008106:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b4a08 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841168b expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008121:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143837.008125:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143837.008147:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.008158:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 29 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008164:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b47d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411557 expref: 278 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008169:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008175:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 29 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008180:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008186:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008191:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.008218:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.008228:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 278 pid: 7245 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.008238:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627444864:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143837.008937:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143837.011608:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 278 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.012942:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 278 pid: 7245 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.012958:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627444992:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143837.013499:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 29 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.013507:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 29 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.013515:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445120:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143837.014094:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.014102:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 29 pid: 6587 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.014112:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445248:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143837.014135:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411557 expref: 279 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.014141:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411557 expref: 279 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.014146:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445376:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143837.014162:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 29 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.014168:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 29 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.014173:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143837.014185:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143837.014204:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c70380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627444864:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143837.014694:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143837.017512:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.017549:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.017561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.017576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.017981:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.018157:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624923520 00000100:00100000:3.0:1746143837.018158:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624923776 00000100:00100000:3.0:1746143837.018164:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624923776 00000100:00100000:1.0:1746143837.018164:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624923520 00010000:00010000:3.0:1746143837.018190:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 281 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.018190:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 281 pid: 7245 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.018213:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624923648 00000100:00100000:1.0:1746143837.018215:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624923648 00010000:00010000:1.0:1746143837.018237:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 30 pid: 10936 timeout: 996 lvb_type: 0 00000100:00080000:0.0:1746143837.018324:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143837.018546:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624924032 00000100:00100000:1.0:1746143837.018546:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624923904 00000100:00100000:1.0:1746143837.018549:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624923904 00000100:00100000:3.0:1746143837.018550:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624924032 00010000:00010000:1.0:1746143837.018560:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b47d8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411557 expref: 282 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.018561:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 31 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.018572:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7976 00000100:00100000:1.0:1746143837.018578:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+282:2009:x1830963624923520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143837.018580:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7977 00000100:00100000:3.0:1746143837.018585:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+282:2009:x1830963624923776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143837.018588:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.018592:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.018595:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 282 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.018597:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 282 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.018603:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 282 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.018622:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.018626:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.018634:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.018678:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+282:2009:x1830963624923776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 92us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.018684:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7977 00000100:00100000:3.0:1746143837.018698:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7978 00000100:00100000:3.0:1746143837.018703:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963624923648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.018708:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.018711:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 31 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.018719:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 31 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.018731:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 281 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.019650:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7f400/0x87925e4cb73b44dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113b3 expref: 281 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.019660:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.019664:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143837.019665:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627444992:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143837.019670:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143837.019675:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fa00/0x87925e4cb73b44d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484113ac expref: 31 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143837.019682:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445120:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143837.019690:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624923648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 987us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.019690:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143837.019696:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7978 00000100:00100000:0.0:1746143837.019697:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445504:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143837.019709:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7980 00000100:00100000:3.0:1746143837.019713:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2009:x1830963624924032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.019719:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.019722:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 29 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.019730:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 29 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143837.019737:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627445248:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143837.019757:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b46c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114c4 expref: 280 pid: 7245 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.019766:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143837.019769:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.019774:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143837.019792:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+279:2009:x1830963624923520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1214us (2284us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143837.019793:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143837.019797:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7976 00010000:00010000:3.0:1746143837.019868:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c200/0x87925e4cb73b4722 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484114f5 expref: 29 pid: 10936 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.019877:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.019880:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.019887:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.019902:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963624924032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 189us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.019908:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7980 00000100:00100000:0.0:1746143837.020865:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.020907:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624924160 00000100:00100000:3.0:1746143837.020931:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624924160 00010000:00010000:3.0:1746143837.020947:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 28 pid: 6587 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746143837.020962:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7981 00000100:00100000:3.0:1746143837.020967:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624924160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.020974:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.020978:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 28 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.020986:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 28 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.020996:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7ea00/0x87925e4cb73b44a5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841137b expref: 28 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.021005:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.021008:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.021014:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.021022:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.021038:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.021057:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963624924160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.021063:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7981 00010000:00010000:0.0:1746143837.021204:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.021210:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:0.0:1746143837.021420:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3202, 88 off269624 00000004:00080000:0.0:1746143837.021427:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896245514258ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.023655:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3201, 88 off269184 00000004:00080000:1.0:1746143837.023667:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896247754579ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.023771:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3202, 88 off269272 00000004:00080000:1.0:1746143837.023775:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896247862986ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.023791:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3203, 88 off269712 00000004:00080000:1.0:1746143837.023793:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896247881284ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024023:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3204, 88 off269800 00000004:00080000:1.0:1746143837.024027:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248114741ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024035:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3203, 88 off269360 00000004:00080000:1.0:1746143837.024038:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896248125432ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.024135:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3204, 88 off269448 00000004:00080000:1.0:1746143837.024139:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896248226549ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.024147:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3205, 88 off269536 00000004:00080000:1.0:1746143837.024149:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896248236670ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.024156:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3205, 88 off269888 00000004:00080000:1.0:1746143837.024159:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248246685ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024260:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3206, 88 off269624 00000004:00080000:1.0:1746143837.024263:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896248350982ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.024339:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3206, 88 off269976 00000004:00080000:1.0:1746143837.024342:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248430226ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024352:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3207, 88 off269712 00000004:00080000:1.0:1746143837.024354:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896248442184ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143837.024361:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3207, 88 off270064 00000004:00080000:1.0:1746143837.024363:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248451332ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024370:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3208, 88 off270152 00000004:00080000:1.0:1746143837.024373:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248460469ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024391:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3209, 88 off270240 00000004:00080000:1.0:1746143837.024393:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248481166ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024505:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3211, 88 off270424 00000004:00080000:1.0:1746143837.024510:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896248597480ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143837.024521:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3208, 88 off269800 00000004:00080000:1.0:1746143837.024523:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896248611031ns, next at 850789974850ns, rc = 0 00000001:00080000:0.0:1746143837.036994:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944984 is committed 00000004:00080000:0.0:1746143837.037010:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2422 committed 00000004:00080000:0.0:1746143837.037026:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2427 committed 00000004:00080000:0.0:1746143837.037043:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2426 committed 00000004:00080000:0.0:1746143837.037045:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2425 committed 00000004:00080000:0.0:1746143837.037047:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2424 committed 00000004:00080000:0.0:1746143837.037048:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2421 committed 00000004:00080000:0.0:1746143837.037050:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2423 committed 00000004:00080000:0.0:1746143837.037052:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2420 committed 00000004:00080000:0.0:1746143837.037054:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2422 committed 00000004:00080000:0.0:1746143837.037056:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2419 committed 00000004:00080000:0.0:1746143837.037057:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2418 committed 00000004:00080000:0.0:1746143837.037059:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2417 committed 00000004:00080000:0.0:1746143837.037060:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2421 committed 00000004:00080000:0.0:1746143837.037062:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2420 committed 00000004:00080000:0.0:1746143837.037063:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2416 committed 00000004:00080000:0.0:1746143837.037065:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2415 committed 00000004:00080000:0.0:1746143837.037066:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2419 committed 00000001:00080000:0.0:1746143837.037072:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944983 is committed 00000001:00080000:0.0:1746143837.037086:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944979 is committed 00000100:00100000:3.0:1746143837.038557:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627447040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.038609:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.038628:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627447552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.038641:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.038652:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143837.038656:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627446912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.038670:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.038677:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627447424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.038687:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1746143837.038783:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880094197b80 reply state ffff88007f6b9400 transno 8589944984 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.038799:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.038807:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143837.038809:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143837.038812:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746143837.038878:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746143837.038890:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2660:x1830963624923136:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 30844us (31004us total) trans 8589944984 rc 0/0 00000100:00100000:1.0:1746143837.038899:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13936 00010000:00010000:3.0:1746143837.039832:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.039839:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.039844:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.039848:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143837.039851:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.039859:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.039867:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.039869:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143837.039871:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.039875:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b4a39 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000004:00080000:3.0:1746143837.039932:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6f480/2, rc 0, transno 21474841188 00000100:00100000:3.0:1746143837.039936:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627446912:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.039943:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4c000/2, rc 0, transno 21474841189 00000100:00100000:3.0:1746143837.039946:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627447424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.039954:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6f800/2, rc 0, transno 21474841186 00000100:00100000:3.0:1746143837.039957:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627447040:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.039962:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4ce00/2, rc 0, transno 21474841187 00000100:00100000:3.0:1746143837.039964:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627447552:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746143837.040238:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143837.040244:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143837.042280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.042387:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624924288 00000100:00100000:1.0:1746143837.042395:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624924288 00000100:00100000:1.0:1746143837.042441:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13937 00000100:00100000:1.0:1746143837.042447:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2660:x1830963624924288:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143837.042465:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.042482:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411692 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.042524:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411692 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.042535:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411692 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.042551:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143837.042553:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143837.042555:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d66800, rc 0) 00000100:00100000:1.0:1746143837.042599:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2660:x1830963624924288:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 152us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.042604:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13937 00000100:00100000:0.0:1746143837.049368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.049447:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624924416 00000100:00100000:3.0:1746143837.049454:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624924416 00000100:00100000:3.0:1746143837.049513:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 979 00000100:00100000:3.0:1746143837.049520:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2660:x1830963624924416:12345-192.168.202.3@tcp:103:mirror_io.0 00010000:00010000:3.0:1746143837.049532:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.049554:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b49fa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411684 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.049585:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.049589:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.049634:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2660:x1830963624924416:12345-192.168.202.3@tcp:103:mirror_io.0 Request processed in 114us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.049640:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 979 00000100:00100000:0.0:1746143837.051988:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.056462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.086831:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.088038:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624925184 00000100:00100000:3.0:1746143837.088047:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624925184 00000100:00100000:3.0:1746143837.088103:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13938 00000100:00100000:3.0:1746143837.088110:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+260:2667:x1830963624925184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143837.088131:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143837.088147:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b4a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411699 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.088207:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088218:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088228:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088239:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088244:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088249:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088327:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088335:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088340:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143837.088348:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143837.088425:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088431:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088436:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088441:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088446:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143837.088450:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088456:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088464:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143837.088466:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143837.088469:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088478:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088500:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088505:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088509:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088514:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143837.088515:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088520:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088524:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65b00) 00010000:00010000:3.0:1746143837.088526:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143837.088528:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088531:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b4a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143837.088562:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b4a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411699 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.088572:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411699 expref: 262 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.088583:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.088585:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143837.088587:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368dac00, rc 0) 00000100:00100000:3.0:1746143837.088627:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:2667:x1830963624925184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 517us (1802us total) trans 8589944987 rc 0/0 00000100:00100000:3.0:1746143837.088632:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13938 00000100:00100000:0.0:1746143837.094864:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.094901:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.101279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.101316:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.101332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.101357:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.101411:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624925440 00000100:00100000:0.0:1746143837.101418:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624925440 00000100:00100000:0.0:1746143837.101459:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624925952 00000100:00100000:0.0:1746143837.101461:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624925952 00000100:00100000:0.0:1746143837.101468:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624925312 00000100:00100000:0.0:1746143837.101470:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624925312 00000100:00100000:0.0:1746143837.101568:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624925824 00000100:00100000:0.0:1746143837.101571:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624925824 00000100:00100000:0.0:1746143837.101586:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16366 00000100:00100000:0.0:1746143837.101592:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963624925440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.101607:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.101622:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484116a7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143837.101642:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a5b, atime: 0x68140a5b, ctime: 0x68140a5b, blocks: 0x808 00010000:00010000:0.0:1746143837.101657:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.101659:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.101666:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.101678:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.101687:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3200, rc 0) 00000100:00100000:0.0:1746143837.102235:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963624925440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 640us (7376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.102243:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16366 00000100:00100000:0.0:1746143837.102268:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16368 00000100:00100000:0.0:1746143837.102274:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963624925696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.102281:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.102508:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b4a86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484116b5 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143837.102519:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a5d, atime: 0x68140a59, ctime: 0x68140a5d, blocks: 0x808 00010000:00010000:0.0:1746143837.102527:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.102529:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.102533:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b4a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116b5 expref: 42 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.102542:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b4a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116b5 expref: 42 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.102560:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:0.0:1746143837.102577:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963624925696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 303us (7676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.102582:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16368 00000100:00080000:0.0:1746143837.102599:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143837.102603:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143837.103298:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.104872:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624926208 00000100:00100000:1.0:1746143837.104881:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624926208 00000100:00100000:1.0:1746143837.104952:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13939 00000100:00100000:1.0:1746143837.104959:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2665:x1830963624926208:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143837.104983:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.105001:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096b25a00/0x87925e4cb73b4a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484116ca expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.105083:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.105095:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411699 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.105102:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143837.105127:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411699 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.105137:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b4a5c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411699 expref: 263 pid: 10936 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.105151:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627447808:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143837.105233:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.114547:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.114616:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624926464 00000100:00100000:1.0:1746143837.114623:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624926464 00002000:00100000:1.0:1746143837.114658:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012b1d9500 x1830963624926464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.114667:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9500 with x1830963624926464 ext(0->1048575) 00002000:00010000:1.0:1746143837.114672:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d9500 00000100:00100000:1.0:1746143837.114700:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7108 00000100:00100000:1.0:1746143837.114706:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624926464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143837.114880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.114906:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624926720 00000100:00100000:0.0:1746143837.114909:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624926720 00002000:00100000:0.0:1746143837.114945:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88012b1dad80 x1830963624926720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.114953:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963624926720 ext(1048576->2097151) 00002000:00010000:0.0:1746143837.114956:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1dad80 00000100:00100000:0.0:1746143837.114968:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7109 00000100:00100000:0.0:1746143837.114973:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963624926720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143837.117743:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.119679:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624926976 00000100:00100000:3.0:1746143837.119689:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624926976 00002000:00100000:3.0:1746143837.119729:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880093c72300 x1830963624926976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.119737:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c72300 with x1830963624926976 ext(1048576->2097151) 00002000:00010000:3.0:1746143837.119741:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c72300 00000100:00100000:3.0:1746143837.119770:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7110 00000100:00100000:3.0:1746143837.119777:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963624926976:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143837.121171:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.121802:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624927232 00000100:00100000:0.0:1746143837.121807:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624927232 00002000:00100000:0.0:1746143837.121836:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093c72680 x1830963624927232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.121844:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c72680 with x1830963624927232 ext(1048576->2097151) 00002000:00010000:0.0:1746143837.121847:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c72680 00000100:00100000:0.0:1746143837.121864:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7111 00000100:00100000:0.0:1746143837.121870:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963624927232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143837.133836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.137704:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963624926720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22717us (22811us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143837.137716:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963624926976:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17932us (19971us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143837.137718:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7109 00000100:00100000:3.0:1746143837.137727:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7110 00002000:00100000:0.0:1746143837.137732:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88012b1dad80 x1830963624926720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.137736:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880093c72300 x1830963624926976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.137742:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963624926720 ext(1048576->2097151) 00002000:00100000:3.0:1746143837.137744:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c72300 with x1830963624926976 ext(1048576->2097151) 00002000:00010000:0.0:1746143837.137747:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1dad80 00002000:00010000:3.0:1746143837.137750:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c72300 00000100:00100000:1.0:1746143837.138179:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963624926464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23472us (23638us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143837.138186:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7108 00002000:00100000:1.0:1746143837.138191:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012b1d9500 x1830963624926464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.138197:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9500 with x1830963624926464 ext(0->1048575) 00002000:00010000:1.0:1746143837.138200:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d9500 00000100:00100000:1.0:1746143837.142657:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624927232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20778us (21480us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143837.142667:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7111 00002000:00100000:1.0:1746143837.142677:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093c72680 x1830963624927232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.142685:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c72680 with x1830963624927232 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.142690:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093c72680 00000100:00100000:0.0:1746143837.143222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.143979:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2011:x1830963624927360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5954us (10151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.143992:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7982 00000100:00100000:0.0:1746143837.152046:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.155827:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.157651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.157680:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.158206:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928128 00000100:00100000:1.0:1746143837.158217:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928128 00000100:00100000:0.0:1746143837.158217:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.160362:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928384 00000100:00100000:3.0:1746143837.160383:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928384 00000100:00100000:3.0:1746143837.160428:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928640 00000100:00100000:3.0:1746143837.160430:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928640 00000100:00100000:3.0:1746143837.161254:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16372 00000100:00100000:3.0:1746143837.161264:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963624928128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143837.161285:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143837.161302:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484116e6 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.161326:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.161328:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.161337:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116e6 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143837.161351:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116e6 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143837.161361:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97000, rc 0) 00000100:00100000:0.0:1746143837.161472:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16374 00000100:00100000:0.0:1746143837.161484:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963624928640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.161491:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.161499:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b4b04 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411702 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.162065:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963624928128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 802us (4419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.162070:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16372 00010000:00010000:0.0:1746143837.162170:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162172:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162177:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b4b04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411702 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162188:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2400/0x87925e4cb73b4b04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411702 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162196:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2400, rc 0) 00000100:00100000:0.0:1746143837.162238:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963624928640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 759us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.162243:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16374 00000100:00100000:0.0:1746143837.162287:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.162297:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928256 00000100:00100000:0.0:1746143837.162301:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928256 00000100:00100000:0.0:1746143837.162318:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16375 00000100:00100000:0.0:1746143837.162322:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624928256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.162328:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.162335:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484116ed expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.162346:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162347:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162350:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 31 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162359:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 31 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162365:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2e00, rc 0) 00000100:00100000:0.0:1746143837.162388:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963624928256:12345-192.168.202.3@tcp:101:cat.0 Request processed in 65us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.162393:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16375 00000100:00100000:0.0:1746143837.162426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.162433:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928512 00000100:00100000:0.0:1746143837.162436:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928512 00000100:00100000:0.0:1746143837.162446:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16376 00000100:00100000:0.0:1746143837.162450:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963624928512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.162455:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.162461:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484116fb expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.162480:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162482:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162485:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162493:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162499:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:0.0:1746143837.162510:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963624928512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 59us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.162514:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16376 00000100:00100000:0.0:1746143837.162535:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.162542:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928768 00000100:00100000:0.0:1746143837.162545:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928768 00000100:00100000:0.0:1746143837.162554:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16377 00000100:00100000:0.0:1746143837.162557:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963624928768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.162562:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.162567:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3600/0x87925e4cb73b4b19 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411709 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.162575:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162576:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143837.162579:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3600/0x87925e4cb73b4b19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411709 expref: 32 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162586:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3600/0x87925e4cb73b4b19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411709 expref: 32 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143837.162592:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3600, rc 0) 00000100:00100000:0.0:1746143837.162601:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2009:x1830963624928768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 43us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.162606:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16377 00000100:00100000:1.0:1746143837.162725:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.162762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.163199:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624928896 00000100:00100000:3.0:1746143837.163203:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624928896 00010000:00010000:3.0:1746143837.163219:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b4ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116d8 expref: 11 pid: 6587 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746143837.163248:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7983 00000100:00100000:3.0:1746143837.163254:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963624928896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.163261:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.163265:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b4ae1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116d8 expref: 11 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.163273:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b4ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116d8 expref: 11 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.163285:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.163288:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.163294:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.163298:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.163313:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963624928896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 59us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.163319:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7983 00000100:00100000:0.0:1746143837.182136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.182176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.182223:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.182265:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624929280 00000100:00100000:3.0:1746143837.182275:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624929280 00000100:00100000:0.0:1746143837.182275:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.182318:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624929536 00000100:00100000:3.0:1746143837.182319:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624929536 00000100:00100000:0.0:1746143837.183121:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624929792 00000100:00100000:0.0:1746143837.183127:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624929792 00000100:00100000:0.0:1746143837.183164:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13944 00000100:00100000:0.0:1746143837.183171:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2667:x1830963624929280:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.183191:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.183208:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411717 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.183259:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.183267:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.183284:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.183293:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.183304:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.183306:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143837.183308:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.183313:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2a00, rc 0) 00000100:00100000:0.0:1746143837.183357:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2667:x1830963624929280:12345-192.168.202.3@tcp:101:cat.0 Request processed in 186us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.183363:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13944 00000100:00100000:0.0:1746143837.183391:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13945 00000100:00100000:0.0:1746143837.183396:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2669:x1830963624929536:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143837.183407:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.183409:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143837.183412:0:7244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 87925e4cb73b4abe) 00010000:00010000:0.0:1746143837.183413:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143837.183419:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b4b35 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841171e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.183444:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143837.183452:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 265 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.183458:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143837.183480:0:7244:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 265 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.183486:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143837.183507:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624929664 00000100:00100000:0.0:1746143837.183509:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624929664 00010000:00010000:0.0:1746143837.183522:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411692 expref: 9 pid: 6587 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143837.183537:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7984 00000100:00100000:0.0:1746143837.183541:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624929664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143837.183547:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143837.183551:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411692 expref: 9 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.183560:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411692 expref: 9 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.186542:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d66800/0x87925e4cb73b4a40 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411692 expref: 9 pid: 6587 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.186574:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.186580:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.186590:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.186596:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143837.186603:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143837.186615:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 265 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.186654:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143837.186696:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143837.186707:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143837.186712:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624929664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3167us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.186723:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7984 00000040:00080000:3.0:1746143837.186950:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3212, 88 off270512 00000004:00080000:3.0:1746143837.186955:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896411042999ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.186978:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3209, 88 off269888 00000004:00080000:3.0:1746143837.186981:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896411068999ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.187010:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3210, 88 off269976 00000004:00080000:3.0:1746143837.187013:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896411100840ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.187022:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3213, 88 off270600 00000004:00080000:3.0:1746143837.187025:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896411113022ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.187032:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3214, 88 off270688 00000004:00080000:3.0:1746143837.187034:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896411121827ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.187040:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3211, 88 off270064 00000004:00080000:3.0:1746143837.187042:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896411129592ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.187050:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3212, 88 off270152 00000004:00080000:3.0:1746143837.187053:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896411140477ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.187061:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3213, 88 off270240 00000004:00080000:3.0:1746143837.187063:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896411150682ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.187072:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3215, 88 off270776 00000004:00080000:3.0:1746143837.187074:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896411161720ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.187162:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3215, 88 off270424 00000004:00080000:3.0:1746143837.187165:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896411253034ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.190099:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3216, 88 off270864 00000004:00080000:3.0:1746143837.190112:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896414199600ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.190154:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3216, 88 off270512 00000004:00080000:3.0:1746143837.190157:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896414244880ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143837.190178:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3217, 88 off270952 00000004:00080000:3.0:1746143837.190181:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896414269150ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.190191:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3218, 88 off271040 00000004:00080000:3.0:1746143837.190193:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896414280978ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.190201:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3219, 88 off271128 00000004:00080000:3.0:1746143837.190203:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896414291353ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.190211:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3220, 88 off271216 00000004:00080000:3.0:1746143837.190213:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896414301384ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143837.190221:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3217, 88 off270600 00000004:00080000:3.0:1746143837.190223:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896414311010ns, next at 850789974850ns, rc = 0 00000001:00080000:0.0:1746143837.195780:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944991 is committed 00000004:00080000:0.0:1746143837.195789:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2430 committed 00000004:00080000:0.0:1746143837.196450:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2436 committed 00000004:00080000:0.0:1746143837.196457:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2435 committed 00000004:00080000:0.0:1746143837.196458:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2434 committed 00000004:00080000:0.0:1746143837.196464:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2433 committed 00000004:00080000:0.0:1746143837.196465:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2429 committed 00000100:00100000:3.0:1746143837.196554:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627448448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.196603:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.196633:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627448960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.196647:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.196682:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627448576:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.196697:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.196716:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627448832 00000100:00100000:3.0:1746143837.196720:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627449088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143837.196727:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627448832 00000004:00080000:0.0:1746143837.196765:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2432 committed 00000004:00080000:0.0:1746143837.196767:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2428 committed 00000004:00080000:0.0:1746143837.196769:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2431 committed 00000004:00080000:0.0:1746143837.196770:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2427 committed 00000004:00080000:0.0:1746143837.196772:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2426 committed 00000004:00080000:0.0:1746143837.196773:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2425 committed 00000004:00080000:0.0:1746143837.196774:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2430 committed 00000004:00080000:0.0:1746143837.196776:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2429 committed 00000004:00080000:0.0:1746143837.196777:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2424 committed 00000004:00080000:0.0:1746143837.196779:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2423 committed 00000004:00080000:0.0:1746143837.196780:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2428 committed 00000001:00080000:0.0:1746143837.196785:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944990 is committed 00000001:00080000:0.0:1746143837.196792:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944986 is committed 00000100:00100000:3.0:1746143837.196845:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.196864:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143837.196869:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627448704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143837.196873:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449088 00000100:00100000:1.0:1746143837.196876:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449088 00000100:00100000:1.0:1746143837.196895:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16379 00000100:00100000:3.0:1746143837.196896:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.196903:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3772:x1830963627448960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.196909:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627449216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.196938:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.196960:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627448704 00000100:00100000:3.0:1746143837.196962:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627448704 00000100:00100000:3.0:1746143837.196976:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449216 00000100:00100000:3.0:1746143837.196978:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449216 00000100:00100000:3.0:1746143837.196985:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380 00000100:00100000:3.0:1746143837.196989:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963627448576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143837.197041:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143837.197043:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00002000:00010000:3.0:1746143837.197045:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143834 -> 1746143834 00002000:00010000:3.0:1746143837.197047:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00002000:00010000:3.0:1746143837.197048:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143837.197071:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963627448960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (422us total) trans 21474841195 rc 0/0 00000100:00100000:3.0:1746143837.197073:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963627448576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (374us total) trans 21474841196 rc 0/0 00000100:00100000:1.0:1746143837.197078:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16379 00000100:00100000:3.0:1746143837.197082:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380 00000100:00100000:1.0:1746143837.197095:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382 00000100:00100000:1.0:1746143837.197100:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963627449088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.197102:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383 00000100:00100000:3.0:1746143837.197107:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963627448704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143837.197134:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16384 00000100:00100000:0.0:1746143837.197140:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963627449216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143837.197147:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:3.0:1746143837.197149:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143837.197150:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143837.197151:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00002000:00010000:1.0:1746143837.197151:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143837.197153:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143836 -> 1746143836 00002000:00010000:1.0:1746143837.197153:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143837.197155:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00002000:00010000:1.0:1746143837.197155:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00002000:00010000:3.0:1746143837.197156:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143837.197179:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963627449088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (445us total) trans 21474841198 rc 0/0 00000100:00100000:3.0:1746143837.197181:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963627448704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (284us total) trans 21474841199 rc 0/0 00000100:00100000:1.0:1746143837.197185:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382 00000100:00100000:3.0:1746143837.197190:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383 00000100:00100000:0.0:1746143837.197203:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627449216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (263us total) trans 21474841200 rc 0/0 00000100:00100000:0.0:1746143837.197208:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16384 00000004:00080000:3.0:1746143837.197222:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f78a80/2, rc 0, transno 21474841195 00000100:00100000:3.0:1746143837.197226:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627448960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.197234:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f7a300/2, rc 0, transno 21474841194 00000100:00100000:3.0:1746143837.197237:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627448448:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.197250:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f7a680/2, rc 0, transno 21474841199 00000100:00100000:3.0:1746143837.197253:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627448704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.197260:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f78e00/2, rc 0, transno 21474841200 00000100:00100000:3.0:1746143837.197262:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627449216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143837.197262:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627449472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143837.197268:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f78000/2, rc 0, transno 21474841196 00000100:00100000:3.0:1746143837.197270:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627448576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.197279:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f79880/2, rc 0, transno 21474841198 00000100:00100000:3.0:1746143837.197282:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627449088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.197289:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627449600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.197292:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143837.197300:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627449728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.197310:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.197318:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627449984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.197322:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.197326:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627450112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.197337:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627450240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.197341:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143837.197365:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.197370:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143837.197385:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627449856:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143837.197387:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411710 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.197396:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:0.0:1746143837.197398:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449472 00010000:00010000:3.0:1746143837.197399:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143837.197401:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143837.197401:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143837.197401:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449472 00010000:00010000:3.0:1746143837.197408:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b4b27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411710 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143837.197412:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627450368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.197417:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449600 00010000:00010000:3.0:1746143837.197419:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143837.197419:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449600 00000100:00100000:1.0:1746143837.197422:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143837.197425:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60080000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143837.197426:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449728 00000100:00100000:0.0:1746143837.197428:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449728 00000100:00100000:0.0:1746143837.197435:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449984 00010000:00010000:3.0:1746143837.197436:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60080000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143837.197437:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449984 00000100:00100000:1.0:1746143837.197439:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627450240 00010000:00010000:3.0:1746143837.197441:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143837.197442:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627450240 00000100:00100000:0.0:1746143837.197444:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627449856 00000100:00100000:0.0:1746143837.197446:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627449856 00000100:00100000:3.0:1746143837.197453:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.197457:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627450112 00000100:00100000:0.0:1746143837.197457:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627450368 00000100:00100000:0.0:1746143837.197458:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627450368 00000100:00100000:1.0:1746143837.197459:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627450112 00000100:00100000:0.0:1746143837.197469:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385 00000100:00100000:1.0:1746143837.197474:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00000100:00100000:0.0:1746143837.197474:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963627449472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.197479:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963627449600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143837.197545:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143837.197548:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00002000:00010000:1.0:1746143837.197550:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143833 -> 1746143833 00002000:00010000:1.0:1746143837.197552:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00002000:00010000:1.0:1746143837.197553:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143837.197577:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627449600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (266us total) trans 17179873919 rc 0/0 00000100:00100000:3.0:1746143837.199831:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387 00000100:00100000:1.0:1746143837.199845:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386 00000100:00100000:3.0:1746143837.199847:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3774:x1830963627449728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.199878:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16388 00000100:00100000:1.0:1746143837.199888:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963627449984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143837.199946:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143837.199949:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143835 -> 1746143835 00002000:00010000:0.0:1746143837.199951:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143834 -> 1746143834 00000004:00080000:3.0:1746143837.199953:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35bb80/2, rc 0, transno 17179873919 00002000:00010000:0.0:1746143837.199953:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143835 -> 1746143835 00002000:00010000:0.0:1746143837.199954:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:3.0:1746143837.199964:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627449600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.200003:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3772:x1830963627449472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2522us (2703us total) trans 17179873921 rc 0/0 00000100:00100000:0.0:1746143837.200013:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385 00000100:00100000:1.0:1746143837.200037:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963627449984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (2694us total) trans 17179873922 rc 0/0 00000100:00100000:0.0:1746143837.200037:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389 00000100:00100000:0.0:1746143837.200043:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627450240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.200044:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16388 00000100:00100000:1.0:1746143837.200057:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390 00000100:00100000:1.0:1746143837.200063:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627449856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143837.200090:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143837.200092:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143837.200094:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143837.200095:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143837.200097:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143837.200123:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3774:x1830963627450240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (2757us total) trans 17179873923 rc 0/0 00000100:00100000:1.0:1746143837.200127:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3772:x1830963627449856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (2725us total) trans 17179873924 rc 0/0 00000100:00100000:0.0:1746143837.200129:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389 00000100:00100000:1.0:1746143837.200133:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390 00000100:00100000:0.0:1746143837.200142:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391 00000100:00100000:1.0:1746143837.200146:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16392 00000100:00100000:0.0:1746143837.200148:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627450368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.200152:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627450112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143837.200192:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:0.0:1746143837.200195:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143837.200196:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143837.200197:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143837.200199:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143837.200222:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3772:x1830963627450368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (2798us total) trans 17179873925 rc 0/0 00000100:00100000:0.0:1746143837.200226:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391 00000004:00080000:0.0:1746143837.200251:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35b480/2, rc 0, transno 17179873923 00000100:00100000:0.0:1746143837.200255:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627450240:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143837.200639:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:3.0:1746143837.200642:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00002000:00010000:3.0:1746143837.200644:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143836 -> 1746143836 00002000:00010000:3.0:1746143837.200646:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00002000:00010000:3.0:1746143837.200648:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:3.0:1746143837.200675:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3774:x1830963627449728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 834us (3352us total) trans 17179873920 rc 0/0 00000100:00100000:3.0:1746143837.200681:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387 00000100:00100000:3.0:1746143837.200693:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16394 00000100:00100000:3.0:1746143837.200697:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3771:x1830963627450496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.200761:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3771:x1830963627450496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (277us total) trans 17179873927 rc 0/0 00000100:00100000:3.0:1746143837.200766:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16394 00000100:00100000:1.0:1746143837.200787:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627450112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 635us (3332us total) trans 17179873926 rc 0/0 00000004:00080000:3.0:1746143837.200789:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e358e00/2, rc 0, transno 17179873926 00000100:00100000:3.0:1746143837.200794:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627450112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.200794:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16392 00000004:00080000:0.0:1746143837.200795:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35a680/2, rc 0, transno 17179873920 00000100:00100000:0.0:1746143837.200799:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627449728:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143837.200839:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e359c00/2, rc 0, transno 17179873924 00000100:00100000:1.0:1746143837.200843:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627449856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143837.200853:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e35a300/2, rc 0, transno 17179873925 00000100:00100000:1.0:1746143837.200856:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627450368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143837.200862:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e358a80/2, rc 0, transno 17179873922 00000100:00100000:1.0:1746143837.200864:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627449984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143837.200871:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e359f80/2, rc 0, transno 17179873921 00000100:00100000:1.0:1746143837.200873:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627449472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.204808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.204854:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624929920 00000100:00100000:3.0:1746143837.204861:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624929920 00000100:00100000:3.0:1746143837.204898:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13947 00000100:00100000:3.0:1746143837.204905:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:2667:x1830963624929920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143837.204936:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143837.204948:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841172c expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.204986:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.204995:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.205002:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.205005:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143837.205007:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143837.205012:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084200, rc 0) 00000100:00100000:3.0:1746143837.205039:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:2667:x1830963624929920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 135us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.205045:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13947 00000100:00100000:0.0:1746143837.205306:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.205320:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624930048 00000100:00100000:0.0:1746143837.205323:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624930048 00010000:00010000:0.0:1746143837.205336:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143837.205360:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7985 00000100:00100000:0.0:1746143837.205364:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:2008:x1830963624930048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143837.205380:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143837.205384:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.205391:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.205403:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b4b2e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411717 expref: 264 pid: 7244 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.205413:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.205416:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143837.205421:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143837.205425:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143837.205443:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963624930048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.205449:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7985 00000100:00100000:0.0:1746143837.212727:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143837.213450:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143837.213457:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000040:00080000:0.0:1746143837.213683:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3221, 88 off271304 00000004:00080000:0.0:1746143837.213689:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437776505ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213714:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3218, 88 off270688 00000004:00080000:0.0:1746143837.213716:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437804200ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213742:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3219, 88 off270776 00000004:00080000:0.0:1746143837.213745:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437833078ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213753:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3222, 88 off271392 00000004:00080000:0.0:1746143837.213756:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437843545ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213762:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3223, 88 off271480 00000004:00080000:0.0:1746143837.213765:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437852653ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213772:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3220, 88 off270864 00000004:00080000:0.0:1746143837.213774:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437862169ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213781:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3221, 88 off270952 00000004:00080000:0.0:1746143837.213783:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437871158ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213789:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3222, 88 off271040 00000004:00080000:0.0:1746143837.213791:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437879301ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213798:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3224, 88 off271568 00000004:00080000:0.0:1746143837.213800:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437888369ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213807:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3223, 88 off271128 00000004:00080000:0.0:1746143837.213810:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437897529ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213816:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3225, 88 off271656 00000004:00080000:0.0:1746143837.213818:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437905714ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213825:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3224, 88 off271216 00000004:00080000:0.0:1746143837.213827:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437914739ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143837.213833:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3226, 88 off271744 00000004:00080000:0.0:1746143837.213836:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437923830ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213843:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3227, 88 off271832 00000004:00080000:0.0:1746143837.213845:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437932794ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213851:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3228, 88 off271920 00000004:00080000:0.0:1746143837.213854:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437941650ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213861:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3229, 88 off272008 00000004:00080000:0.0:1746143837.213864:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 896437951464ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143837.213872:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3225, 88 off271304 00000004:00080000:0.0:1746143837.213874:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 896437961713ns, next at 850789974850ns, rc = 0 00000100:00100000:3.0:1746143837.224881:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627450880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746143837.224952:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.224998:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627450880 00000100:00100000:1.0:1746143837.225004:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627450880 00000100:00100000:1.0:1746143837.225068:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:1.0:1746143837.225074:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627450880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746143837.225099:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1163993152 pending 8986624 free 3906236416 avail 3674714112 00000100:00100000:1.0:1746143837.225136:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627450880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.225141:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1746143837.225157:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627450880:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1746143837.227810:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.227820:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:1.0:1746143837.227822:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451264:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143837.227822:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746143837.227826:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.227834:0:7244:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.227840:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.227849:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.227854:0:7244:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.227859:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143837.227861:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746143837.227879:0:7244:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143837.227880:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.227888:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627452032:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143837.227891:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.227903:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143837.227907:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.227933:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.227950:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451264 00000100:00100000:1.0:1746143837.227955:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451264 00010000:00010000:0.0:1746143837.227962:0:7244:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143837.227969:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627452160:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143837.227980:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451776 00000100:00100000:1.0:1746143837.227982:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451776 00000100:00100000:0.0:1746143837.227985:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143837.227991:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451136 00000100:00100000:1.0:1746143837.227992:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451136 00000100:00100000:0.0:1746143837.228000:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16395 00000100:00100000:0.0:1746143837.228005:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963627451264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.228012:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16396 00000100:00100000:1.0:1746143837.228016:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963627451776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.228050:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.228073:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.228088:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.228103:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.228111:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451392 00000100:00100000:1.0:1746143837.228114:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451392 00000100:00100000:3.0:1746143837.228115:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143837.228119:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451008:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143837.228124:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00000100:00100000:1.0:1746143837.228126:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451904 00002000:00010000:0.0:1746143837.228127:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00000100:00100000:1.0:1746143837.228128:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451904 00002000:00010000:0.0:1746143837.228129:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143836 -> 1746143836 00002000:00010000:0.0:1746143837.228131:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00000100:00100000:3.0:1746143837.228132:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143837.228132:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:1.0:1746143837.228141:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451008 00000100:00100000:3.0:1746143837.228143:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.228143:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451008 00000100:00100000:1.0:1746143837.228153:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16397 00000100:00100000:1.0:1746143837.228156:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3772:x1830963627451136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.228158:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143837.228158:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3772:x1830963627451264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (296us total) trans 17179873929 rc 0/0 00000100:00100000:0.0:1746143837.228163:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16395 00000100:00100000:0.0:1746143837.228173:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451520 00000100:00100000:0.0:1746143837.228175:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451520 00000100:00100000:3.0:1746143837.228176:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16398 00000100:00100000:3.0:1746143837.228183:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627451392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.228185:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16399 00000100:00100000:0.0:1746143837.228189:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627451904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143837.228193:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143837.228195:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00002000:00010000:1.0:1746143837.228197:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143833 -> 1746143833 00002000:00010000:1.0:1746143837.228199:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00002000:00010000:1.0:1746143837.228200:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143837.228218:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3772:x1830963627451136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (284us total) trans 17179873930 rc 0/0 00002000:00010000:0.0:1746143837.228222:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00000100:00100000:1.0:1746143837.228223:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16397 00002000:00010000:0.0:1746143837.228224:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143837.228225:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143837.228227:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143837.228228:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:1.0:1746143837.228232:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16400 00000100:00100000:1.0:1746143837.228235:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627451008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.228247:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627451904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (144us total) trans 17179873931 rc 0/0 00000100:00100000:3.0:1746143837.228249:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627451392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (175us total) trans 17179873932 rc 0/0 00000100:00100000:0.0:1746143837.228252:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16399 00000100:00100000:3.0:1746143837.228255:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16398 00000100:00100000:0.0:1746143837.228261:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16401 00000100:00100000:0.0:1746143837.228265:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627451520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143837.228268:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746143837.228270:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143835 -> 1746143835 00002000:00010000:1.0:1746143837.228272:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143834 -> 1746143834 00002000:00010000:1.0:1746143837.228273:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143835 -> 1746143835 00002000:00010000:1.0:1746143837.228275:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000004:00080000:3.0:1746143837.228280:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136635500/2, rc 0, transno 17179873932 00000100:00100000:3.0:1746143837.228288:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.228291:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627451008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (158us total) trans 17179873933 rc 0/0 00000004:00080000:3.0:1746143837.228294:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136635c00/2, rc 0, transno 17179873931 00000100:00100000:3.0:1746143837.228296:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.228296:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16400 00000004:00080000:3.0:1746143837.228302:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c70380/2, rc 0, transno 17179873933 00000100:00100000:3.0:1746143837.228305:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.228307:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627451520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (147us total) trans 17179873934 rc 0/0 00000004:00080000:3.0:1746143837.228310:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136635f80/2, rc 0, transno 17179873934 00000100:00100000:0.0:1746143837.228311:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16401 00000100:00100000:3.0:1746143837.228313:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627451520:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143837.228315:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143837.228317:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143837.228319:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143837.228320:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143837.228322:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000004:00080000:0.0:1746143837.228331:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c71f80/2, rc 0, transno 17179873930 00000100:00100000:3.0:1746143837.228334:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143837.228335:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3772:x1830963627451776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (444us total) trans 17179873928 rc 0/0 00000100:00100000:0.0:1746143837.228335:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.228339:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627452288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.228340:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16396 00000100:00100000:0.0:1746143837.228340:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.228355:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143837.228383:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627452288 00000100:00100000:1.0:1746143837.228386:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627452288 00000100:00100000:1.0:1746143837.229152:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627452416 00000100:00100000:1.0:1746143837.229155:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627452416 00000100:00100000:1.0:1746143837.229171:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16402 00000100:00100000:1.0:1746143837.229175:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3773:x1830963627452288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143837.229233:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627452288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (877us total) trans 17179873935 rc 0/0 00000100:00100000:1.0:1746143837.229238:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16402 00000100:00100000:1.0:1746143837.229246:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16404 00000100:00100000:1.0:1746143837.229249:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3771:x1830963627452928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143837.229300:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3771:x1830963627452928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (131us total) trans 21474841203 rc 0/0 00000100:00100000:1.0:1746143837.229305:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16404 00000100:00100000:0.0:1746143837.229723:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16407 00000100:00100000:0.0:1746143837.229733:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627452672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143837.229867:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143837.229869:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143837 -> 1746143837 00002000:00010000:0.0:1746143837.229871:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143836 -> 1746143836 00002000:00010000:0.0:1746143837.229873:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143837 -> 1746143837 00002000:00010000:0.0:1746143837.229874:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143837.229891:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+42:3774:x1830963627452672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (424us total) trans 21474841205 rc 0/0 00000100:00100000:0.0:1746143837.229895:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16407 00000100:00100000:0.0:1746143837.229910:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143837.229946:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093c72a00/2, rc 0, transno 17179873929 00000100:00100000:0.0:1746143837.229950:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143837.229956:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136634000/2, rc 0, transno 17179873928 00000100:00100000:0.0:1746143837.229959:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.229966:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627453056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143837.229980:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143837.229996:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627451648 00000100:00100000:0.0:1746143837.229999:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627451648 00000100:00100000:0.0:1746143837.230010:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627453056 00000100:00100000:0.0:1746143837.230012:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627453056 00000100:00100000:0.0:1746143837.230020:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16408 00000100:00100000:0.0:1746143837.230024:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3772:x1830963627451648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143837.230080:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3772:x1830963627451648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (169us total) trans 17179873936 rc 0/0 00000100:00100000:0.0:1746143837.230085:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16408 00000100:00100000:3.0:1746143837.230090:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16409 00000100:00100000:3.0:1746143837.230097:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3772:x1830963627453056:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143837.230107:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136637100/2, rc 0, transno 17179873936 00000100:00100000:0.0:1746143837.230110:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627451648:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143837.230142:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:3.0:1746143837.230144:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143837.230146:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143837.230147:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143837.230149:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143837.230171:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963627453056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (190us total) trans 21474841206 rc 0/0 00000100:00100000:3.0:1746143837.230176:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16409 00000100:00100000:3.0:1746143837.230195:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627453184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.230211:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143837.230226:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094197100/2, rc 0, transno 17179873935 00000100:00100000:3.0:1746143837.230229:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627452288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143837.230235:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143837.230238:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627453312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.230250:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143837.230264:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627453184 00000100:00100000:3.0:1746143837.230267:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627453184 00000100:00100000:3.0:1746143837.230280:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627453312 00000100:00100000:3.0:1746143837.230282:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627453312 00000100:00100000:3.0:1746143837.230290:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16410 00000100:00100000:3.0:1746143837.230294:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3773:x1830963627453184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.230346:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3773:x1830963627453184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (134us total) trans 21474841207 rc 0/0 00000100:00100000:3.0:1746143837.230351:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16410 00000100:00100000:3.0:1746143837.230360:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16411 00000100:00100000:3.0:1746143837.230364:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3773:x1830963627453312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143837.230420:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3773:x1830963627453312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (168us total) trans 21474841208 rc 0/0 00000100:00100000:3.0:1746143837.230424:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16411 00000004:00080000:3.0:1746143837.230442:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7ad80/2, rc 0, transno 21474841208 00000100:00100000:3.0:1746143837.230446:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627453312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.230452:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b100/2, rc 0, transno 21474841207 00000100:00100000:3.0:1746143837.230454:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627453184:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143837.230483:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79f80/2, rc 0, transno 21474841205 00000100:00100000:3.0:1746143837.230486:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627452672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143837.231793:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78a80/2, rc 0, transno 21474841206 00000100:00100000:0.0:1746143837.231796:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627453056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143837.232093:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.232111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.232241:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5386 00000100:00100000:3.0:1746143837.232248:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2667:x1830963624930432:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:0.0:1746143837.232260:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627452032:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143837.232269:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627452160:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143837.232296:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b4b35 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 11 pid: 7244 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746143837.232316:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.232324:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2667:x1830963624930432:12345-192.168.202.3@tcp:49:cat.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.232329:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5386 00000004:00080000:3.0:1746143837.232351:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b800/2, rc 0, transno 21474841209 00000100:00100000:3.0:1746143837.232355:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627452800:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143837.232472:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3e00, rc 0) 00000100:00100000:0.0:1746143837.232496:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2669:x1830963624929536:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 49099us (50318us total) trans 8589944992 rc 0/0 00000100:00100000:0.0:1746143837.232501:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13945 00000100:00100000:1.0:1746143837.232564:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.232729:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624930560 00000100:00100000:0.0:1746143837.232732:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624930560 00000100:00100000:0.0:1746143837.232752:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13948 00000100:00100000:0.0:1746143837.232756:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2665:x1830963624930560:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143837.232763:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.232773:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4b51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411733 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.232800:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4b51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411733 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.232810:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b4b51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411733 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.232820:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.232823:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143837.232825:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da800, rc 0) 00000100:00100000:0.0:1746143837.233006:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2665:x1830963624930560:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 247us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.233012:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13948 00000100:00100000:0.0:1746143837.242881:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.245621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.246339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.252175:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.252194:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.252218:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.252400:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624931200 00000100:00100000:3.0:1746143837.252410:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624931200 00010000:00010000:3.0:1746143837.252445:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b4a71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116c3 expref: 47 pid: 3134 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143837.252480:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624931072 00000100:00100000:3.0:1746143837.252482:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624931072 00010000:00010000:3.0:1746143837.252493:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3600/0x87925e4cb73b4b19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411709 expref: 33 pid: 12327 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143837.252508:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7987 00000100:00100000:3.0:1746143837.252514:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963624931200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.252526:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.252542:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b4a71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116c3 expref: 46 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.252551:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b4a71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116c3 expref: 46 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.252586:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012224fa00/0x87925e4cb73b4a71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116c3 expref: 46 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.252603:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.252658:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963624931200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 144us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.252664:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7987 00000100:00100000:0.0:1746143837.255854:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.255878:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.255906:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.255924:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624931584 00000100:00100000:1.0:1746143837.255935:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624931584 00000100:00100000:0.0:1746143837.255937:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624931840 00000100:00100000:0.0:1746143837.255942:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624931840 00002000:00100000:0.0:1746143837.255971:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800921cdc00 x1830963624931840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.255976:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800921cd880 x1830963624931584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.255980:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cdc00 with x1830963624931840 ext(1048576->2097151) 00002000:00100000:1.0:1746143837.255985:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd880 with x1830963624931584 ext(1048576->2097151) 00002000:00010000:0.0:1746143837.255985:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cdc00 00002000:00010000:1.0:1746143837.255990:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cd880 00000100:00100000:1.0:1746143837.257258:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624932096 00000100:00100000:1.0:1746143837.257264:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624932096 00000100:00100000:3.0:1746143837.257342:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7112 00000100:00100000:3.0:1746143837.257355:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963624931840:12345-192.168.202.3@tcp:3:multiop.0 00002000:00100000:1.0:1746143837.257620:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800921cc000 x1830963624932096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.257627:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc000 with x1830963624932096 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.257631:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc000 00000100:00100000:1.0:1746143837.257645:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7113 00000100:00100000:1.0:1746143837.257650:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963624931584:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143837.258201:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7114 00000100:00100000:1.0:1746143837.258207:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963624932096:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143837.261833:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.262024:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624932352 00000100:00100000:1.0:1746143837.262035:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624932352 00002000:00100000:1.0:1746143837.262083:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800921cd180 x1830963624932352/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.262093:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd180 with x1830963624932352 ext(0->1048575) 00002000:00010000:1.0:1746143837.262099:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cd180 00000100:00100000:1.0:1746143837.262122:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7115 00000100:00100000:1.0:1746143837.262130:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624932352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143837.265247:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.267478:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624932608 00000100:00100000:1.0:1746143837.267492:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624932608 00002000:00100000:1.0:1746143837.267546:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092b72a00 x1830963624932608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.267556:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72a00 with x1830963624932608 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.267562:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72a00 00000100:00100000:1.0:1746143837.267600:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7116 00000100:00100000:1.0:1746143837.267607:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2011:x1830963624932608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143837.275812:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.275847:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.275902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.275968:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.276417:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7118 00000100:00100000:1.0:1746143837.276429:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963624933248:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143837.276570:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+49:2009:x1830963624933248:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 144us (721us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143837.276576:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7118 00002000:00100000:1.0:1746143837.276583:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2215936->2220031) req@ffff880092b70e00 x1830963624933248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/4536 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.276591:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70e00 with x1830963624933248 ext(2215936->2220031) 00002000:00010000:1.0:1746143837.276596:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b70e00 00000100:00100000:1.0:1746143837.276615:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7119 00000100:00100000:1.0:1746143837.276620:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624933376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143837.277828:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627453824:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143837.277848:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.277871:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2008:x1830963624931072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 25344us (25652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.277878:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7988 00000100:00100000:1.0:1746143837.283475:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963624931584:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 23829us (25629us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143837.283496:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7113 00002000:00100000:1.0:1746143837.283513:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800921cd880 x1830963624931584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.283524:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd880 with x1830963624931584 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.283532:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cd880 00000100:00100000:1.0:1746143837.293521:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963624932096:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 35300us (37599us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143837.293536:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7114 00002000:00100000:1.0:1746143837.293550:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800921cc000 x1830963624932096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.293560:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc000 with x1830963624932096 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.293566:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc000 00000100:00100000:1.0:1746143837.301612:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2011:x1830963624932608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 33993us (36363us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143837.301624:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7116 00002000:00100000:1.0:1746143837.301637:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092b72a00 x1830963624932608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.301647:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72a00 with x1830963624932608 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.301654:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72a00 00000100:00100000:0.0:1746143837.306456:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.306852:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624933376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 30225us (30943us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143837.306856:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624933888 00000100:00100000:1.0:1746143837.306862:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7119 00000100:00100000:3.0:1746143837.306863:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624933888 00002000:00100000:1.0:1746143837.306871:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b70000 x1830963624933376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.306879:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70000 with x1830963624933376 ext(1048576->2097151) 00002000:00010000:1.0:1746143837.306884:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70000 00000100:00100000:3.0:1746143837.306900:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5388 00000100:00100000:3.0:1746143837.306907:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2669:x1830963624933888:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143837.307079:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2669:x1830963624933888:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 173us (3818us total) trans 8589944993 rc 0/0 00000100:00100000:3.0:1746143837.307084:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5388 00000100:00100000:0.0:1746143837.308852:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624934144 00000100:00100000:0.0:1746143837.308857:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624934144 00002000:00100000:0.0:1746143837.308888:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2330624->2334719) req@ffff8801368e9c00 x1830963624934144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.308894:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9c00 with x1830963624934144 ext(2330624->2334719) 00002000:00010000:0.0:1746143837.308898:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9c00 00000100:00100000:0.0:1746143837.308938:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7121 00000100:00100000:0.0:1746143837.308945:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963624934144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143837.309096:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963624934144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 150us (554us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143837.309102:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7121 00002000:00100000:0.0:1746143837.309106:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2330624->2334719) req@ffff8801368e9c00 x1830963624934144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/4536 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.309112:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9c00 with x1830963624934144 ext(2330624->2334719) 00002000:00010000:0.0:1746143837.309114:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9c00 00000100:00100000:0.0:1746143837.311591:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.319102:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.325807:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.339896:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.342457:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.342489:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.342514:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624935168 00000100:00100000:3.0:1746143837.342520:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624935168 00000100:00100000:0.0:1746143837.342528:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143837.342552:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2215936->2334719) req@ffff880092ef2680 x1830963624935168/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.342560:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2680 with x1830963624935168 ext(2215936->2334719) 00010000:00010000:3.0:1746143837.342566:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 45 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.342575:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 45 pid: 9586 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143837.342580:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef2680 00000100:00100000:3.0:1746143837.342593:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624935296 00000100:00100000:3.0:1746143837.342596:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624935296 00002000:00100000:3.0:1746143837.342607:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2740224->3092479) req@ffff880092ef0380 x1830963624935296/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143837.342607:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624935040 00000100:00100000:1.0:1746143837.342612:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624935040 00002000:00100000:3.0:1746143837.342614:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963624935296 ext(2740224->3092479) 00010000:00010000:3.0:1746143837.342618:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 34 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.342625:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 34 pid: 9586 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143837.342630:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef0380 00000100:00100000:1.0:1746143837.342637:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16416 00000100:00100000:3.0:1746143837.342641:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2644 00000100:00100000:1.0:1746143837.342642:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+46:2667:x1830963624935040:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143837.342646:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963624935168:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:1.0:1746143837.342652:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.342662:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411756 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.342677:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143837.342681:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.342694:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 47 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.342702:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27a00, rc 0) 00000100:00100000:1.0:1746143837.342725:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+48:2667:x1830963624935040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.342731:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16416 00000100:00100000:3.0:1746143837.342733:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2645 00000100:00100000:3.0:1746143837.342737:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2010:x1830963624935296:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143837.349871:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2010:x1830963624935168:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7216us (7410us total) trans 21474841210 rc 0/0 00000100:00100000:3.0:1746143837.349883:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2644 00002000:00100000:3.0:1746143837.349894:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2215936->2334719) req@ffff880092ef2680 x1830963624935168/t21474841210(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/448 e 0 to 0 dl 1746143848 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.349902:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2680 with x1830963624935168 ext(2215936->2334719) 00010000:00010000:3.0:1746143837.349920:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.349932:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143837.349938:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef2680 00000100:00100000:3.0:1746143837.354719:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2010:x1830963624935296:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11973us (12183us total) trans 21474841211 rc 0/0 00000100:00100000:3.0:1746143837.354731:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2645 00002000:00100000:3.0:1746143837.354741:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2740224->3092479) req@ffff880092ef0380 x1830963624935296/t21474841211(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/448 e 0 to 0 dl 1746143848 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.354750:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963624935296 ext(2740224->3092479) 00010000:00010000:3.0:1746143837.354759:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 35 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.354769:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 35 pid: 9586 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143837.354774:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef0380 00000100:00100000:0.0:1746143837.360568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.360606:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.360644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.360658:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.360685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.360711:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.361438:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1204 00000100:00100000:1.0:1746143837.361446:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963624935680:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143837.361473:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963624935680:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.361478:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1204 00000100:00100000:1.0:1746143837.361489:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1205 00000100:00100000:1.0:1746143837.361494:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2008:x1830963624935936:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143837.361512:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2008:x1830963624935936:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 18us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.361517:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1205 00000100:00100000:1.0:1746143837.361532:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624935424 00000100:00100000:1.0:1746143837.361535:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624935424 00010000:00010000:1.0:1746143837.361554:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.361571:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624936064 00000100:00100000:1.0:1746143837.361572:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624936064 00010000:00010000:1.0:1746143837.361767:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 35 pid: 9586 timeout: 996 lvb_type: 0 00000100:00100000:1.0:1746143837.361786:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7989 00000100:00100000:1.0:1746143837.361791:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963624935424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143837.361798:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143837.361815:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.361824:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.361842:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b4b5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [2215936->2334719] (req 2215936->2334719) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411741 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.361859:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143837.361873:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+47:2011:x1830963624935424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.361878:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7989 00000100:00100000:1.0:1746143837.361908:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7990 00000100:00100000:1.0:1746143837.361935:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963624936064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143837.361940:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143837.361947:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 35 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.361955:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 35 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.361965:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b4b58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->18446744073709551615] (req 2740224->3092479) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841173a expref: 35 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:1.0:1746143837.361973:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.361974:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.361980:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b4b6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841174f expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.361987:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b4b6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841174f expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.361994:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.361995:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.361998:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.362004:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.362027:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 46 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143837.362037:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627454336:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143837.362078:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b4b6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841174f expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143837.362090:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627454464:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143837.362103:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143837.367950:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627454336:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143837.367960:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627454464:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143837.367975:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143837.368009:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963624936064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6074us (7296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.368017:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7990 00000100:00100000:0.0:1746143837.373715:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.373783:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624936576 00000100:00100000:3.0:1746143837.373791:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624936576 00002000:00100000:3.0:1746143837.373828:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092ef1f80 x1830963624936576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.373836:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963624936576 ext(3145728->4194303) 00002000:00010000:3.0:1746143837.373841:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:0.0:1746143837.373848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.374173:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624936448 00000100:00100000:3.0:1746143837.374177:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624936448 00002000:00100000:3.0:1746143837.374877:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095cb6300 x1830963624936448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.374890:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6300 with x1830963624936448 ext(2097152->4194303) 00002000:00010000:3.0:1746143837.374894:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6300 00000100:00100000:3.0:1746143837.374930:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7125 00000100:00100000:3.0:1746143837.374936:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963624936448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143837.382437:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.382881:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.384835:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7127 00000100:00100000:0.0:1746143837.384844:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963624937088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143837.392172:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963624936576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17930us (18456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143837.392181:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7124 00002000:00100000:3.0:1746143837.392191:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092ef1f80 x1830963624936576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.392199:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963624936576 ext(3145728->4194303) 00002000:00010000:3.0:1746143837.392204:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:3.0:1746143837.401115:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963624936448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26169us (27257us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143837.401126:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7125 00002000:00100000:3.0:1746143837.401137:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095cb6300 x1830963624936448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.401146:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6300 with x1830963624936448 ext(2097152->4194303) 00002000:00010000:3.0:1746143837.401151:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb6300 00000100:00100000:0.0:1746143837.407219:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963624936960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23164us (24595us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143837.407231:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7126 00002000:00100000:0.0:1746143837.407241:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095cb7b80 x1830963624936960/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.407250:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7b80 with x1830963624936960 ext(2097152->4194303) 00002000:00010000:0.0:1746143837.407255:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb7b80 00000100:00100000:0.0:1746143837.408139:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963624937088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23295us (25256us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143837.408146:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7127 00002000:00100000:0.0:1746143837.408152:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb4000 x1830963624937088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.408160:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4000 with x1830963624937088 ext(3145728->4194303) 00002000:00010000:0.0:1746143837.408163:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4000 00000100:00100000:0.0:1746143837.417296:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.425894:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.440102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.440294:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624937856 00000100:00100000:3.0:1746143837.440305:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624937856 00000100:00100000:3.0:1746143837.440354:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5389 00000100:00100000:3.0:1746143837.440361:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2672:x1830963624937856:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143837.440580:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2672:x1830963624937856:12345-192.168.202.3@tcp:35:cat.0 Request processed in 219us (484us total) trans 8589944994 rc 0/0 00000100:00100000:3.0:1746143837.440587:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5389 00000100:00100000:3.0:1746143837.446002:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963624937600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19576us (20106us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143837.446013:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7129 00002000:00100000:3.0:1746143837.446023:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095cb6680 x1830963624937600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.446031:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6680 with x1830963624937600 ext(4194304->4853759) 00002000:00010000:3.0:1746143837.446036:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb6680 00000100:00100000:0.0:1746143837.453695:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.538324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.538844:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.538874:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624938624 00000100:00100000:0.0:1746143837.538877:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624938624 00000100:00100000:0.0:1746143837.538896:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13950 00000100:00100000:0.0:1746143837.538900:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2679:x1830963624938624:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143837.538934:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.538940:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b4b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411764 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.538980:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.538990:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.538999:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539009:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539014:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539019:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539746:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539757:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539762:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143837.539767:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143837.539790:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539795:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539798:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539802:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539811:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143837.539813:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.539817:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540105:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143837.540107:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143837.540110:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540115:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540129:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540133:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540137:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540140:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143837.540142:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540145:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540151:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030c00) 00010000:00010000:0.0:1746143837.540152:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143837.540153:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540157:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4b97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.540187:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b4b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.540197:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.540202:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.540205:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143837.540207:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0800, rc 0) 00000100:00100000:1.0:1746143837.540256:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2679:x1830963624938624:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1353us (1410us total) trans 8589944997 rc 0/0 00000100:00100000:1.0:1746143837.540262:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13950 00000100:00100000:0.0:1746143837.545591:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.545793:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624938880 00000100:00100000:3.0:1746143837.545802:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624938880 00000100:00100000:3.0:1746143837.545906:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5391 00000100:00100000:3.0:1746143837.545952:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2680:x1830963624938880:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143837.546512:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2680:x1830963624938880:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 560us (926us total) trans 8589944998 rc 0/0 00000100:00100000:3.0:1746143837.546519:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5391 00000100:00100000:0.0:1746143837.558111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.566442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.566485:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.566574:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624939136 00000100:00100000:3.0:1746143837.566586:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624939136 00010000:00010000:3.0:1746143837.566623:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e24de00/0x87925e4cb73b4a78 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a0 expref: 42 pid: 3134 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143837.566655:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624939264 00000100:00100000:3.0:1746143837.566658:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624939264 00010000:00010000:3.0:1746143837.566667:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116e6 expref: 30 pid: 9585 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143837.566996:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7992 00000100:00100000:3.0:1746143837.567004:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624939264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.567017:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.567035:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116e6 expref: 30 pid: 9585 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.567045:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116e6 expref: 30 pid: 9585 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143837.567049:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627454592:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143837.567061:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e24de00/0x87925e4cb73b4a78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a0 expref: 42 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.567064:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b4af6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116e6 expref: 30 pid: 9585 timeout: 996 lvb_type: 1 00000100:00100000:0.0:1746143837.567077:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627454720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143837.567082:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.567084:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.567090:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.567097:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.567180:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.567190:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3800, rc 0) 00010000:00010000:3.0:1746143837.567196:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.567207:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627454848:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143837.567220:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2679:x1830963624939008:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8887us (9115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.567228:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16417 00000100:00100000:3.0:1746143837.567272:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143837.572556:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627454848:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143837.572572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143837.572645:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143837.573002:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.573042:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624939776 00000100:00100000:0.0:1746143837.573045:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624939776 00000100:00100000:3.0:1746143837.573048:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963624939264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6044us (6562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.573057:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7992 00002000:00100000:0.0:1746143837.573075:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (323584->327679) req@ffff88009391c700 x1830963624939776/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.573084:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c700 with x1830963624939776 ext(323584->327679) 00002000:00010000:0.0:1746143837.573088:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391c700 00000100:00100000:0.0:1746143837.573099:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7130 00000100:00100000:0.0:1746143837.573103:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624939776:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143837.573223:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624939776:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 119us (220us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143837.573228:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7130 00002000:00100000:0.0:1746143837.573233:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (323584->327679) req@ffff88009391c700 x1830963624939776/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/4536 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.573239:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c700 with x1830963624939776 ext(323584->327679) 00002000:00010000:0.0:1746143837.573242:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391c700 00000100:00100000:0.0:1746143837.581585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.581689:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624940032 00000100:00100000:3.0:1746143837.581699:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624940032 00000100:00100000:3.0:1746143837.582231:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5392 00000100:00100000:3.0:1746143837.582241:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2679:x1830963624940032:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143837.582496:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2679:x1830963624940032:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 256us (920us total) trans 8589945000 rc 0/0 00000100:00100000:3.0:1746143837.582502:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5392 00000100:00100000:0.0:1746143837.584377:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.586446:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.586526:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624940288 00000100:00100000:3.0:1746143837.586533:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624940288 00000100:00100000:3.0:1746143837.586594:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 981 00000100:00100000:3.0:1746143837.586602:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+268:2009:x1830963624940288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.586614:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.586640:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087c00/0x87925e4cb73b4bdd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411772 expref: 268 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.586660:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.586665:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.586889:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+267:2009:x1830963624940288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 288us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.586897:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 981 00000100:00100000:0.0:1746143837.601668:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.607752:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.607821:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624940544 00000100:00100000:3.0:1746143837.607827:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624940544 00002000:00100000:3.0:1746143837.607855:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (172032->327679) req@ffff88009391df80 x1830963624940544/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.607863:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963624940544 ext(172032->327679) 00010000:00010000:3.0:1746143837.607868:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 28 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.607877:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 28 pid: 3134 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143837.607883:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391df80 00000100:00100000:3.0:1746143837.607894:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2646 00000100:00100000:3.0:1746143837.607899:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963624940544:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143837.616297:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2011:x1830963624940544:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8389us (8537us total) trans 17179873937 rc 0/0 00000100:00100000:3.0:1746143837.616308:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2646 00002000:00100000:3.0:1746143837.616319:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (172032->327679) req@ffff88009391df80 x1830963624940544/t17179873937(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/448 e 0 to 0 dl 1746143848 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.616328:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963624940544 ext(172032->327679) 00010000:00010000:3.0:1746143837.616337:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.616349:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00002000:00010000:3.0:1746143837.616356:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391df80 00000100:00100000:0.0:1746143837.627245:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.627734:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624940672 00000100:00100000:3.0:1746143837.627744:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624940672 00010000:00010000:3.0:1746143837.627782:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00000100:00100000:3.0:1746143837.627836:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7993 00000100:00100000:3.0:1746143837.627845:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963624940672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.627861:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.627881:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.627893:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.627969:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3800/0x87925e4cb73b4bc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 172032->327679) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841176b expref: 30 pid: 3134 timeout: 996 lvb_type: 0 00010000:00010000:3.0:1746143837.627997:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.628000:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.628007:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73b4bf2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411780 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.628015:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73b4bf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411780 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.628055:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73b4bf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411780 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.628073:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627455232:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143837.628187:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143837.640101:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627455232:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143837.640128:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.640188:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963624940672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12342us (12951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.640199:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7993 00000100:00100000:1.0:1746143837.641336:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.641466:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624940928 00000100:00100000:3.0:1746143837.641476:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624940928 00002000:00100000:3.0:1746143837.641513:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880135b09880 x1830963624940928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.641521:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963624940928 ext(0->1048575) 00002000:00010000:3.0:1746143837.641525:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:3.0:1746143837.641834:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7131 00000100:00100000:3.0:1746143837.641843:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624940928:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143837.655587:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624940928:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13737us (14243us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143837.655599:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7131 00002000:00100000:3.0:1746143837.655607:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880135b09880 x1830963624940928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.655616:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963624940928 ext(0->1048575) 00002000:00010000:3.0:1746143837.655620:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:0.0:1746143837.672437:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.696058:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.716138:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.716192:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.716252:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627455360:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143837.716260:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627455488:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143837.716284:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2613248->3145727] (req 2613248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 48 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.716298:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523200, rc 0) 00000100:00100000:0.0:1746143837.716342:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+48:2680:x1830963624941056:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 41502us (43912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.716352:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16420 00000100:00100000:0.0:1746143837.716400:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624941440 00000100:00100000:0.0:1746143837.716405:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624941440 00010000:00010000:0.0:1746143837.716424:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00000100:00100000:0.0:1746143837.716441:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7994 00000100:00100000:0.0:1746143837.716445:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963624941440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143837.716455:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143837.716470:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.716477:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.716496:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27a00/0x87925e4cb73b4b74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411756 expref: 48 pid: 9586 timeout: 996 lvb_type: 0 00010000:00010000:0.0:1746143837.716509:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143837.716533:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963624941440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 88us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.716538:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7994 00000100:00100000:3.0:1746143837.716670:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624941696 00000100:00100000:3.0:1746143837.716675:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624941696 00000100:00100000:3.0:1746143837.716703:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13952 00000100:00100000:3.0:1746143837.716708:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2688:x1830963624941696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143837.716725:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143837.716737:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73b4c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841178e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.716791:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716801:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716809:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716820:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716825:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716829:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716905:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b4c15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716934:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.716941:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143837.716951:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143837.717007:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717012:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717017:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717021:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717025:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011de82600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143837.717028:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717033:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717039:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143837.717041:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143837.717044:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717048:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b4c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717073:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717078:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717084:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717087:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143837.717089:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717093:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717097:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65e00) 00010000:00010000:3.0:1746143837.717099:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143837.717101:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717104:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b4c0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143837.717132:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82400/0x87925e4cb73b4c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841178e expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.717139:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841178e expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.717144:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.717145:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143837.717147:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a9c00, rc 0) 00000100:00100000:3.0:1746143837.723127:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2688:x1830963624941696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6409us (6989us total) trans 8589945002 rc 0/0 00000100:00100000:3.0:1746143837.723137:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13952 00000100:00100000:0.0:1746143837.728201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.730046:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.730064:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.730079:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624941952 00000100:00100000:1.0:1746143837.730082:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624941952 00000100:00100000:1.0:1746143837.730101:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624942080 00000100:00100000:1.0:1746143837.730103:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624942080 00000100:00100000:1.0:1746143837.730113:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16421 00000100:00100000:1.0:1746143837.730118:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2009:x1830963624941952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143837.730131:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.730141:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b4c23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411795 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.730154:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.730156:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.730162:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b4c23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411795 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.730173:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27600/0x87925e4cb73b4c23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411795 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.730180:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27600, rc 0) 00000100:00100000:1.0:1746143837.730214:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624941952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.730219:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16421 00000100:00100000:1.0:1746143837.730231:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16422 00000100:00100000:1.0:1746143837.730235:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963624942080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143837.730241:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.730247:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73b4c2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841179c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.730255:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.730261:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73b4c2a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841179c expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.730267:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27e00/0x87925e4cb73b4c2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841179c expref: 35 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.730277:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27e00, rc 0) 00000100:00100000:1.0:1746143837.730291:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963624942080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 55us (226us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143837.730296:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16422 00000100:00100000:1.0:1746143837.730346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.730833:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624942208 00000100:00100000:3.0:1746143837.730837:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624942208 00000100:00100000:3.0:1746143837.730861:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 982 00000100:00100000:3.0:1746143837.730865:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963624942208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.730872:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.730884:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b4c15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841178e expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.730897:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.730901:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.730933:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963624942208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.730938:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 982 00000100:00100000:0.0:1746143837.736078:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.736170:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624942464 00000100:00100000:3.0:1746143837.736176:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624942464 00002000:00100000:3.0:1746143837.736209:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2613248->2617343) req@ffff880136aca300 x1830963624942464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.736216:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136aca300 with x1830963624942464 ext(2613248->2617343) 00002000:00010000:3.0:1746143837.736220:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136aca300 00000100:00100000:3.0:1746143837.736233:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7132 00000100:00100000:3.0:1746143837.736239:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963624942464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143837.736336:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963624942464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 92us (262us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143837.736342:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7132 00002000:00100000:3.0:1746143837.736347:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2613248->2617343) req@ffff880136aca300 x1830963624942464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/4536 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.736359:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136aca300 with x1830963624942464 ext(2613248->2617343) 00002000:00010000:3.0:1746143837.736361:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136aca300 00000100:00100000:0.0:1746143837.742199:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.742306:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624942720 00000100:00100000:3.0:1746143837.742314:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624942720 00002000:00100000:3.0:1746143837.742348:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880136ac8380 x1830963624942720/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.742357:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8380 with x1830963624942720 ext(0->1048575) 00002000:00010000:3.0:1746143837.742361:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8380 00000100:00100000:3.0:1746143837.742398:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7133 00000100:00100000:3.0:1746143837.742404:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624942720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143837.756191:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.756838:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624942720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14431us (14643us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143837.756849:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7133 00002000:00100000:3.0:1746143837.756859:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880136ac8380 x1830963624942720/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.756867:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8380 with x1830963624942720 ext(0->1048575) 00002000:00010000:3.0:1746143837.756872:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8380 00000100:00100000:0.0:1746143837.780010:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.782636:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.782690:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624943232 00000100:00100000:3.0:1746143837.782695:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624943232 00010000:00010000:3.0:1746143837.782715:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b4a8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116bc expref: 43 pid: 3134 timeout: 996 lvb_type: 1 00000100:00100000:3.0:1746143837.782740:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7997 00000100:00100000:3.0:1746143837.782745:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963624943232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.782754:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.782764:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b4a8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116bc expref: 43 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.782773:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b4a8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116bc expref: 43 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.782785:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b4a8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116bc expref: 43 pid: 3134 timeout: 996 lvb_type: 1 00010000:00010000:3.0:1746143837.782796:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.782797:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.782802:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.782809:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.782834:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 42 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.782842:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627456000:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143837.782896:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.791377:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.793086:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627456000:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143837.793106:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143837.793195:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.793430:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963624943232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10682us (10794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.793439:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7997 00000100:00100000:0.0:1746143837.794985:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16425 00000100:00100000:0.0:1746143837.794991:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963624943360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.794998:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.795005:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117b1 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143837.795027:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627456256:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143837.795045:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.798560:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.798860:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624943616 00000100:00100000:3.0:1746143837.798866:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624943616 00002000:00100000:3.0:1746143837.798896:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3432448->3436543) req@ffff880095c3b100 x1830963624943616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.798904:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963624943616 ext(3432448->3436543) 00002000:00010000:3.0:1746143837.798908:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:3.0:1746143837.798936:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7134 00000100:00100000:3.0:1746143837.798941:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963624943616:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143837.799032:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963624943616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 90us (480us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143837.799037:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7134 00002000:00100000:3.0:1746143837.799042:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3432448->3436543) req@ffff880095c3b100 x1830963624943616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/4536 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.799048:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963624943616 ext(3432448->3436543) 00002000:00010000:3.0:1746143837.799051:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c3b100 00002000:00010000:1.0:1746143837.799158:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143837 -> 1746143838 00002000:00010000:1.0:1746143837.799162:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143837 -> 1746143838 00002000:00010000:1.0:1746143837.799163:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143837 -> 1746143838 00000100:00100000:1.0:1746143837.799172:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627456256:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143837.799188:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c3f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b1 expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.799197:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b1 expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.799208:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1e00, rc 0) 00000100:00100000:1.0:1746143837.799223:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963624943360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4233us (6030us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143837.799228:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16425 00000100:00100000:0.0:1746143837.805223:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.805671:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624943744 00000100:00100000:1.0:1746143837.805679:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624943744 00000100:00100000:1.0:1746143837.805723:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16426 00000100:00100000:1.0:1746143837.805731:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2688:x1830963624943744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143837.805746:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.805760:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117b8 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.805785:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.805793:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143837.805794:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143837.805798:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.805824:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.805835:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 41 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143837.805846:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627456384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143837.805961:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.810499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.811358:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627456384:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143837.811390:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.811402:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26200, rc 0) 00000100:00100000:1.0:1746143837.811427:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2688:x1830963624943744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5697us (6211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143837.811433:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16426 00000100:00100000:0.0:1746143837.830464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.830527:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624944000 00000100:00100000:3.0:1746143837.830536:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624944000 00010000:00010000:3.0:1746143837.830572:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 44 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143837.830607:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7998 00000100:00100000:3.0:1746143837.830614:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963624944000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.830626:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.830643:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 44 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.830653:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 44 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.830671:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b4c31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117a3 expref: 44 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.830694:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.830696:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.830702:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.830709:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.830736:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.830747:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627456512:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143837.830819:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.839500:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.841309:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.841333:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624944256 00000100:00100000:0.0:1746143837.841340:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624944256 00000100:00100000:0.0:1746143837.841390:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624944512 00000100:00100000:0.0:1746143837.841392:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624944512 00000100:00100000:0.0:1746143837.841408:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13953 00000100:00100000:0.0:1746143837.841416:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2692:x1830963624944256:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143837.841437:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.841452:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4c4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117bf expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.841518:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841529:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841540:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841550:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841556:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841561:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841637:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b4c62 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841646:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b4c62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841651:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b4c62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143837.841659:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143837.841716:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841722:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841730:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841735:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841740:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143837.841743:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841749:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841758:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143837.841761:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143837.841764:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841768:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b4c54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841782:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841787:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841791:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841795:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143837.841797:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841805:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841810:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030c00) 00010000:00010000:0.0:1746143837.841812:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143837.841814:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841819:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b4c5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.841847:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0c00/0x87925e4cb73b4c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117bf expref: 18 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.841857:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b4c62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117bf expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.841863:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.841865:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143837.841867:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0a00, rc 0) 00000100:00100000:0.0:1746143837.841904:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2692:x1830963624944256:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 488us (2409us total) trans 8589945003 rc 0/0 00000100:00100000:0.0:1746143837.841935:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13953 00000100:00100000:0.0:1746143837.841950:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13954 00000100:00100000:0.0:1746143837.841956:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+268:2696:x1830963624944512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143837.841965:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143837.841971:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b4c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117c6 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.842000:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842006:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842012:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842019:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842023:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842028:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143837.842033:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627456512:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143837.842048:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143837.842056:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4c85 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842062:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143837.842067:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963624944000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11454us (11610us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143837.842067:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143837.842073:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000100:00100000:3.0:1746143837.842074:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7998 00010000:00010000:0.0:1746143837.842100:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842105:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842112:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842116:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842120:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143837.842122:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842126:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842132:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143837.842134:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143837.842136:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842140:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b4c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842146:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842149:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842153:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842156:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143837.842158:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842164:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842168:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030000) 00010000:00010000:0.0:1746143837.842170:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143837.842171:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143837.842176:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b4c7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143837.842189:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.842259:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624944768 00000100:00100000:3.0:1746143837.842263:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624944768 00002000:00100000:3.0:1746143837.842284:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012b1daa00 x1830963624944768/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.842292:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963624944768 ext(2097152->3145727) 00002000:00010000:3.0:1746143837.842296:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1daa00 00000100:00100000:3.0:1746143837.842309:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7135 00000100:00100000:3.0:1746143837.842314:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624944768:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:0.0:1746143837.844523:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b4c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117c6 expref: 271 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.844534:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4c85 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117c6 expref: 270 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.844542:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.844544:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143837.844547:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1000, rc 0) 00000100:00100000:0.0:1746143837.844589:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+270:2696:x1830963624944512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2632us (3284us total) trans 8589945004 rc 0/0 00000100:00100000:0.0:1746143837.844595:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13954 00000100:00100000:0.0:1746143837.850701:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.851282:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.852083:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624944896 00000100:00100000:3.0:1746143837.852089:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624944896 00000100:00100000:0.0:1746143837.854771:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.855383:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945024 00000100:00100000:1.0:1746143837.855392:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945024 00000100:00100000:1.0:1746143837.855468:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16427 00000100:00100000:3.0:1746143837.855469:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 983 00000100:00100000:1.0:1746143837.855475:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2692:x1830963624945024:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:3.0:1746143837.855477:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963624944896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143837.855487:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143837.855496:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945152 00000100:00100000:3.0:1746143837.855499:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945152 00010000:00010000:1.0:1746143837.855502:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117cd expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.855513:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16428 00000100:00100000:3.0:1746143837.855517:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963624945152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143837.855522:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.855524:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b4a86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116b5 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143837.855527:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117d4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.855532:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 31 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143837.855537:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.855537:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.855538:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143837.855538:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143837.855540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143837.855541:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1576960->1728511] (req 1576960->1728511) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.855543:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117d4 expref: 44 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143837.855554:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117d4 expref: 44 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143837.855556:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945280 00000100:00100000:0.0:1746143837.855559:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945280 00010000:00010000:3.0:1746143837.855562:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fe00, rc 0) 00010000:00010000:1.0:1746143837.855564:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 31 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.855573:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 31 pid: 12327 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143837.855579:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 984 00000100:00100000:1.0:1746143837.855583:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627456640:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143837.855584:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:2010:x1830963624945280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143837.855590:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143837.855594:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963624945152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 76us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.855598:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16428 00010000:00010000:0.0:1746143837.855605:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b4c85 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117c6 expref: 270 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.855614:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143837.855617:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143837.855621:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143837.855635:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:2010:x1830963624945280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.855639:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 984 00010000:00010000:3.0:1746143837.855652:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b4c62 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117bf expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.855670:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143837.855673:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.855689:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963624944896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 214us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.855694:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 983 00010000:00010000:1.0:1746143837.856121:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b4a86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116b5 expref: 43 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143837.856137:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b4a86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116b5 expref: 43 pid: 13436 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143837.856151:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627456768:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143837.857050:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.861794:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627456640:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143837.861858:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945408 00000100:00100000:1.0:1746143837.861863:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945408 00000100:00100000:1.0:1746143837.861905:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16429 00000100:00100000:1.0:1746143837.861931:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2688:x1830963624945408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143837.861944:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143837.861957:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b4ca1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117db expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.861982:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 46 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.861989:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143837.861990:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143837.861993:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b4ca1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117db expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.862016:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 46 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143837.862025:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 46 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143837.862035:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627456896:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143837.862102:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.866896:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.868286:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945536 00000100:00100000:3.0:1746143837.868296:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945536 00010000:00010000:3.0:1746143837.868330:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 32 pid: 12327 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746143837.868357:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7999 00000100:00100000:3.0:1746143837.868363:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2009:x1830963624945536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.868386:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143837.868402:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 32 pid: 12327 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143837.868412:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 32 pid: 12327 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143837.868431:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3000/0x87925e4cb73b4b12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116fb expref: 32 pid: 12327 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143837.868726:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.868770:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627456768:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143837.868792:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1576960->1728511] (req 1576960->1728511) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143837.868803:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27200, rc 0) 00010000:00010000:3.0:1746143837.869109:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143837.869419:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2692:x1830963624945024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13943us (18136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143837.869426:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16427 00000100:00100000:3.0:1746143837.869576:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624945536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1212us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.869582:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7999 00000100:00100000:3.0:1746143837.869636:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945792 00000100:00100000:3.0:1746143837.869640:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945792 00002000:00100000:3.0:1746143837.869660:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2613248->3145727) req@ffff880135b08000 x1830963624945792/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.869668:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08000 with x1830963624945792 ext(2613248->3145727) 00010000:00010000:3.0:1746143837.869673:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 47 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.869682:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 47 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143837.869688:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b08000 00000100:00100000:3.0:1746143837.869697:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2648 00000100:00100000:1.0:1746143837.870076:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.870829:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963624945792:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143837.877269:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.878489:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624945920 00000100:00100000:3.0:1746143837.878494:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624945920 00000100:00100000:3.0:1746143837.878516:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16430 00000100:00100000:3.0:1746143837.878521:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+43:2696:x1830963624945920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143837.878529:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143837.878541:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117e2 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.878561:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.878567:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143837.878569:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143837.878572:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 44 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.878593:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.878602:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 29 pid: 13436 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143837.878612:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627457152:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143837.878666:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143837.884895:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+49:2008:x1830963624945792:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15192us (16168us total) trans 21474841212 rc 0/0 00000100:00100000:3.0:1746143837.884902:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2648 00002000:00100000:3.0:1746143837.884930:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2613248->3145727) req@ffff880135b08000 x1830963624945792/t21474841212(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/448 e 0 to 0 dl 1746143848 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.884938:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08000 with x1830963624945792 ext(2613248->3145727) 00010000:00010000:3.0:1746143837.884946:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 49 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.884956:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b4bf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2613248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411787 expref: 49 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143837.884962:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b08000 00000100:00100000:3.0:1746143837.885935:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624946432 00000100:00100000:3.0:1746143837.885941:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624946432 00002000:00100000:3.0:1746143837.885968:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1724416->1728511) req@ffff8801368ead80 x1830963624946432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.885976:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ead80 with x1830963624946432 ext(1724416->1728511) 00010000:00010000:3.0:1746143837.885982:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 30 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.885990:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 30 pid: 13436 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143837.885996:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ead80 00000100:00100000:3.0:1746143837.886020:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2649 00000100:00100000:3.0:1746143837.886026:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624946432:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143837.886118:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963624946432:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 92us (638us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143837.886123:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2649 00002000:00100000:3.0:1746143837.886128:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1724416->1728511) req@ffff8801368ead80 x1830963624946432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/4536 e 0 to 0 dl 1746143848 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143837.886140:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ead80 with x1830963624946432 ext(1724416->1728511) 00010000:00010000:3.0:1746143837.886144:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 30 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.886151:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 30 pid: 13436 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143837.886156:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ead80 00000001:00080000:0.0:1746143837.887081:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841212 is committed 00000001:00080000:0.0:1746143837.887090:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841211 is committed 00000001:00080000:0.0:1746143837.887099:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841209 is committed 00000100:00100000:0.0:1746143837.888647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.890019:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.891031:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.892143:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627457280:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143837.892159:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.892194:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963624946560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3056us (3551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.892201:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8001 00000100:00100000:1.0:1746143837.898665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.898718:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.899004:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2010:x1830963624946816:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8521us (8985us total) trans 17179873939 rc 0/0 00000100:00100000:0.0:1746143837.899013:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2650 00002000:00100000:0.0:1746143837.899019:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1576960->1728511) req@ffff88011e30aa00 x1830963624946816/t17179873939(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:233/0 lens 488/448 e 0 to 0 dl 1746143848 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.899025:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30aa00 with x1830963624946816 ext(1576960->1728511) 00010000:00010000:0.0:1746143837.899031:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 33 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143837.899043:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 33 pid: 13436 timeout: 997 lvb_type: 0 00002000:00010000:0.0:1746143837.899049:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e30aa00 00000100:00100000:0.0:1746143837.899062:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7138 00000100:00100000:0.0:1746143837.899065:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624947584:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143837.908348:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.909974:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624947712 00000100:00100000:3.0:1746143837.909982:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624947712 00010000:00010000:3.0:1746143837.910011:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 9 pid: 13436 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143837.910035:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8002 00000100:00100000:3.0:1746143837.910042:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2010:x1830963624947712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143837.910052:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143837.910064:0:12362:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143837 -> 1746143838 00002000:00010000:3.0:1746143837.910066:0:12362:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143837 -> 1746143838 00010000:00010000:3.0:1746143837.910070:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 9 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.910083:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 9 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.910102:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27200/0x87925e4cb73b4c93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1728511) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117cd expref: 9 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143837.910117:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.910120:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143837.910125:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.910133:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143837.910175:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143837.910184:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627457408:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143837.910543:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143837.913851:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.914281:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627457408:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143837.914300:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143837.915553:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624947712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5508us (7208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143837.915560:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8002 00000100:00100000:0.0:1746143837.931793:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.945388:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.949551:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.949574:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624948864 00000100:00100000:0.0:1746143837.949581:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624948864 00002000:00100000:0.0:1746143837.949616:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88011e308000 x1830963624948864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/0 e 0 to 0 dl 1746143848 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143837.949629:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308000 with x1830963624948864 ext(2097152->3145727) 00002000:00010000:0.0:1746143837.949634:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308000 00000100:00100000:1.0:1746143837.951255:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7141 00000100:00100000:1.0:1746143837.951263:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963624948864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143837.963717:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.963747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143837.963826:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963624948864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12564us (14283us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143837.963832:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7141 00002000:00100000:1.0:1746143837.963837:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88011e308000 x1830963624948864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143837.963843:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308000 with x1830963624948864 ext(2097152->3145727) 00002000:00010000:1.0:1746143837.963846:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308000 00000100:00100000:0.0:1746143837.963935:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624949248 00000100:00100000:0.0:1746143837.963942:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624949248 00000100:00100000:0.0:1746143837.963969:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5395 00000100:00100000:0.0:1746143837.963974:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:2699:x1830963624949248:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143837.964101:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:2699:x1830963624949248:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 126us (385us total) trans 8589945007 rc 0/0 00000100:00100000:0.0:1746143837.964106:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5395 00000100:00100000:0.0:1746143837.970420:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.973766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.993433:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143837.993985:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143837.999197:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7143 00000100:00100000:3.0:1746143837.999221:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963624950144:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143838.021121:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963624950144:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21900us (27129us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143838.021132:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7143 00002000:00100000:3.0:1746143838.021142:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88011e309180 x1830963624950144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:233/0 lens 488/440 e 0 to 0 dl 1746143848 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.021150:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309180 with x1830963624950144 ext(2097152->4194303) 00002000:00010000:3.0:1746143838.021155:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e309180 00000100:00100000:0.0:1746143838.043665:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.043733:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624950656 00000100:00100000:3.0:1746143838.043741:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624950656 00002000:00100000:3.0:1746143838.043779:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88011e30a300 x1830963624950656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.043788:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a300 with x1830963624950656 ext(4194304->4853759) 00002000:00010000:3.0:1746143838.043792:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30a300 00000100:00100000:3.0:1746143838.043826:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7144 00000100:00100000:3.0:1746143838.043833:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963624950656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143838.046065:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624950400 00000100:00100000:3.0:1746143838.046073:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624950400 00000100:00100000:3.0:1746143838.046345:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13956 00000100:00100000:3.0:1746143838.046353:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2702:x1830963624950400:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143838.047575:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.047595:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73b4ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484117fe expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.047656:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047666:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047675:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047686:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047690:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047694:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047770:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512000/0x87925e4cb73b4cf5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047778:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124512000/0x87925e4cb73b4cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047783:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124512000/0x87925e4cb73b4cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143838.047790:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143838.047845:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047851:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047856:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047861:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047866:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ee00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.047869:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047875:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047884:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143838.047887:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143838.047890:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047894:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047944:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047949:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047953:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047957:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408fc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.047959:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047964:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047970:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b530ac00) 00010000:00010000:3.0:1746143838.047972:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143838.047975:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.047979:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4cee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.048010:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fe00/0x87925e4cb73b4ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117fe expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.048019:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512000/0x87925e4cb73b4cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117fe expref: 20 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.048025:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.048026:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143838.048028:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512000, rc 0) 00000100:00100000:3.0:1746143838.048079:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2702:x1830963624950400:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1726us (2536us total) trans 8589945009 rc 0/0 00000100:00100000:3.0:1746143838.048086:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13956 00000100:00100000:3.0:1746143838.049794:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963624950656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5959us (6134us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143838.049802:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7144 00002000:00100000:3.0:1746143838.049811:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88011e30a300 x1830963624950656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.049820:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a300 with x1830963624950656 ext(4194304->4853759) 00002000:00010000:3.0:1746143838.049824:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30a300 00000100:00100000:0.0:1746143838.054743:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.068313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.112544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.118573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.119426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.119442:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624951424 00000100:00100000:0.0:1746143838.119447:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624951424 00010000:00010000:0.0:1746143838.119475:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b4ca1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117db expref: 8 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746143838.119493:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8004 00000100:00100000:0.0:1746143838.119497:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624951424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143838.119503:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143838.119510:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b4ca1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117db expref: 8 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143838.119517:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b4ca1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117db expref: 8 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143838.119527:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27800/0x87925e4cb73b4ca1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117db expref: 8 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143838.119538:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143838.119539:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143838.119545:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.119551:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746143838.119821:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746143838.120009:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 22 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143838.120021:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627457792:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143838.120157:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.122682:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627457792:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143838.122700:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.122732:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624951424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3233us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.122741:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8004 00000100:00100000:0.0:1746143838.123730:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.123788:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624951680 00000100:00100000:3.0:1746143838.123794:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624951680 00002000:00100000:3.0:1746143838.123824:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2826240->2830335) req@ffff880087df7800 x1830963624951680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.123833:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7800 with x1830963624951680 ext(2826240->2830335) 00002000:00010000:3.0:1746143838.123837:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087df7800 00000100:00100000:3.0:1746143838.123863:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7145 00000100:00100000:3.0:1746143838.123868:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963624951680:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143838.123973:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963624951680:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 105us (245us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143838.123978:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7145 00002000:00100000:3.0:1746143838.123982:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2826240->2830335) req@ffff880087df7800 x1830963624951680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.123989:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7800 with x1830963624951680 ext(2826240->2830335) 00002000:00010000:3.0:1746143838.123991:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087df7800 00000100:00100000:0.0:1746143838.129264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.137322:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.137372:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.137617:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624952064 00000100:00100000:3.0:1746143838.137623:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624952064 00010000:00010000:3.0:1746143838.137648:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117d4 expref: 25 pid: 3135 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746143838.137668:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624951936 00000100:00100000:3.0:1746143838.137670:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624951936 00010000:00010000:3.0:1746143838.137698:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 8 pid: 13436 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.137719:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8005 00000100:00100000:3.0:1746143838.137726:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624952064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.137736:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.137754:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117d4 expref: 25 pid: 3135 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.137762:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117d4 expref: 25 pid: 3135 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.137780:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fe00/0x87925e4cb73b4c9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117d4 expref: 25 pid: 3135 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.137793:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.137812:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963624952064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.137814:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8006 00000100:00100000:3.0:1746143838.137819:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8005 00000100:00100000:1.0:1746143838.137823:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624951936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.137832:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.137842:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 8 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.137851:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 8 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.137863:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b4c46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117b8 expref: 8 pid: 13436 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.137876:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.137878:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.137884:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.137891:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.137938:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.137949:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627458176:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143838.138004:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.145711:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627458176:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143838.145732:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.145784:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624951936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7962us (8419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.145795:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8006 00000100:00100000:0.0:1746143838.146085:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.166842:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.174459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.175250:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.175519:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8008 00000100:00100000:3.0:1746143838.175527:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624952576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.175535:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.175544:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73b4bf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411780 expref: 24 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.175551:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73b4bf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411780 expref: 24 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.175561:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087400/0x87925e4cb73b4bf2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411780 expref: 24 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.175574:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.175576:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.175582:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.175589:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.175614:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.175625:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627458560:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.175681:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.175798:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8007 00000100:00100000:2.0:1746143838.179838:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.179884:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624952960 00000100:00100000:0.0:1746143838.179892:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624952960 00002000:00100000:0.0:1746143838.179948:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->741375) req@ffff8801368ebb80 x1830963624952960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143838.179956:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963624952960 ext(737280->741375) 00002000:00010000:0.0:1746143838.179960:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ebb80 00000100:00100000:0.0:1746143838.179988:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7147 00000100:00100000:0.0:1746143838.179995:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624952960:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143838.180102:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624952960:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 107us (270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143838.180108:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7147 00002000:00100000:0.0:1746143838.180113:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->741375) req@ffff8801368ebb80 x1830963624952960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143838.180119:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963624952960 ext(737280->741375) 00002000:00010000:0.0:1746143838.180122:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ebb80 00000100:00100000:3.0:1746143838.180395:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627458560:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143838.180410:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.180440:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963624952576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4915us (5191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.180447:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8008 00000100:00100000:0.0:1746143838.189016:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.189143:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624953088 00000100:00100000:2.0:1746143838.189151:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624953088 00000100:00100000:2.0:1746143838.190302:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16436 00000100:00100000:2.0:1746143838.190312:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2702:x1830963624953088:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143838.190328:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.190344:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841181a expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.190380:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.190388:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.190393:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.190395:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.190397:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 8 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.190424:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.190435:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 8 pid: 12327 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.190445:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627458688:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.191186:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.191196:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 22 pid: 13436 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.191203:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627458816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.191224:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.198793:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.198835:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.198904:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624953216 00000100:00100000:3.0:1746143838.198924:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624953216 00010000:00010000:3.0:1746143838.198954:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 9 pid: 12327 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.199014:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627458688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.199022:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627458816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.199045:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1048576->1658879] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.199059:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b4c00, rc 0) 00000100:00100000:2.0:1746143838.199096:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2702:x1830963624953088:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8785us (10087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.199104:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16436 00000100:00100000:0.0:1746143838.199285:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624953344 00000100:00100000:0.0:1746143838.199289:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624953344 00010000:00010000:0.0:1746143838.199303:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 23 pid: 13436 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143838.199333:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8009 00000100:00100000:0.0:1746143838.199339:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963624953344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143838.199349:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143838.199372:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 23 pid: 13436 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143838.199382:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 23 pid: 13436 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143838.199402:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3200/0x87925e4cb73b4a6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116a7 expref: 23 pid: 13436 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143838.199416:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143838.199433:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2010:x1830963624953344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143838.199438:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8009 00000100:00100000:3.0:1746143838.199892:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8010 00000100:00100000:3.0:1746143838.199898:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2011:x1830963624953216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.199906:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.199931:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 8 pid: 12327 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.199944:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 8 pid: 12327 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.199956:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b4b0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ed expref: 8 pid: 12327 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.199968:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.199970:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.199976:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.199983:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.200009:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 7 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.200019:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627458944:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.200064:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.202724:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.204497:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624953600 00000100:00100000:3.0:1746143838.204506:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624953600 00000100:00100000:3.0:1746143838.204561:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13957 00000100:00100000:3.0:1746143838.204572:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2710:x1830963624953600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.204592:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.204609:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4d1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411821 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.204674:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204684:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204692:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204702:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204707:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204711:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204780:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4d34 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204787:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4d34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204792:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4d34 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143838.204798:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143838.204849:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204854:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204862:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204867:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204872:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ee00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.204874:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204879:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204886:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143838.204888:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143838.204891:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204895:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b4d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204903:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204907:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204925:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204928:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.204930:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204937:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204942:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e624100) 00010000:00010000:3.0:1746143838.204944:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143838.204946:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204949:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4d2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.204976:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fc00/0x87925e4cb73b4d1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411821 expref: 22 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.204984:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4d34 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411821 expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.204989:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.204990:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143838.204992:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fa00, rc 0) 00000100:00100000:2.0:1746143838.206964:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627458944:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143838.208446:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.208499:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963624953216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8598us (9711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.208510:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8010 00000100:00100000:3.0:1746143838.209593:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2710:x1830963624953600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5018us (6870us total) trans 8589945011 rc 0/0 00000100:00100000:3.0:1746143838.209601:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13957 00000100:00100000:0.0:1746143838.209648:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.209653:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.209666:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.209676:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624953856 00000100:00100000:3.0:1746143838.209682:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624953856 00000100:00100000:0.0:1746143838.209686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.209710:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13958 00000100:00100000:3.0:1746143838.209715:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:2709:x1830963624953856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.209736:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.209751:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b4d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411828 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.209810:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209820:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209829:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209840:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209844:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209849:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209942:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b4d57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209950:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b4d57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.209956:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b4d57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143838.209964:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143838.210022:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210032:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210037:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210042:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210046:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082ea0200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.210050:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210056:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210064:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143838.210067:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143838.210070:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210074:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea0200/0x87925e4cb73b4d49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210084:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210088:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210092:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210096:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.210099:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210103:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210108:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e624800) 00010000:00010000:3.0:1746143838.210110:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143838.210112:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143838.210115:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b4d50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746143838.210117:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624953984 00000100:00100000:1.0:1746143838.210121:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624953984 00000100:00100000:1.0:1746143838.210141:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624954112 00000100:00100000:1.0:1746143838.210143:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624954112 00010000:00010000:3.0:1746143838.210145:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082ea1200/0x87925e4cb73b4d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411828 expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.210155:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b4d57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411828 expref: 274 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.210155:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16437 00010000:00010000:3.0:1746143838.210160:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:1.0:1746143838.210160:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624953984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.210162:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143838.210164:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512200, rc 0) 00010000:00010000:1.0:1746143838.210167:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.210176:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4d65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841182f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.210187:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:2709:x1830963624953856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 473us (534us total) trans 8589945012 rc 0/0 00000100:00100000:3.0:1746143838.210192:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13958 00000100:00100000:1.0:1746143838.210209:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627459072:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143838.210211:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16438 00000100:00100000:3.0:1746143838.210216:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624954112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.210222:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.210230:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513a00/0x87925e4cb73b4d6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411836 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.210250:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627459200:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143838.210258:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143838.210267:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.210310:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624954240 00000100:00100000:1.0:1746143838.210314:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624954240 00000100:00100000:1.0:1746143838.210336:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 987 00000100:00100000:1.0:1746143838.210340:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963624954240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.210347:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.210357:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4d34 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411821 expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.210378:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143838.210380:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.210396:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963624954240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.210401:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 987 00000100:00100000:0.0:1746143838.214591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.214619:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.214682:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624954496 00000100:00100000:2.0:1746143838.214689:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624954496 00000100:00100000:0.0:1746143838.214696:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.214721:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624954368 00000100:00100000:2.0:1746143838.214723:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624954368 00000100:00100000:2.0:1746143838.214743:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16439 00000100:00100000:2.0:1746143838.214750:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963624954496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143838.214764:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143838.214926:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16440 00000100:00100000:1.0:1746143838.214934:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963624954368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143838.214941:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.214953:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b4d73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841183d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.214990:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627459200:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143838.214993:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627459328:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143838.215011:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513a00/0x87925e4cb73b4d6c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411836 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.215021:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513a00/0x87925e4cb73b4d6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411836 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.215030:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513a00, rc 0) 00000100:00100000:3.0:1746143838.215048:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624954112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4832us (5381us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.215054:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16438 00000100:00100000:1.0:1746143838.215059:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.215089:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627459072:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143838.215103:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4d65 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841182f expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.215111:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4d65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841182f expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.215118:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848000, rc 0) 00000100:00100000:1.0:1746143838.215143:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624953984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4982us (5495us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143838.215149:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16437 00000100:00100000:1.0:1746143838.215165:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624954624 00000100:00100000:1.0:1746143838.215168:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624954624 00000100:00100000:1.0:1746143838.215190:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 988 00000100:00100000:1.0:1746143838.215195:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+274:2011:x1830963624954624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.215205:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.215219:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b4d57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411828 expref: 274 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.215223:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512c00/0x87925e4cb73b4d7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411844 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.215228:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143838.215232:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.215248:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2011:x1830963624954624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.215249:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627459456:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143838.215253:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 988 00000100:00100000:2.0:1746143838.215278:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.216647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.216935:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624954880 00000100:00100000:2.0:1746143838.216941:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624954880 00002000:00100000:2.0:1746143838.216970:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1654784->1658879) req@ffff880093cf8e00 x1830963624954880/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.216978:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8e00 with x1830963624954880 ext(1654784->1658879) 00002000:00010000:2.0:1746143838.216982:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf8e00 00000100:00100000:2.0:1746143838.216997:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7148 00000100:00100000:2.0:1746143838.217001:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624954880:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143838.217102:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963624954880:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 99us (457us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143838.217109:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7148 00002000:00100000:2.0:1746143838.217114:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1654784->1658879) req@ffff880093cf8e00 x1830963624954880/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.217121:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8e00 with x1830963624954880 ext(1654784->1658879) 00002000:00010000:2.0:1746143838.217123:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf8e00 00002000:00010000:1.0:1746143838.218892:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143837 -> 1746143838 00000100:00100000:1.0:1746143838.218909:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627459328:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143838.218956:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b4d73 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841183d expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.218967:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b4d73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841183d expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.218976:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849a00, rc 0) 00000100:00100000:1.0:1746143838.219009:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963624954368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4076us (4388us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143838.219016:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16440 00000100:00100000:0.0:1746143838.219182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.219587:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624955136 00000100:00100000:0.0:1746143838.219592:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624955136 00002000:00100000:0.0:1746143838.219618:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->737279) req@ffff880093cf8a80 x1830963624955136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143838.219631:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8a80 with x1830963624955136 ext(0->737279) 00002000:00010000:0.0:1746143838.219635:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8a80 00002000:00010000:3.0:1746143838.219638:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143835 -> 1746143838 00002000:00010000:3.0:1746143838.219642:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143835 -> 1746143838 00002000:00010000:3.0:1746143838.219644:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143835 -> 1746143838 00000100:00100000:0.0:1746143838.219648:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7149 00000100:00100000:3.0:1746143838.219653:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627459456:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143838.219654:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624955136:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143838.219669:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512c00/0x87925e4cb73b4d7a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411844 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.219678:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512c00/0x87925e4cb73b4d7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411844 expref: 23 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.219685:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512c00, rc 0) 00000100:00100000:3.0:1746143838.219709:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963624954496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4959us (5125us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.219715:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16439 00000100:00100000:0.0:1746143838.225060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.225100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.225174:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624955520 00000100:00100000:3.0:1746143838.225181:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624955520 00000100:00100000:3.0:1746143838.225223:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16441 00000100:00100000:3.0:1746143838.225229:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2709:x1830963624955520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.225244:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.225256:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841184b expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.225283:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 8 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.225291:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.225292:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.225295:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.225319:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 8 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.225328:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 8 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.225338:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627459584:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.225405:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.227247:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624955136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7589us (8061us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746143838.227256:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7149 00002000:00100000:1.0:1746143838.227265:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->737279) req@ffff880093cf8a80 x1830963624955136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.227278:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8a80 with x1830963624955136 ext(0->737279) 00010000:00010000:1.0:1746143838.227286:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.227296:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.227302:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cf8a80 00000100:00100000:2.0:1746143838.227459:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624955392 00000100:00100000:2.0:1746143838.227465:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624955392 00000100:00100000:2.0:1746143838.227499:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5398 00000100:00100000:2.0:1746143838.227505:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2702:x1830963624955392:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143838.228001:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627459584:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.228019:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.228030:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513600, rc 0) 00000100:00100000:3.0:1746143838.228047:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2709:x1830963624955520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2818us (2946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.228053:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16441 00000100:00100000:3.0:1746143838.228760:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.228886:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2702:x1830963624955392:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 1380us (3832us total) trans 8589945013 rc 0/0 00000100:00100000:2.0:1746143838.228894:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5398 00000100:00100000:1.0:1746143838.228984:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624955648 00000100:00100000:1.0:1746143838.228989:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624955648 00002000:00100000:1.0:1746143838.229009:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->1048575) req@ffff88012b1da300 x1830963624955648/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.229016:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963624955648 ext(737280->1048575) 00010000:00010000:1.0:1746143838.229021:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.229031:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 7 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.229037:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1da300 00000100:00100000:1.0:1746143838.229056:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2651 00000100:00100000:1.0:1746143838.229061:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624955648:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143838.234554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.234855:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624955904 00000100:00100000:2.0:1746143838.234863:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624955904 00002000:00100000:2.0:1746143838.234901:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1658880->2097151) req@ffff880093cfa680 x1830963624955904/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.234935:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa680 with x1830963624955904 ext(1658880->2097151) 00002000:00010000:2.0:1746143838.234939:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfa680 00000100:00100000:2.0:1746143838.234970:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7150 00000100:00100000:2.0:1746143838.234977:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624955904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143838.238213:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624955648:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9144us (9446us total) trans 17179873940 rc 0/0 00000100:00100000:1.0:1746143838.238221:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2651 00002000:00100000:1.0:1746143838.238230:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->1048575) req@ffff88012b1da300 x1830963624955648/t17179873940(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.238237:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963624955648 ext(737280->1048575) 00010000:00010000:1.0:1746143838.238244:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.238253:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.238260:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1da300 00000100:00100000:0.0:1746143838.240346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.240437:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624956160 00000100:00100000:1.0:1746143838.240444:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624956160 00002000:00100000:1.0:1746143838.240475:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093cf9c00 x1830963624956160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.240483:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9c00 with x1830963624956160 ext(1048576->2097151) 00002000:00010000:1.0:1746143838.240488:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf9c00 00000100:00100000:1.0:1746143838.240518:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7151 00000100:00100000:1.0:1746143838.240525:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624956160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143838.252514:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963624955904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17530us (17960us total) trans 0 rc 438272/438272 00000100:00100000:2.0:1746143838.252525:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7150 00002000:00100000:2.0:1746143838.252535:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1658880->2097151) req@ffff880093cfa680 x1830963624955904/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 438272/438272 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.252543:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa680 with x1830963624955904 ext(1658880->2097151) 00002000:00010000:2.0:1746143838.252548:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfa680 00000100:00100000:1.0:1746143838.253749:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624956160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13221us (13406us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143838.253757:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7151 00002000:00100000:1.0:1746143838.253763:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093cf9c00 x1830963624956160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.253770:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9c00 with x1830963624956160 ext(1048576->2097151) 00002000:00010000:1.0:1746143838.253774:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf9c00 00000100:00100000:0.0:1746143838.257558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.257620:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624956288 00000100:00100000:3.0:1746143838.257628:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624956288 00010000:00010000:3.0:1746143838.257661:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.257756:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8011 00000100:00100000:3.0:1746143838.257764:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624956288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.257777:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.257796:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.257807:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.257827:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5600/0x87925e4cb73b4d11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411813 expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.257854:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.257857:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.257863:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.257870:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.257898:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.257907:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627459712:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.258002:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143838.263238:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627459712:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143838.263257:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.265338:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963624956288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7564us (7777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.265351:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8011 00000100:00100000:0.0:1746143838.266486:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.266516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.266538:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.266562:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.266616:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624956416 00000100:00100000:3.0:1746143838.266624:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624956416 00000100:00100000:3.0:1746143838.266668:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624956544 00000100:00100000:3.0:1746143838.266670:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624956544 00000100:00100000:3.0:1746143838.266681:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624956672 00000100:00100000:3.0:1746143838.266682:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624956672 00000100:00100000:3.0:1746143838.266695:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16442 00000100:00100000:3.0:1746143838.266701:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624956416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.266715:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.266728:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411852 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.266749:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.266751:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.266758:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.266769:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.266778:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b5c00, rc 0) 00000100:00100000:3.0:1746143838.266810:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624956416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 110us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.266815:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16442 00000100:00100000:3.0:1746143838.266826:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16443 00000100:00100000:3.0:1746143838.266831:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624956544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.266836:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.266842:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338b4a00/0x87925e4cb73b4d8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411859 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.266871:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627459840:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143838.266935:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143838.266953:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16444 00000100:00100000:3.0:1746143838.266958:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624956672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.266964:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.266972:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b4d96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411860 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.266996:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627459968:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143838.267023:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.267113:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624956928 00000100:00100000:2.0:1746143838.267117:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624956928 00002000:00100000:2.0:1746143838.267140:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880095c31180 x1830963624956928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.267148:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31180 with x1830963624956928 ext(0->1048575) 00002000:00010000:2.0:1746143838.267152:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c31180 00000100:00100000:2.0:1746143838.267173:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7152 00000100:00100000:2.0:1746143838.267178:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624956928:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143838.275970:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624956928:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8782us (9397us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143838.275984:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7152 00002000:00100000:2.0:1746143838.275995:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880095c31180 x1830963624956928/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.276003:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31180 with x1830963624956928 ext(0->1048575) 00002000:00010000:2.0:1746143838.276007:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c31180 00000100:00100000:2.0:1746143838.276072:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627459968:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143838.276102:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b4d96 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411860 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.276113:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b4d96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411860 expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.276138:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849a00, rc 0) 00000100:00100000:2.0:1746143838.276155:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624956672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9198us (9616us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143838.276161:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16444 00000100:00100000:3.0:1746143838.276220:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627459840:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143838.276236:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338b4a00/0x87925e4cb73b4d8f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411859 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.276244:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b4a00/0x87925e4cb73b4d8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411859 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.276254:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b4a00, rc 0) 00000100:00100000:3.0:1746143838.276273:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624956544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9441us (9756us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.276278:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16443 00000100:00100000:0.0:1746143838.281319:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.281423:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624957056 00000100:00100000:3.0:1746143838.281432:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624957056 00000100:00100000:3.0:1746143838.281481:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16445 00000100:00100000:3.0:1746143838.281636:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2710:x1830963624957056:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.281652:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.281670:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411867 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.281695:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.281702:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.281704:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.281707:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.281731:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 23 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.281741:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 23 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.281751:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627460096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.281820:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.285868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.286058:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.286149:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624957184 00000100:00100000:2.0:1746143838.286156:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624957184 00000100:00100000:2.0:1746143838.286930:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16446 00000100:00100000:2.0:1746143838.286938:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+22:2709:x1830963624957184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143838.286954:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.286969:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841186e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.286993:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 6 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.286999:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143838.287000:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143838.287004:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.287026:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 6 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.287034:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 6 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.287044:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627460224:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.287096:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.287109:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624957312 00000100:00100000:2.0:1746143838.287113:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624957312 00002000:00100000:2.0:1746143838.287135:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3756031) req@ffff880095c30a80 x1830963624957312/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.287143:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963624957312 ext(3145728->3756031) 00010000:00010000:2.0:1746143838.287149:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 24 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.287162:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 24 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746143838.287168:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c30a80 00000100:00100000:2.0:1746143838.287181:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2652 00000100:00100000:2.0:1746143838.287186:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624957312:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143838.287202:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627460096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.287222:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 10 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.287232:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848600, rc 0) 00000100:00100000:3.0:1746143838.287253:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2710:x1830963624957056:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5621us (5941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.287259:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16445 00000100:00100000:2.0:1746143838.288360:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.288581:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624957568 00000100:00100000:0.0:1746143838.288587:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624957568 00000100:00100000:0.0:1746143838.288624:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13959 00000100:00100000:0.0:1746143838.288630:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+273:2713:x1830963624957568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143838.288642:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143838.288653:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73b4dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411875 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.288703:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288712:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288721:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288732:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288736:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288741:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288805:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b4dc0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288812:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b4dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288817:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b4dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143838.288823:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143838.288872:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288877:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288881:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288886:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288891:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143838.288894:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288899:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.288906:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143838.288908:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143838.290322:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290332:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634000/0x87925e4cb73b4db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290374:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290379:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290384:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290389:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143838.290392:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290396:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290404:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030000) 00010000:00010000:0.0:1746143838.290406:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143838.290410:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290413:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634600/0x87925e4cb73b4db9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143838.290739:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635e00/0x87925e4cb73b4dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411875 expref: 276 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.292832:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b4dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411875 expref: 275 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.292840:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143838.292842:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143838.292845:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635400, rc 0) 00000100:00100000:0.0:1746143838.292924:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+275:2713:x1830963624957568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4280us (4552us total) trans 8589945014 rc 0/0 00000100:00100000:0.0:1746143838.292932:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13959 00000100:00100000:0.0:1746143838.295562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.296029:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624957696 00000100:00100000:2.0:1746143838.296037:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624957696 00002000:00100000:2.0:1746143838.296067:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1658879) req@ffff880095c32a00 x1830963624957696/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.296077:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32a00 with x1830963624957696 ext(1048576->1658879) 00010000:00010000:2.0:1746143838.296086:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 7 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.296097:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 7 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746143838.296104:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c32a00 00000100:00100000:2.0:1746143838.296124:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2653 00000100:00100000:2.0:1746143838.296131:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963624957696:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143838.296397:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627460224:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.296415:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 23 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.296426:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33600, rc 0) 00000100:00100000:3.0:1746143838.296445:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2709:x1830963624957184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9508us (10586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.296451:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16446 00000100:00100000:0.0:1746143838.297045:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624957312:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9857us (11134us total) trans 17179873941 rc 0/0 00000100:00100000:0.0:1746143838.297052:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2652 00002000:00100000:0.0:1746143838.297059:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3756031) req@ffff880095c30a80 x1830963624957312/t17179873941(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143838.297066:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963624957312 ext(3145728->3756031) 00010000:00010000:0.0:1746143838.297073:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 26 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143838.297087:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 26 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:0.0:1746143838.297093:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c30a80 00000100:00100000:0.0:1746143838.297386:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.298080:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624957952 00000100:00100000:3.0:1746143838.298086:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624957952 00000100:00100000:3.0:1746143838.298115:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5399 00000100:00100000:3.0:1746143838.298120:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2713:x1830963624957952:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143838.298684:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:2713:x1830963624957952:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 562us (1297us total) trans 8589945015 rc 0/0 00000100:00100000:3.0:1746143838.298691:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5399 00000100:00100000:2.0:1746143838.298822:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.299405:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624958080 00000100:00100000:3.0:1746143838.299409:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624958080 00000100:00100000:3.0:1746143838.299436:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 989 00000100:00100000:3.0:1746143838.299441:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:2011:x1830963624958080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.299449:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.299468:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b4dc0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411875 expref: 276 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.299587:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.299592:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.299783:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2011:x1830963624958080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 340us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.299789:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 989 00000100:00100000:0.0:1746143838.322463:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.322531:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624958208 00000100:00100000:2.0:1746143838.322539:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624958208 00010000:00010000:2.0:1746143838.322576:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 26 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.322616:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8012 00000100:00100000:2.0:1746143838.322622:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624958208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.322634:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.322652:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 26 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.322662:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 26 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.322680:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5800/0x87925e4cb73b4d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3756031) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841180c expref: 26 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.322697:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.322698:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.322704:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.322712:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.323170:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 9 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.323182:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627460352:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143838.323249:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.326670:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624957696:12345-192.168.202.3@tcp:4:cat.0 Request processed in 30164us (30739us total) trans 21474841213 rc 0/0 00000100:00100000:1.0:1746143838.326682:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2653 00002000:00100000:1.0:1746143838.326692:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1658879) req@ffff880095c32a00 x1830963624957696/t21474841213(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.326972:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32a00 with x1830963624957696 ext(1048576->1658879) 00010000:00010000:1.0:1746143838.326982:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.326993:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.326999:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c32a00 00000100:00100000:2.0:1746143838.331036:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627460352:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143838.331059:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.331096:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624958208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8474us (8640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.331105:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8012 00000100:00100000:2.0:1746143838.331892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.332542:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.332700:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624958464 00000100:00100000:3.0:1746143838.332708:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624958464 00010000:00010000:3.0:1746143838.332743:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.332903:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624958592 00000100:00100000:1.0:1746143838.332909:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624958592 00000100:00100000:3.0:1746143838.333071:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8013 00000100:00100000:3.0:1746143838.333081:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624958464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.333095:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.333117:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.333129:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.333149:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4c00/0x87925e4cb73b4d18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1658879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841181a expref: 9 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.333189:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.333193:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.333200:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.333208:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.333242:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.333255:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627460480:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.333329:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00002000:00100000:1.0:1746143838.333649:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8801368e9180 x1830963624958592/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.333657:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963624958592 ext(2097152->3145727) 00002000:00010000:1.0:1746143838.333660:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:1.0:1746143838.333675:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7153 00000100:00100000:1.0:1746143838.333680:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624958592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143838.343848:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627460480:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143838.343867:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.344690:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624958464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11609us (12147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.344700:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8013 00000100:00100000:2.0:1746143838.345389:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624958592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11707us (13495us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143838.345397:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7153 00002000:00100000:2.0:1746143838.345405:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8801368e9180 x1830963624958592/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.345414:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963624958592 ext(2097152->3145727) 00002000:00010000:2.0:1746143838.345419:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:1.0:1746143838.346634:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.346751:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624958848 00000100:00100000:2.0:1746143838.346759:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624958848 00002000:00100000:2.0:1746143838.346791:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880135b08700 x1830963624958848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.346798:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08700 with x1830963624958848 ext(1048576->2097151) 00002000:00010000:2.0:1746143838.346801:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08700 00000100:00100000:2.0:1746143838.346831:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7154 00000100:00100000:2.0:1746143838.346837:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963624958848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143838.359206:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.359374:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624958976 00000100:00100000:3.0:1746143838.359383:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624958976 00000100:00100000:3.0:1746143838.359430:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16447 00000100:00100000:3.0:1746143838.359436:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2710:x1830963624958976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.359450:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.359462:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841187c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.359485:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.359492:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.359494:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.359497:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.359522:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.359531:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 24 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.359540:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627460608:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.359601:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.360426:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963624958848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13587us (13794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143838.360436:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7154 00002000:00100000:2.0:1746143838.360444:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880135b08700 x1830963624958848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.360453:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08700 with x1830963624958848 ext(1048576->2097151) 00002000:00010000:2.0:1746143838.360456:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135b08700 00000100:00100000:3.0:1746143838.361376:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627460608:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.361397:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 9 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143838.361404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143838.361410:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848e00, rc 0) 00000100:00100000:3.0:1746143838.361446:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2710:x1830963624958976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2009us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.361452:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16447 00000100:00100000:2.0:1746143838.361487:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624959104 00000100:00100000:2.0:1746143838.361492:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624959104 00002000:00100000:2.0:1746143838.361515:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2826240->3145727) req@ffff88007f64a300 x1830963624959104/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.361522:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a300 with x1830963624959104 ext(2826240->3145727) 00010000:00010000:2.0:1746143838.361527:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 23 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.361536:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 23 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:2.0:1746143838.361542:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f64a300 00000100:00100000:2.0:1746143838.361554:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2654 00000100:00100000:2.0:1746143838.361559:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2010:x1830963624959104:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143838.366469:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.366532:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624959360 00000100:00100000:2.0:1746143838.366539:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624959360 00000100:00100000:2.0:1746143838.366581:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13960 00000100:00100000:2.0:1746143838.366586:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2715:x1830963624959360:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143838.366604:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.366620:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b4dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411883 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.366679:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366690:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366699:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366710:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366716:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366720:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366800:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b4dea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366809:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b4dea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366814:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b4dea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143838.366826:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143838.366885:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366891:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366896:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366900:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366905:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143838.366908:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366944:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366954:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143838.366957:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143838.366960:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366964:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b4ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366991:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366995:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.366999:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.367003:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143838.367005:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.367012:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.367018:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5b9d000) 00010000:00010000:2.0:1746143838.367019:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143838.367021:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.367025:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b4de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.367053:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b4dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411883 expref: 24 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.367062:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b4dea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411883 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.367067:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.367068:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143838.367070:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33e00, rc 0) 00000100:00100000:2.0:1746143838.367104:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2715:x1830963624959360:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 517us (641us total) trans 8589945016 rc 0/0 00000100:00100000:2.0:1746143838.367110:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13960 00000100:00100000:3.0:1746143838.368536:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624959104:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6971us (7128us total) trans 21474841214 rc 0/0 00000100:00100000:3.0:1746143838.368544:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2654 00002000:00100000:3.0:1746143838.368553:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2826240->3145727) req@ffff88007f64a300 x1830963624959104/t21474841214(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.368560:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a300 with x1830963624959104 ext(2826240->3145727) 00010000:00010000:3.0:1746143838.368568:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 25 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.368585:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 25 pid: 3134 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143838.368590:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f64a300 00000100:00100000:0.0:1746143838.371147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.371226:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624959488 00000100:00100000:3.0:1746143838.371233:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624959488 00000100:00100000:3.0:1746143838.371281:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16448 00000100:00100000:3.0:1746143838.371288:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2709:x1830963624959488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.371304:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.371317:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841188a expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.371336:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.371337:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.371343:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.371354:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.371373:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848000, rc 0) 00000100:00100000:3.0:1746143838.371406:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2709:x1830963624959488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.371411:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16448 00000100:00100000:0.0:1746143838.373419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.373602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.373672:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624959744 00000100:00100000:3.0:1746143838.373677:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624959616 00000100:00100000:2.0:1746143838.373679:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624959744 00000100:00100000:3.0:1746143838.373683:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624959616 00010000:00010000:2.0:1746143838.373708:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 25 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.373759:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8014 00000100:00100000:2.0:1746143838.373766:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 990 00000100:00100000:3.0:1746143838.373769:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624959744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143838.373772:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963624959616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.373780:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.373780:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.373799:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 25 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.373799:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b4dea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411883 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.373810:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 25 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.373831:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b4d03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2826240->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411805 expref: 25 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.373833:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.373836:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143838.373860:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.373863:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.373870:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 8 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.373878:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 8 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.373896:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624959616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 124us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.373903:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 990 00010000:00010000:3.0:1746143838.373938:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 8 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.373953:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627460736:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.374017:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.376012:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.376248:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627460736:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.376252:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624960000 00000100:00100000:3.0:1746143838.376258:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624960000 00010000:00010000:2.0:1746143838.376265:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143838.376292:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88007f64ad80 x1830963624960000/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.376300:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64ad80 with x1830963624960000 ext(2097152->3145727) 00002000:00010000:3.0:1746143838.376304:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64ad80 00000100:00100000:2.0:1746143838.376308:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963624959744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2540us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.376316:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8014 00000100:00100000:3.0:1746143838.376320:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7155 00000100:00100000:3.0:1746143838.376327:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624960000:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143838.390693:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.390735:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.390802:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624960384 00000100:00100000:1.0:1746143838.390810:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624960384 00002000:00100000:1.0:1746143838.390846:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88007f648380 x1830963624960384/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.390860:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648380 with x1830963624960384 ext(3145728->4194303) 00002000:00010000:1.0:1746143838.390865:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648380 00000100:00100000:1.0:1746143838.390879:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624960512 00000100:00100000:1.0:1746143838.390881:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624960512 00002000:00100000:1.0:1746143838.390892:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f648e00 x1830963624960512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143838.390893:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7156 00002000:00100000:1.0:1746143838.390898:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648e00 with x1830963624960512 ext(2097152->4194303) 00002000:00010000:1.0:1746143838.390900:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f648e00 00000100:00100000:2.0:1746143838.390902:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624960384:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143838.390909:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7157 00000100:00100000:1.0:1746143838.390935:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624960512:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143838.397402:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624960000:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21067us (21386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143838.397414:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7155 00002000:00100000:3.0:1746143838.397424:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88007f64ad80 x1830963624960000/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.397433:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64ad80 with x1830963624960000 ext(2097152->3145727) 00002000:00010000:3.0:1746143838.397438:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64ad80 00000100:00100000:2.0:1746143838.401642:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624960384:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10733us (10948us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143838.401653:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7156 00002000:00100000:2.0:1746143838.401663:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88007f648380 x1830963624960384/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.401672:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648380 with x1830963624960384 ext(3145728->4194303) 00002000:00010000:2.0:1746143838.401676:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648380 00000100:00100000:0.0:1746143838.405201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.406611:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624960640 00000100:00100000:1.0:1746143838.406620:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624960640 00000100:00100000:1.0:1746143838.406677:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16449 00000100:00100000:1.0:1746143838.406684:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2709:x1830963624960640:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143838.406699:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.406715:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411891 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.406736:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.406737:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.406742:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.406755:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.406769:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96c00, rc 0) 00000100:00100000:1.0:1746143838.406822:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2709:x1830963624960640:12345-192.168.202.3@tcp:101:cat.0 Request processed in 139us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.406827:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16449 00000100:00100000:1.0:1746143838.417424:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624960512:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26478us (26677us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143838.417436:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7157 00002000:00100000:1.0:1746143838.417450:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f648e00 x1830963624960512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.417460:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648e00 with x1830963624960512 ext(2097152->4194303) 00002000:00010000:1.0:1746143838.417465:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f648e00 00000100:00100000:0.0:1746143838.424062:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.424180:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624960896 00000100:00100000:1.0:1746143838.424189:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624960896 00002000:00100000:1.0:1746143838.424224:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f649180 x1830963624960896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.424232:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963624960896 ext(2097152->4194303) 00002000:00010000:1.0:1746143838.424236:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649180 00000100:00100000:1.0:1746143838.424262:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7158 00000100:00100000:1.0:1746143838.424269:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624960896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143838.424706:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.424721:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624961152 00000100:00100000:0.0:1746143838.424724:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624961152 00002000:00100000:0.0:1746143838.424739:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88007f648700 x1830963624961152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143838.424746:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648700 with x1830963624961152 ext(3145728->4194303) 00002000:00010000:0.0:1746143838.424748:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648700 00000100:00100000:0.0:1746143838.424768:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7159 00000100:00100000:0.0:1746143838.424772:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624961152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143838.429386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.429443:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624961280 00000100:00100000:1.0:1746143838.429452:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624961280 00000100:00100000:1.0:1746143838.430144:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16450 00000100:00100000:1.0:1746143838.430152:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2715:x1830963624961280:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143838.430166:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.430179:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411898 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.430203:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.430211:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.430217:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.430218:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.430221:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3117055] (req 2641920->3117055) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.430246:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.430256:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.430267:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627460864:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143838.430346:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.430355:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 10 pid: 1945 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.430381:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627460992:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143838.430400:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b21149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.436843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.437082:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624961408 00000100:00100000:3.0:1746143838.437090:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624961408 00000100:00100000:3.0:1746143838.437146:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16451 00000100:00100000:3.0:1746143838.437154:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624961408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.437170:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.437185:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841189f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.437203:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.437204:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.437210:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.437229:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.437238:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:3.0:1746143838.437277:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624961408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 124us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.437282:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16451 00000100:00100000:1.0:1746143838.438939:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624961152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14158us (14225us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143838.438949:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7159 00002000:00100000:1.0:1746143838.438959:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88007f648700 x1830963624961152/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.438969:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648700 with x1830963624961152 ext(3145728->4194303) 00002000:00010000:1.0:1746143838.438974:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648700 00000100:00100000:1.0:1746143838.440844:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627460864:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143838.440856:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627460992:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143838.440881:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3117055] (req 2641920->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.440896:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97000, rc 0) 00000100:00100000:1.0:1746143838.440964:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2715:x1830963624961280:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10812us (11585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.440972:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16450 00000100:00100000:0.0:1746143838.443064:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.443284:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624961536 00000100:00100000:2.0:1746143838.443292:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624961536 00010000:00010000:2.0:1746143838.443322:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 11 pid: 1945 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.443359:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8015 00000100:00100000:2.0:1746143838.443376:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624961536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.443388:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.443403:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 11 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.443413:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 11 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.443433:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d848e00/0x87925e4cb73b4dce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841187c expref: 11 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.443450:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.443481:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624961536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 107us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.443486:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8015 00000100:00100000:1.0:1746143838.444125:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624960896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19854us (20067us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143838.444133:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7158 00002000:00100000:1.0:1746143838.444142:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f649180 x1830963624960896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.444151:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963624960896 ext(2097152->4194303) 00010000:00010000:1.0:1746143838.444156:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.444167:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.444173:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f649180 00000100:00100000:0.0:1746143838.445274:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.445359:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624961792 00000100:00100000:1.0:1746143838.445375:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624961792 00002000:00100000:1.0:1746143838.445404:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009e490a80 x1830963624961792/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.445413:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963624961792 ext(4194304->4853759) 00002000:00010000:1.0:1746143838.445417:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490a80 00000100:00100000:1.0:1746143838.445481:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7160 00000100:00100000:1.0:1746143838.445488:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624961792:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143838.450692:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.452663:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.452969:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624961920 00000100:00100000:1.0:1746143838.452977:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624961920 00000100:00100000:1.0:1746143838.453022:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16452 00000100:00100000:1.0:1746143838.453029:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2709:x1830963624961920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143838.453044:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.453058:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118a6 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.453080:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.453083:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.453091:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.453103:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.453113:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049400, rc 0) 00000100:00100000:1.0:1746143838.453153:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2709:x1830963624961920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 124us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.453159:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16452 00000100:00100000:2.0:1746143838.454020:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624962048 00000100:00100000:2.0:1746143838.454025:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624962048 00010000:00010000:2.0:1746143838.454042:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.454070:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8016 00000100:00100000:2.0:1746143838.454076:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624962048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.454086:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.454106:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.454116:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.454129:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b4dff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411891 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.454142:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.454143:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.454148:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.454154:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.454180:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.454191:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627461120:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143838.454239:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.455011:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624961792:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9522us (9740us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143838.455019:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7160 00002000:00100000:2.0:1746143838.455026:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009e490a80 x1830963624961792/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.455034:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963624961792 ext(4194304->4853759) 00002000:00010000:2.0:1746143838.455038:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e490a80 00000100:00100000:2.0:1746143838.457714:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ea300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627461120:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143838.457733:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.457776:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624962048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3700us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.457784:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8016 00000100:00100000:0.0:1746143838.458709:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.459212:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624962304 00000100:00100000:2.0:1746143838.459219:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624962304 00002000:00100000:2.0:1746143838.459257:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2641920->2646015) req@ffff88009e491500 x1830963624962304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.459266:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491500 with x1830963624962304 ext(2641920->2646015) 00002000:00010000:2.0:1746143838.459270:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491500 00000100:00100000:2.0:1746143838.459299:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7161 00000100:00100000:2.0:1746143838.459306:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624962304:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143838.459436:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624962304:12345-192.168.202.3@tcp:3:cat.0 Request processed in 129us (729us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143838.459442:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7161 00002000:00100000:2.0:1746143838.459447:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2641920->2646015) req@ffff88009e491500 x1830963624962304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.459455:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491500 with x1830963624962304 ext(2641920->2646015) 00002000:00010000:2.0:1746143838.459458:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491500 00000100:00100000:0.0:1746143838.460795:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.460962:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624962432 00000100:00100000:3.0:1746143838.460968:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624962432 00000100:00100000:3.0:1746143838.461055:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16453 00000100:00100000:3.0:1746143838.461062:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624962432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.461073:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.461088:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118ad expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.461112:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e1b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ad expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.461122:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ad expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.461406:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fa00, rc 0) 00000100:00100000:3.0:1746143838.461540:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624962432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 477us (747us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.461545:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16453 00000100:00100000:0.0:1746143838.465885:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.465990:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624962688 00000100:00100000:2.0:1746143838.465999:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624962688 00002000:00100000:2.0:1746143838.466038:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3112960->3117055) req@ffff88009e491880 x1830963624962688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.466046:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491880 with x1830963624962688 ext(3112960->3117055) 00002000:00010000:2.0:1746143838.466051:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491880 00000100:00100000:2.0:1746143838.466068:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7162 00000100:00100000:2.0:1746143838.466074:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2010:x1830963624962688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143838.466198:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2010:x1830963624962688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 122us (318us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143838.466203:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7162 00002000:00100000:2.0:1746143838.466209:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3112960->3117055) req@ffff88009e491880 x1830963624962688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.466215:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491880 with x1830963624962688 ext(3112960->3117055) 00002000:00010000:2.0:1746143838.466218:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491880 00000100:00100000:0.0:1746143838.470138:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.470215:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624962944 00000100:00100000:2.0:1746143838.470222:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624962944 00002000:00100000:2.0:1746143838.470255:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009e490380 x1830963624962944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.470261:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490380 with x1830963624962944 ext(3145728->4194303) 00002000:00010000:2.0:1746143838.470265:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490380 00000100:00100000:2.0:1746143838.470278:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7163 00000100:00100000:2.0:1746143838.470283:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624962944:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143838.473032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.473078:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.473191:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624963200 00000100:00100000:3.0:1746143838.473198:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624963200 00000100:00100000:3.0:1746143838.473245:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16454 00000100:00100000:0.0:1746143838.473247:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624963328 00000100:00100000:0.0:1746143838.473251:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624963328 00000100:00100000:3.0:1746143838.473252:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624963200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.473267:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.473281:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118b4 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143838.473284:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5400 00000100:00100000:0.0:1746143838.473288:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2715:x1830963624963328:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:3.0:1746143838.473307:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e22 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118b4 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.473319:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118b4 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.473332:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fa00, rc 0) 00000100:00100000:3.0:1746143838.473377:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624963200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 125us (352us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.473383:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16454 00000100:00100000:0.0:1746143838.473427:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2715:x1830963624963328:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 138us (348us total) trans 8589945017 rc 0/0 00000100:00100000:0.0:1746143838.473433:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5400 00000100:00100000:2.0:1746143838.483832:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624962944:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13540us (13691us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143838.483842:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7163 00002000:00100000:2.0:1746143838.483852:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009e490380 x1830963624962944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.483860:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490380 with x1830963624962944 ext(3145728->4194303) 00002000:00010000:2.0:1746143838.483865:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490380 00000100:00100000:0.0:1746143838.484217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.485185:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624963584 00000100:00100000:2.0:1746143838.485193:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624963584 00000100:00100000:2.0:1746143838.485225:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5401 00000100:00100000:2.0:1746143838.485231:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2710:x1830963624963584:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143838.485411:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2710:x1830963624963584:12345-192.168.202.3@tcp:35:cat.0 Request processed in 180us (1194us total) trans 8589945018 rc 0/0 00000100:00100000:2.0:1746143838.485417:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5401 00000100:00100000:0.0:1746143838.487196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.487393:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624963712 00000100:00100000:2.0:1746143838.487400:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624963712 00000100:00100000:2.0:1746143838.487444:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16455 00000100:00100000:2.0:1746143838.487451:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2713:x1830963624963712:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143838.487463:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.487479:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118bb expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.487504:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.487512:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.487518:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.487520:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.487523:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.487549:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.487559:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 9 pid: 9587 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.487570:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627461248:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.487630:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.487637:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.487645:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627461376:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.487662:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.490792:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.491201:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624963840 00000100:00100000:3.0:1746143838.491209:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624963840 00000100:00100000:3.0:1746143838.491250:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16456 00000100:00100000:3.0:1746143838.491256:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624963840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.491271:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.491285:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b4e30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118c2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.491312:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b4e30 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c2 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.491322:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fe00/0x87925e4cb73b4e30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c2 expref: 28 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143838.491440:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627461376:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.491494:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fe00, rc 0) 00000100:00100000:3.0:1746143838.491534:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624963840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 278us (749us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.491540:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16456 00000100:00100000:3.0:1746143838.492350:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627461248:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.492383:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1654784->2097151] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.492394:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:3.0:1746143838.492425:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2713:x1830963624963712:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4973us (5232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.492431:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16455 00000100:00100000:0.0:1746143838.493869:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.494456:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624963968 00000100:00100000:2.0:1746143838.494463:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624963968 00010000:00010000:2.0:1746143838.494490:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.494631:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8017 00000100:00100000:2.0:1746143838.494638:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624963968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.494649:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.494664:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.494672:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.494690:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6400/0x87925e4cb73b4a7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ae expref: 26 pid: 3134 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.494823:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.495472:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624963968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 832us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.495478:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8017 00000100:00100000:0.0:1746143838.496378:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.496419:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624964096 00000100:00100000:2.0:1746143838.496424:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624964096 00010000:00010000:2.0:1746143838.496443:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 10 pid: 9587 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.496470:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8018 00000100:00100000:2.0:1746143838.496481:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624964096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.496490:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.496500:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 10 pid: 9587 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.496509:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 10 pid: 9587 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.496522:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b4afd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116f4 expref: 10 pid: 9587 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.496532:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.496534:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.496539:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.496547:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.496574:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.496584:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627461504:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143838.496652:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.497889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.499619:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624964352 00000100:00100000:2.0:1746143838.499629:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624964352 00002000:00100000:2.0:1746143838.499668:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880092144000 x1830963624964352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.499678:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144000 with x1830963624964352 ext(4194304->4853759) 00002000:00010000:2.0:1746143838.499682:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144000 00000100:00100000:2.0:1746143838.499718:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7164 00000100:00100000:2.0:1746143838.499726:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624964352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143838.501670:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.501754:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624964608 00000100:00100000:1.0:1746143838.501761:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624964608 00000100:00100000:3.0:1746143838.501775:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627461504:192.168.202.3@tcp:105: 00002000:00100000:1.0:1746143838.501790:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1654784->1658879) req@ffff880092144380 x1830963624964608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143838.501792:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746143838.501798:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144380 with x1830963624964608 ext(1654784->1658879) 00002000:00010000:1.0:1746143838.501802:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092144380 00000100:00100000:1.0:1746143838.501816:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7165 00000100:00100000:3.0:1746143838.501821:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624964096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5343us (5444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.501823:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624964608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143838.501830:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8018 00000100:00100000:1.0:1746143838.501903:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624964608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 80us (237us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143838.501908:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7165 00002000:00100000:1.0:1746143838.501932:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1654784->1658879) req@ffff880092144380 x1830963624964608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.501938:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144380 with x1830963624964608 ext(1654784->1658879) 00002000:00010000:1.0:1746143838.501941:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092144380 00000100:00100000:2.0:1746143838.504357:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624964352:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4626us (6464us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143838.504375:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7164 00002000:00100000:2.0:1746143838.504384:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880092144000 x1830963624964352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/440 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.504392:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144000 with x1830963624964352 ext(4194304->4853759) 00002000:00010000:2.0:1746143838.504397:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144000 00000100:00100000:0.0:1746143838.509826:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.509865:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.509942:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624964736 00000100:00100000:2.0:1746143838.509943:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624964864 00000100:00100000:2.0:1746143838.509950:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624964864 00000100:00100000:3.0:1746143838.509951:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624964736 00000100:00100000:2.0:1746143838.509992:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16457 00000100:00100000:2.0:1746143838.509998:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963624964864:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143838.509999:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16458 00000100:00100000:3.0:1746143838.510005:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2713:x1830963624964736:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143838.510012:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.510013:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.510025:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118c9 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.510025:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b4e3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118d0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.510046:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.510049:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b4e3e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118d0 expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.510054:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.510057:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b4e3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118d0 expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.510063:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.510065:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.510068:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.510078:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00010000:00010000:3.0:1746143838.510094:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.510104:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 9 pid: 3134 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746143838.510114:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627461632:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.510115:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963624964864:12345-192.168.202.3@tcp:101:cat.0 Request processed in 116us (248us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143838.510120:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16457 00010000:00010000:3.0:1746143838.510179:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.510186:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.510193:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627461760:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.510210:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143838.516187:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627461632:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.516200:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627461760:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.516229:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->1568767] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.516250:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ee00, rc 0) 00000100:00100000:3.0:1746143838.516304:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2713:x1830963624964736:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6298us (6484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.516311:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16458 00000100:00100000:0.0:1746143838.517803:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.517852:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624964992 00000100:00100000:3.0:1746143838.517859:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624964992 00000100:00100000:0.0:1746143838.517865:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.517895:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624965120 00000100:00100000:3.0:1746143838.517898:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624965120 00000100:00100000:0.0:1746143838.517928:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.517933:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16459 00000100:00100000:3.0:1746143838.517939:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624964992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.517953:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.517965:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b4e45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118d7 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.517981:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.517990:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b4e45 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118d7 expref: 28 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.517998:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b4e45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118d7 expref: 28 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.518011:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28c00, rc 0) 00000100:00100000:3.0:1746143838.518049:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624964992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 110us (249us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.518054:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16459 00000100:00100000:3.0:1746143838.518066:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16460 00000100:00100000:3.0:1746143838.518071:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624965120:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143838.518077:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.518085:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b4e4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118de expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.518099:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b4e4c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118de expref: 26 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.518105:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b4e4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118de expref: 26 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.518112:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28e00, rc 0) 00000100:00100000:3.0:1746143838.518125:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624965120:12345-192.168.202.3@tcp:101:cat.0 Request processed in 54us (260us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.518130:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16460 00000100:00100000:3.0:1746143838.518154:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624965248 00000100:00100000:3.0:1746143838.518157:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624965248 00010000:00010000:3.0:1746143838.518167:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.518182:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8019 00000100:00100000:3.0:1746143838.518187:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624965248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.518195:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.518211:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.518223:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.518236:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84f400/0x87925e4cb73b4ca8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e2 expref: 27 pid: 3134 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.518244:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.518258:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624965248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.518262:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8019 00000100:00100000:2.0:1746143838.519013:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627461888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143838.519030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.519051:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143838.519072:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627461888 00000100:00100000:0.0:1746143838.519075:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627461888 00000100:00080000:2.0:1746143838.519094:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143838.519101:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1746143838.519105:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627461888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143838.519121:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1169345728 pending 978944 free 3910172672 avail 3668869120 00000100:00100000:0.0:1746143838.519144:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627461888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143838.519149:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1746143838.519279:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624965376 00000100:00100000:3.0:1746143838.519282:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624965376 00010000:00010000:3.0:1746143838.519297:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 10 pid: 3134 timeout: 997 lvb_type: 1 00000100:00100000:3.0:1746143838.519324:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8020 00000100:00100000:3.0:1746143838.519329:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624965376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.519335:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.519345:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 10 pid: 3134 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.519353:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 10 pid: 3134 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.519374:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b4caf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484117e9 expref: 10 pid: 3134 timeout: 997 lvb_type: 1 00010000:00010000:3.0:1746143838.519383:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.519384:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143838.519386:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627461888:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1746143838.519390:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.519401:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.520271:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.520280:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627462016:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143838.520341:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.528224:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.528590:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627462016:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143838.528609:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.528647:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624965376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9318us (9781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.528657:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8020 00000100:00100000:1.0:1746143838.528834:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624965632 00000100:00100000:1.0:1746143838.528840:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624965632 00000100:00100000:1.0:1746143838.528877:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5402 00000100:00100000:1.0:1746143838.528882:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:2709:x1830963624965632:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143838.529041:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+276:2709:x1830963624965632:12345-192.168.202.3@tcp:35:cat.0 Request processed in 158us (825us total) trans 8589945019 rc 0/0 00000100:00100000:1.0:1746143838.529046:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5402 00000100:00100000:0.0:1746143838.530096:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.530264:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624965888 00000100:00100000:2.0:1746143838.530268:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624965888 00002000:00100000:2.0:1746143838.530293:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1564672->1568767) req@ffff880096942300 x1830963624965888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.530301:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096942300 with x1830963624965888 ext(1564672->1568767) 00002000:00010000:2.0:1746143838.530305:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096942300 00000100:00100000:2.0:1746143838.530744:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7166 00000100:00100000:2.0:1746143838.530751:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624965888:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143838.531336:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624965888:12345-192.168.202.3@tcp:3:cat.0 Request processed in 584us (1240us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143838.531343:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7166 00002000:00100000:2.0:1746143838.531349:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1564672->1568767) req@ffff880096942300 x1830963624965888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/4536 e 0 to 0 dl 1746143849 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143838.531356:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096942300 with x1830963624965888 ext(1564672->1568767) 00002000:00010000:2.0:1746143838.531369:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096942300 00000100:00100000:0.0:1746143838.548295:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.548645:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966016 00000100:00100000:2.0:1746143838.548652:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966016 00000100:00100000:2.0:1746143838.548705:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13961 00000100:00100000:2.0:1746143838.548712:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2719:x1830963624966016:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143838.548732:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.548748:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b4e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118e5 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.548795:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548806:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548815:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548826:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548830:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548834:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548893:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548901:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 275 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.548908:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.548951:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 275 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.548965:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 275 pid: 6587 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.548975:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627462144:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.549039:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.552310:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627462144:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.552333:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143838.555957:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.556088:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966272 00000100:00100000:2.0:1746143838.556097:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966272 00000100:00100000:2.0:1746143838.556138:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5403 00000100:00100000:2.0:1746143838.556145:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:30659:x1830963624966272:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143838.557205:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:30659:x1830963624966272:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 1058us (1253us total) trans 8589945020 rc 0/0 00000100:00100000:2.0:1746143838.557212:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5403 00000100:00100000:0.0:1746143838.560832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.562834:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966400 00000100:00100000:3.0:1746143838.562846:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966400 00010000:00010000:3.0:1746143838.562884:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 277 pid: 6587 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.562940:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8021 00000100:00100000:3.0:1746143838.562947:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+277:2008:x1830963624966400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.562962:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.562968:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 277 pid: 6587 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.562979:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 277 pid: 6587 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.562999:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ae00/0x87925e4cb73b4a9b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484116ca expref: 277 pid: 6587 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.563017:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.563021:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.563035:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.563043:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143838.563074:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.563112:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963624966400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 165us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.563117:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8021 00010000:00010000:2.0:1746143838.563155:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563171:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143838.563214:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143838.563218:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143838.563233:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563246:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563254:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563259:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563264:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563268:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563379:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143838.563383:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563389:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563398:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143838.563400:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143838.563403:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563407:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b4e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563422:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563427:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563432:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563436:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143838.563438:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563443:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563448:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5b9dd00) 00010000:00010000:2.0:1746143838.563449:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143838.563451:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563455:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.563481:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b4e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.563491:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 7 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.563496:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.563498:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143838.563500:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:2.0:1746143838.563524:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2719:x1830963624966016:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 14812us (15237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.563530:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13961 00000100:00100000:0.0:1746143838.569979:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.570004:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.570028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.570038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.570060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.570082:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.570136:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966528 00000100:00100000:3.0:1746143838.570143:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966528 00000100:00100000:3.0:1746143838.570179:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966784 00000100:00100000:3.0:1746143838.570180:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966784 00000100:00100000:3.0:1746143838.570191:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624967040 00000100:00100000:3.0:1746143838.570192:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624967040 00000100:00100000:3.0:1746143838.570199:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966656 00000100:00100000:3.0:1746143838.570201:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966656 00000100:00100000:3.0:1746143838.570207:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624966912 00000100:00100000:3.0:1746143838.570208:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624966912 00000100:00100000:3.0:1746143838.570214:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624967168 00000100:00100000:3.0:1746143838.570215:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624967168 00000100:00100000:3.0:1746143838.570224:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16461 00000100:00100000:3.0:1746143838.570230:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624966528:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.570242:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.570254:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118ec expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.570271:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.570272:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.570279:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.570296:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.570304:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf14000, rc 0) 00000100:00100000:3.0:1746143838.570336:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624966528:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.570341:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16461 00000100:00100000:3.0:1746143838.570352:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16462 00000100:00100000:3.0:1746143838.570356:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624966784:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.570370:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.570379:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b4e76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118fa expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143838.570418:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627462272:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143838.570429:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16463 00000100:00100000:1.0:1746143838.570435:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624967040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143838.570441:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.570447:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411908 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.570457:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.570458:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.570462:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143838.570463:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00010000:00010000:1.0:1746143838.570471:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.570477:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25800, rc 0) 00000100:00100000:3.0:1746143838.570478:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16464 00000100:00100000:3.0:1746143838.570482:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624966656:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.570487:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143838.570492:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624967040:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 58us (464us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143838.570493:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484118f3 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.570497:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16463 00010000:00010000:3.0:1746143838.570501:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.570502:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.570507:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143838.570507:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16465 00000100:00100000:1.0:1746143838.570511:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624966912:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.570515:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.570516:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143838.570520:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b4e8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411901 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.570521:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fa00, rc 0) 00000100:00100000:3.0:1746143838.570532:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624966656:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 50us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.570536:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16464 00000100:00100000:1.0:1746143838.570538:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627462400:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143838.570545:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16466 00000100:00100000:3.0:1746143838.570549:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624967168:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.570553:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143838.570556:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114180 going to sleep for 11 seconds 00010000:00010000:3.0:1746143838.570559:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd87200/0x87925e4cb73b4e92 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841190f expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.570574:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd87200/0x87925e4cb73b4e92 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841190f expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.570581:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd87200/0x87925e4cb73b4e92 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841190f expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.570588:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87200, rc 0) 00000100:00100000:3.0:1746143838.570605:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624967168:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 56us (523us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.570610:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16466 00000100:00080000:2.0:1746143838.570672:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143838.570675:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1746143838.572608:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143833 -> 1746143838 00000100:00100000:1.0:1746143838.572631:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627462400:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143838.572653:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b4e8b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411901 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.572665:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b4e8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411901 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.572689:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:1.0:1746143838.572721:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624966912:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 2208us (2659us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143838.572729:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16465 00002000:00010000:3.0:1746143838.572802:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143837 -> 1746143838 00002000:00010000:3.0:1746143838.572804:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143834 -> 1746143838 00002000:00010000:3.0:1746143838.572806:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143837 -> 1746143838 00000100:00100000:3.0:1746143838.572815:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627462272:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143838.572829:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b4e76 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118fa expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.572837:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e29a00/0x87925e4cb73b4e76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118fa expref: 9 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.572844:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e29a00, rc 0) 00000100:00100000:3.0:1746143838.572861:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624966784:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 2504us (2855us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143838.572865:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16462 00000100:00100000:0.0:1746143838.575465:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.575525:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624967424 00000100:00100000:2.0:1746143838.575532:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624967424 00000100:00100000:2.0:1746143838.575583:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13962 00000100:00100000:2.0:1746143838.575590:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2719:x1830963624967424:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143838.575604:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.575618:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b4e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411916 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.575698:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.575709:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.575715:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.575739:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.575748:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 8 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.575758:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627462528:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.577427:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.577453:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627462528:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.577469:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143838.580298:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.581132:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624967552 00000100:00100000:2.0:1746143838.581140:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624967552 00010000:00010000:2.0:1746143838.581172:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 9 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.581206:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8022 00000100:00100000:2.0:1746143838.581214:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963624967552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.581230:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.581235:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 9 pid: 10936 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.581245:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 9 pid: 10936 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.581262:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4e68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118e5 expref: 9 pid: 10936 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.581287:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.581290:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.581298:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.581302:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.581320:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.581355:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963624967552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.581371:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8022 00010000:00010000:2.0:1746143838.581393:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.581399:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143838.581415:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143838.582672:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b4e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411916 expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.582691:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411916 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.582697:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.582699:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143838.582701:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466600, rc 0) 00000100:00100000:2.0:1746143838.582738:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624967424:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 7148us (7279us total) trans 8589945021 rc 0/0 00000100:00100000:2.0:1746143838.582744:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13962 00000100:00100000:0.0:1746143838.585940:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.586472:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624967808 00000100:00100000:2.0:1746143838.586480:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624967808 00000100:00100000:2.0:1746143838.586534:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13963 00000100:00100000:2.0:1746143838.586540:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624967808:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143838.586558:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.586561:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143838.586583:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466600/0x87925e4cb73b4ea0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411916 expref: 8 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.586601:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.586605:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143838.586614:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b4eae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841191d expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.586687:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4eb5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.586697:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143838.586705:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4eb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143838.586713:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143838.587072:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b4eae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841191d expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.587084:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4eb5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841191d expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.587090:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.587092:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143838.587094:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:2.0:1746143838.587176:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2719:x1830963624967808:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 635us (1271us total) trans 8589945022 rc 0/0 00000100:00100000:2.0:1746143838.587183:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13963 00000100:00100000:0.0:1746143838.589218:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.590408:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624967936 00000100:00100000:2.0:1746143838.590416:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624967936 00000100:00100000:2.0:1746143838.590464:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13964 00000100:00100000:2.0:1746143838.590471:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2719:x1830963624967936:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143838.590490:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.590504:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b4ec3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411924 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.590549:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b4ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411924 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.590560:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b4ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411924 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.590574:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.590577:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143838.590579:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:2.0:1746143838.590615:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2719:x1830963624967936:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 144us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.590621:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13964 00000100:00100000:2.0:1746143838.594470:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.594488:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.594511:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.594524:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.594542:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968064 00000100:00100000:1.0:1746143838.594542:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968192 00000100:00100000:2.0:1746143838.594548:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968064 00000100:00100000:1.0:1746143838.594548:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968192 00000100:00100000:0.0:1746143838.594726:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968320 00000100:00100000:0.0:1746143838.594729:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968320 00000100:00100000:1.0:1746143838.594769:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968448 00000100:00100000:1.0:1746143838.594772:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968448 00000100:00100000:1.0:1746143838.594786:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16467 00000100:00100000:1.0:1746143838.594792:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624968192:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143838.594828:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.594846:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.594853:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.594860:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143838.594862:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16468 00010000:00010000:1.0:1746143838.594866:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.594868:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143838.594869:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624968448:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143838.594871:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.594888:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.594895:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 8 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.594897:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.594901:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.594902:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143838.594904:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.594905:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 8 pid: 1945 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143838.594930:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627462656:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.594933:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.594939:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.594946:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627462784:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143838.594987:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143838.594991:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16469 00010000:00010000:1.0:1746143838.594995:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 9 pid: 13430 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143838.594997:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624968320:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:1.0:1746143838.595007:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627462912:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143838.595011:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.595019:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.595029:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143838.595030:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143838.595032:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.595047:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.595054:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746143838.595061:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627463040:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.595250:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.595310:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16470 00000100:00100000:2.0:1746143838.595316:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624968064:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143838.595331:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595340:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595347:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.595354:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.595369:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.595371:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.595372:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595388:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.595396:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 8 pid: 9586 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.595404:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627463168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.595431:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.595438:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 10 pid: 13436 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.595450:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627463296:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.595471:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595479:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 25 pid: 9586 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.595487:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627463424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.595500:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.595529:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.595578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.595592:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968576 00000100:00100000:2.0:1746143838.595595:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968576 00000100:00100000:2.0:1746143838.595608:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968704 00000100:00100000:2.0:1746143838.595610:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968704 00000100:00100000:2.0:1746143838.595621:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16471 00000100:00100000:2.0:1746143838.595626:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624968576:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143838.595641:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595650:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595656:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.595667:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595672:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.595674:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.595676:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595688:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595695:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 25 pid: 1945 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.595703:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627463552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.595724:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.595731:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 11 pid: 1945 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.595738:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627463680:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.595755:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595767:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.595775:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627463808:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.595787:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143838.595800:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16472 00000100:00100000:2.0:1746143838.595805:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624968704:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143838.595818:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595827:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 8 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595834:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595839:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143838.595840:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143838.595842:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595854:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595861:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 24 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.595868:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627463936:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.595887:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 8 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.595894:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 8 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.595900:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627464064:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.595927:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143838.596526:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.596534:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 24 pid: 1945 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.596541:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627464192:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143838.596560:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.597245:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143838.615336:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627462656:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.615417:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627462784:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.615437:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.615524:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.615541:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.615572:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.615583:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.615600:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968832 00000100:00100000:1.0:1746143838.615605:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968832 00010000:00010000:1.0:1746143838.615630:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 9 pid: 1945 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143838.615648:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969088 00000100:00100000:1.0:1746143838.615649:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969088 00010000:00010000:1.0:1746143838.615658:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 9 pid: 9586 timeout: 997 lvb_type: 1 00000100:00100000:1.0:1746143838.615669:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969344 00000100:00100000:1.0:1746143838.615671:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969344 00010000:00010000:1.0:1746143838.615678:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 26 pid: 9586 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.615690:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8023 00000100:00100000:1.0:1746143838.615695:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2010:x1830963624968832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.615706:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.615722:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 9 pid: 1945 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.615817:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8024 00000100:00100000:2.0:1746143838.615825:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2010:x1830963624969088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.615832:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.615844:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 9 pid: 9586 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.615851:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 9 pid: 9586 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.615869:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.615899:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2010:x1830963624969088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.615904:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8024 00000100:00100000:2.0:1746143838.615937:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8025 00000100:00100000:2.0:1746143838.615941:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624969344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.615947:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.615953:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 26 pid: 9586 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.615959:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 26 pid: 9586 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.615968:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.615979:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624969344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.615983:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8025 00010000:00010000:2.0:1746143838.616004:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5c00/0x87925e4cb73b4d88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411852 expref: 8 pid: 9586 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.616016:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627463168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.616024:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627463296:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.616032:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e513600/0x87925e4cb73b4d81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841184b expref: 25 pid: 9586 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.616038:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627463424:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.616052:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.616091:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.616104:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969216 00000100:00100000:2.0:1746143838.616107:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969216 00010000:00010000:2.0:1746143838.616119:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 12 pid: 13436 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.616137:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8026 00000100:00100000:2.0:1746143838.616142:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963624969216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.616147:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.616154:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 12 pid: 13436 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.616161:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 12 pid: 13436 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.616172:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf14000/0x87925e4cb73b4e6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118ec expref: 12 pid: 13436 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.616179:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.616181:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.616184:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616190:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616205:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.616219:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963624969216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.616224:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8026 00010000:00010000:2.0:1746143838.616240:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616246:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616259:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616264:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616270:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616275:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7f200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143838.616278:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616284:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616292:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.616296:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b4edf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.616332:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624968064:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 21017us (21867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.616338:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16470 00000100:00100000:2.0:1746143838.616408:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627463552:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143838.616430:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624968960 00000100:00100000:0.0:1746143838.616433:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624968960 00002000:00100000:0.0:1746143838.616457:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1568767) req@ffff88009e491c00 x1830963624968960/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143838.616465:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491c00 with x1830963624968960 ext(1048576->1568767) 00010000:00010000:0.0:1746143838.616470:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:0.0:1746143838.616479:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.616480:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627463680:192.168.202.3@tcp:104: 00002000:00010000:0.0:1746143838.616485:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e491c00 00000100:00100000:0.0:1746143838.616496:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2655 00000100:00100000:0.0:1746143838.616500:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624968960:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143838.616501:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.616510:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969472 00000100:00100000:2.0:1746143838.616512:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969472 00010000:00010000:2.0:1746143838.616520:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 10 pid: 1945 timeout: 997 lvb_type: 1 00000100:00100000:2.0:1746143838.616531:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8027 00000100:00100000:2.0:1746143838.616534:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624969472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.616539:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.616545:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 10 pid: 1945 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.616551:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 10 pid: 1945 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.616560:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25800/0x87925e4cb73b4e7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411908 expref: 10 pid: 1945 timeout: 997 lvb_type: 1 00010000:00010000:2.0:1746143838.616568:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143838.616580:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624969472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.616584:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8027 00000100:00100000:2.0:1746143838.616625:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627463808:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143838.616637:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.616654:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627463936:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143838.616679:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627464064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143838.616788:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 9 pid: 1945 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746143838.616803:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b4e0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841189f expref: 9 pid: 1945 timeout: 997 lvb_type: 1 00010000:00010000:1.0:1746143838.616815:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.616835:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963624968832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1139us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.616840:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8023 00000100:00100000:1.0:1746143838.616867:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.616902:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.616925:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969728 00000100:00100000:1.0:1746143838.616927:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969728 00010000:00010000:1.0:1746143838.616937:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.616950:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8028 00000100:00100000:1.0:1746143838.616954:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624969728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.616961:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.616970:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.616976:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.616987:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b4e14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118a6 expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.616994:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.617010:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624969728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.617015:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8028 00000100:00100000:1.0:1746143838.617044:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969600 00000100:00100000:1.0:1746143838.617047:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969600 00002000:00100000:1.0:1746143838.617059:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2641920->3117055) req@ffff880087df4000 x1830963624969600/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.617066:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4000 with x1830963624969600 ext(2641920->3117055) 00010000:00010000:1.0:1746143838.617075:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 8 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617082:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 8 pid: 3135 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.617088:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df4000 00000100:00100000:1.0:1746143838.617100:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2656 00000100:00100000:1.0:1746143838.617104:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963624969600:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143838.617189:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.617200:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969856 00000100:00100000:1.0:1746143838.617203:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969856 00010000:00010000:1.0:1746143838.617212:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.617226:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8029 00000100:00100000:1.0:1746143838.617230:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2011:x1830963624969856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.617236:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.617244:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617251:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617262:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b4d9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411867 expref: 8 pid: 9586 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617271:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.617285:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963624969856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.617290:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8029 00000100:00100000:1.0:1746143838.617340:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627462912:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143838.617421:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627464192:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143838.617438:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.617468:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.617477:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624970112 00000100:00100000:1.0:1746143838.617479:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624970112 00010000:00010000:1.0:1746143838.617488:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 27 pid: 1945 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.617499:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8030 00000100:00100000:1.0:1746143838.617503:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963624970112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.617508:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.617514:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 27 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617521:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 27 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617530:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b4df8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841188a expref: 27 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.617537:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.617538:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.617540:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617546:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617557:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.617568:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624970112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 65us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.617572:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8030 00000100:00100000:1.0:1746143838.617609:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bde680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627463040:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143838.617618:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617634:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617640:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617649:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617655:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617660:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617665:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189de00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143838.617667:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617673:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617680:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.617685:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b4ee6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.617712:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624968576:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 22086us (22183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.617718:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16471 00010000:00010000:2.0:1746143838.619559:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143838.620188:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.620294:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.620314:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624969984 00000100:00100000:0.0:1746143838.620319:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624969984 00010000:00010000:0.0:1746143838.620342:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 11 pid: 13430 timeout: 997 lvb_type: 1 00000100:00100000:0.0:1746143838.620377:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8031 00000100:00100000:0.0:1746143838.620384:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624969984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143838.620393:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143838.620406:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 11 pid: 13430 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143838.620414:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 11 pid: 13430 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143838.620429:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408fa00/0x87925e4cb73b4e84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118f3 expref: 11 pid: 13430 timeout: 997 lvb_type: 1 00010000:00010000:0.0:1746143838.620446:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143838.620470:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624969984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143838.620475:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8031 00000100:00100000:3.0:1746143838.620553:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624970240 00000100:00100000:3.0:1746143838.620560:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624970240 00002000:00100000:3.0:1746143838.620581:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1654784->2097151) req@ffff880091bddc00 x1830963624970240/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/0 e 0 to 0 dl 1746143849 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.620588:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963624970240 ext(1654784->2097151) 00010000:00010000:3.0:1746143838.620594:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.620602:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 24 pid: 3135 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143838.620607:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bddc00 00000100:00100000:3.0:1746143838.620617:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2657 00000100:00100000:3.0:1746143838.620622:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963624970240:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143838.625758:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.627595:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624970368 00000100:00100000:3.0:1746143838.627606:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624970368 00010000:00010000:3.0:1746143838.627637:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 26 pid: 1945 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.627674:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8032 00000100:00100000:3.0:1746143838.627681:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624970368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.627692:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.627710:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 26 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.627719:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 26 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.628295:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b4da4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841186e expref: 26 pid: 1945 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.628313:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.628314:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.628318:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.628325:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.628342:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.628390:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624970368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 709us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.628396:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8032 00010000:00010000:0.0:1746143838.628455:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628463:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628477:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628484:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628490:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628494:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143838.628497:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628503:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628517:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143838.628523:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b4eca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143838.628561:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624968192:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 33768us (34071us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143838.628569:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16467 00000100:00100000:1.0:1746143838.629894:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624968960:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13389us (14347us total) trans 17179873942 rc 0/0 00000100:00100000:1.0:1746143838.629904:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2655 00002000:00100000:1.0:1746143838.629945:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1568767) req@ffff88009e491c00 x1830963624968960/t17179873942(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.629953:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491c00 with x1830963624968960 ext(1048576->1568767) 00010000:00010000:1.0:1746143838.629960:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.629970:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.629975:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e491c00 00000100:00100000:1.0:1746143838.633987:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624969600:12345-192.168.202.3@tcp:4:cat.0 Request processed in 16874us (17111us total) trans 21474841215 rc 0/0 00000100:00100000:1.0:1746143838.633998:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2656 00002000:00100000:1.0:1746143838.634008:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2641920->3117055) req@ffff880087df4000 x1830963624969600/t21474841215(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143838.634016:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4000 with x1830963624969600 ext(2641920->3117055) 00010000:00010000:1.0:1746143838.634025:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.634038:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 997 lvb_type: 0 00002000:00010000:1.0:1746143838.634043:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df4000 00000100:00100000:3.0:1746143838.635630:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963624970240:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15002us (15440us total) trans 21474841216 rc 0/0 00000100:00100000:3.0:1746143838.635640:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2657 00002000:00100000:3.0:1746143838.635647:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1654784->2097151) req@ffff880091bddc00 x1830963624970240/t21474841216(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:234/0 lens 488/448 e 0 to 0 dl 1746143849 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143838.635655:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963624970240 ext(1654784->2097151) 00010000:00010000:3.0:1746143838.635662:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.635671:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00002000:00010000:3.0:1746143838.635676:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bddc00 00000100:00100000:0.0:1746143838.636655:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.636867:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624970496 00000100:00100000:3.0:1746143838.636874:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624970496 00010000:00010000:3.0:1746143838.637776:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.637810:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8033 00000100:00100000:3.0:1746143838.637818:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963624970496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.637829:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.637845:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.637854:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.637874:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b4e37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1568767) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118c9 expref: 26 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.637897:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.637899:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.637902:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.637909:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.638318:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.638370:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963624970496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 542us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.638376:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8033 00010000:00010000:2.0:1746143838.638685:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638692:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638707:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638713:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638719:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638729:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd87000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143838.638733:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638739:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638750:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.638756:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b4ed1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.638808:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963624968448:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 43939us (44282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.638816:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16468 00000100:00100000:0.0:1746143838.638942:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.639383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.639427:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624970624 00000100:00100000:1.0:1746143838.639434:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624970624 00010000:00010000:1.0:1746143838.639453:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.639468:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624970752 00000100:00100000:1.0:1746143838.639470:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624970752 00010000:00010000:1.0:1746143838.639478:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.639492:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8034 00000100:00100000:1.0:1746143838.639498:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624970624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.639507:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.639519:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.639527:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.639541:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b4e06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3117055) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411898 expref: 10 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.639553:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.639555:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.639558:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639565:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639585:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.639603:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624970624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.639608:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8034 00000100:00100000:1.0:1746143838.639619:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8035 00000100:00100000:1.0:1746143838.639623:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624970752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.639629:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.639636:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.639645:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.639660:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b4e29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484118bb expref: 25 pid: 3135 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.639669:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.639670:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.639673:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639678:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639690:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.639703:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963624970752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.639708:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8035 00010000:00010000:1.0:1746143838.639745:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639752:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639768:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639774:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639783:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639787:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2dba00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143838.639789:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639795:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639803:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143838.639807:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b4ed8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143838.639839:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963624968320:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 44842us (45326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.639845:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16469 00010000:00010000:2.0:1746143838.643064:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643079:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643107:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643114:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643120:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643126:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189d600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143838.643129:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643135:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643150:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143838.643155:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189d600/0x87925e4cb73b4eed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143838.643478:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963624968704:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 47670us (47895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.643486:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16472 00000100:00100000:0.0:1746143838.646333:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.646410:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971008 00000100:00100000:3.0:1746143838.646419:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971008 00000100:00100000:3.0:1746143838.646521:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13965 00000100:00100000:3.0:1746143838.646528:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2719:x1830963624971008:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:3.0:1746143838.646566:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.646589:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b4ec3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411924 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649352:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.649368:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143838.649403:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.649419:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649426:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649432:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649437:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649444:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649449:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.649482:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649496:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 275 pid: 7245 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.649507:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464320:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.649853:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649862:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 23 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.649868:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464448:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.649890:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649896:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 23 pid: 7244 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.649902:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464576:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.649943:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649948:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 23 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.649954:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464704:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143838.649970:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.649975:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.649980:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464832:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.649990:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143838.652055:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.652063:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464320:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.652070:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464448:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.652076:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464576:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.652080:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092146300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464704:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143838.652086:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627464832:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143838.652087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143838.652108:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143838.652114:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.652125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143838.652251:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971264 00000100:00100000:1.0:1746143838.652257:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971264 00010000:00010000:1.0:1746143838.652284:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 276 pid: 7245 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.652315:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971136 00000100:00100000:1.0:1746143838.652318:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971136 00010000:00010000:1.0:1746143838.652327:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 24 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.652335:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971520 00000100:00100000:1.0:1746143838.652337:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971392 00000100:00100000:3.0:1746143838.652339:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971520 00000100:00100000:1.0:1746143838.652339:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971392 00010000:00010000:1.0:1746143838.652346:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 26 pid: 7244 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.652352:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 26 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.652355:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8036 00000100:00100000:1.0:1746143838.652374:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+276:2010:x1830963624971264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143838.652378:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8037 00000100:00100000:3.0:1746143838.652382:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963624971136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.652384:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.652388:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143838.652389:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 276 pid: 7245 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.652396:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 26 pid: 10936 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.652397:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 276 pid: 7245 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.652404:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 26 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:2.0:1746143838.652448:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8038 00000100:00100000:2.0:1746143838.652457:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963624971392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143838.652464:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143838.652468:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 26 pid: 7244 timeout: 997 lvb_type: 0 00000100:00100000:0.0:1746143838.652576:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143838.652665:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b4b4a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841172c expref: 276 pid: 7245 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.652672:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b4b43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411725 expref: 26 pid: 10936 timeout: 997 lvb_type: 0 00010000:00010000:2.0:1746143838.652672:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 26 pid: 7244 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.652682:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143838.652686:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143838.652693:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143838.652696:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.652697:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b4b3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841171e expref: 25 pid: 7244 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.652699:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.652705:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143838.652705:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143838.652707:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143838.652711:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.652719:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+275:2010:x1830963624971264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 358us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.652722:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963624971136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 339us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.652722:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963624971392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 269us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.652726:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8036 00000100:00100000:3.0:1746143838.652729:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8037 00000100:00100000:2.0:1746143838.652731:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8038 00000100:00100000:1.0:1746143838.652737:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971648 00000100:00100000:1.0:1746143838.652739:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971648 00000100:00100000:3.0:1746143838.652745:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8039 00010000:00010000:1.0:1746143838.652747:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 997 lvb_type: 0 00000100:00100000:3.0:1746143838.652751:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963624971520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143838.652757:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.652760:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 22 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.652769:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8040 00010000:00010000:3.0:1746143838.652771:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 22 pid: 10936 timeout: 997 lvb_type: 0 00000100:00100000:1.0:1746143838.652773:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+275:2011:x1830963624971648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143838.652779:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143838.652780:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0800/0x87925e4cb73b4bb3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411764 expref: 22 pid: 10936 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.652781:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.652788:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 997 lvb_type: 0 00010000:00010000:3.0:1746143838.652793:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.652796:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.652800:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143838.652823:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963624971520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.652827:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8039 00010000:00010000:1.0:1746143838.654086:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2e00/0x87925e4cb73b4ba5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841175d expref: 275 pid: 7245 timeout: 997 lvb_type: 0 00010000:00010000:1.0:1746143838.654096:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143838.654100:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143838.654106:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143838.654111:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143838.654140:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143838.654169:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+274:2011:x1830963624971648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1394us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.654176:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8040 00010000:00010000:3.0:1746143838.654491:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.654498:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:3.0:1746143838.654703:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3230, 88 off272096 00000004:00080000:3.0:1746143838.654709:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878796815ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654736:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3226, 88 off271392 00000004:00080000:3.0:1746143838.654740:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878828359ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654767:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3227, 88 off271480 00000004:00080000:3.0:1746143838.654770:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878857461ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654777:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3231, 88 off272184 00000004:00080000:3.0:1746143838.654779:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878866608ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654786:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3232, 88 off272272 00000004:00080000:3.0:1746143838.654788:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878875495ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654794:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3228, 88 off271568 00000004:00080000:3.0:1746143838.654797:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878884538ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654804:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3229, 88 off271656 00000004:00080000:3.0:1746143838.654806:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878893765ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654812:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3230, 88 off271744 00000004:00080000:3.0:1746143838.654814:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878902424ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654821:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3233, 88 off272360 00000004:00080000:3.0:1746143838.654823:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878911251ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654829:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3231, 88 off271832 00000004:00080000:3.0:1746143838.654831:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878919245ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654837:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3234, 88 off272448 00000004:00080000:3.0:1746143838.654839:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878927433ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654845:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3232, 88 off271920 00000004:00080000:3.0:1746143838.654847:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878935293ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143838.654854:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3235, 88 off272536 00000004:00080000:3.0:1746143838.654856:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878944129ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654862:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3236, 88 off272624 00000004:00080000:3.0:1746143838.654864:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878952194ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654871:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3237, 88 off272712 00000004:00080000:3.0:1746143838.654873:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878960744ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654880:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3238, 88 off272800 00000004:00080000:3.0:1746143838.654882:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897878970029ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143838.654889:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3233, 88 off272008 00000004:00080000:3.0:1746143838.654890:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897878978334ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143838.656450:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945023 is committed 00000004:00080000:2.0:1746143838.656457:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2446 committed 00000004:00080000:2.0:1746143838.657068:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2454 committed 00000004:00080000:2.0:1746143838.657074:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2453 committed 00000004:00080000:2.0:1746143838.657075:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2452 committed 00000004:00080000:2.0:1746143838.657077:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2451 committed 00000004:00080000:2.0:1746143838.657078:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2445 committed 00000004:00080000:2.0:1746143838.657079:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2450 committed 00000004:00080000:2.0:1746143838.657081:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2444 committed 00000004:00080000:2.0:1746143838.657082:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2449 committed 00000004:00080000:2.0:1746143838.657083:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2443 committed 00000004:00080000:2.0:1746143838.657084:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2442 committed 00000004:00080000:2.0:1746143838.657086:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2441 committed 00000004:00080000:2.0:1746143838.657087:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2448 committed 00000004:00080000:2.0:1746143838.657089:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2447 committed 00000004:00080000:2.0:1746143838.657090:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2440 committed 00000004:00080000:2.0:1746143838.657092:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2439 committed 00000004:00080000:2.0:1746143838.657093:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2446 committed 00000001:00080000:2.0:1746143838.657103:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945020 is committed 00000001:00080000:2.0:1746143838.657111:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945018 is committed 00000100:00100000:1.0:1746143838.657282:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627464960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657327:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143838.657346:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627465472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657371:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143838.657388:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143838.657393:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627465344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657406:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143838.657414:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627465856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657424:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143838.657442:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627464960 00000100:00100000:1.0:1746143838.657447:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627464960 00000100:00100000:1.0:1746143838.657471:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465472 00000100:00100000:1.0:1746143838.657473:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465472 00000100:00100000:1.0:1746143838.657481:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465344 00000100:00100000:1.0:1746143838.657482:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465344 00000100:00100000:1.0:1746143838.657489:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465856 00000100:00100000:1.0:1746143838.657490:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465856 00000100:00100000:1.0:1746143838.657500:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16473 00000100:00100000:1.0:1746143838.657506:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963627464960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657610:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963627464960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (282us total) trans 21474841217 rc 0/0 00000100:00100000:1.0:1746143838.657615:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16473 00000100:00100000:0.0:1746143838.657622:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16474 00000100:00100000:1.0:1746143838.657627:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16475 00000100:00100000:0.0:1746143838.657630:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963627465472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657631:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963627465344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143838.657670:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143838.657673:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143838.657675:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143838.657677:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143838.657679:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143838.657696:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627465472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (336us total) trans 21474841219 rc 0/0 00000100:00100000:1.0:1746143838.657697:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627465344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (290us total) trans 21474841218 rc 0/0 00000100:00100000:0.0:1746143838.657701:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16474 00000100:00100000:1.0:1746143838.657704:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16475 00000100:00100000:0.0:1746143838.657712:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16476 00000100:00100000:0.0:1746143838.657716:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3772:x1830963627465856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143838.657738:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841209 gen 2 00000004:00080000:1.0:1746143838.657743:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bbb80, transno 21474841160 00000004:00080000:1.0:1746143838.657748:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9f80, transno 21474841161 00000004:00080000:1.0:1746143838.657750:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9880, transno 21474841162 00000004:00080000:1.0:1746143838.657751:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9500, transno 21474841163 00000004:00080000:1.0:1746143838.657753:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b8000, transno 21474841164 00000004:00080000:1.0:1746143838.657755:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b8a80, transno 21474841165 00000004:00080000:1.0:1746143838.657757:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bb100, transno 21474841166 00000004:00080000:1.0:1746143838.657759:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bb480, transno 21474841167 00000004:00080000:1.0:1746143838.657761:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972eaa00, transno 21474841168 00000004:00080000:1.0:1746143838.657763:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972e9c00, transno 21474841169 00000004:00080000:1.0:1746143838.657765:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972e9880, transno 21474841170 00000100:00100000:0.0:1746143838.657767:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3772:x1830963627465856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (341us total) trans 21474841220 rc 0/0 00000004:00080000:1.0:1746143838.657768:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972eb800, transno 21474841171 00000004:00080000:1.0:1746143838.657770:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972e9f80, transno 21474841172 00000004:00080000:1.0:1746143838.657772:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972ea680, transno 21474841173 00000100:00100000:0.0:1746143838.657772:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16476 00000004:00080000:1.0:1746143838.657774:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972ea300, transno 21474841174 00000004:00080000:1.0:1746143838.657775:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972e9180, transno 21474841175 00000004:00080000:1.0:1746143838.657778:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6f800, transno 21474841186 00000004:00080000:1.0:1746143838.657780:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4ce00, transno 21474841187 00000004:00080000:1.0:1746143838.657781:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6f480, transno 21474841188 00000004:00080000:1.0:1746143838.657783:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4c000, transno 21474841189 00000004:00080000:1.0:1746143838.657785:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6c000, transno 21474841190 00000004:00080000:1.0:1746143838.657787:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4d880, transno 21474841191 00000004:00080000:1.0:1746143838.657789:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6ea00, transno 21474841192 00000004:00080000:1.0:1746143838.657791:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4df80, transno 21474841193 00000004:00080000:1.0:1746143838.657793:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f7a300, transno 21474841194 00000004:00080000:1.0:1746143838.657794:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78a80, transno 21474841195 00000004:00080000:1.0:1746143838.657796:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78000, transno 21474841196 00000004:00080000:1.0:1746143838.657798:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f7b100, transno 21474841197 00000004:00080000:1.0:1746143838.657800:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f79880, transno 21474841198 00000004:00080000:1.0:1746143838.657802:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f7a680, transno 21474841199 00000004:00080000:1.0:1746143838.657803:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78e00, transno 21474841200 00000004:00080000:1.0:1746143838.657805:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093f78700, transno 21474841201 00000004:00080000:1.0:1746143838.657807:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e79c00, transno 21474841202 00000004:00080000:1.0:1746143838.657809:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78700, transno 21474841203 00000004:00080000:1.0:1746143838.657810:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e79880, transno 21474841204 00000004:00080000:1.0:1746143838.657812:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e79f80, transno 21474841205 00000004:00080000:1.0:1746143838.657814:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78a80, transno 21474841206 00000004:00080000:1.0:1746143838.657816:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7b100, transno 21474841207 00000004:00080000:1.0:1746143838.657817:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7ad80, transno 21474841208 00000004:00080000:1.0:1746143838.657819:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7b800, transno 21474841209 00000100:00100000:1.0:1746143838.657824:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880087df4700 x1830963627465344/t21474841218(21474841218) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143854 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143838.657831:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880087df4700/2, rc 0, transno 21474841218 00000100:00100000:1.0:1746143838.657835:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627465344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143838.657842:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c33b80/2, rc 0, transno 21474841220 00000100:00100000:1.0:1746143838.657845:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627465856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143838.657888:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143838.657923:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143838.657935:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143838.657947:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143838.657954:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143838.657966:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143838.657973:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143838.657984:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143838.657993:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746143838.657996:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143838.658008:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143838.658016:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143838.658025:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143838.658032:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143838.658042:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143838.658046:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465088 00000100:00100000:3.0:1746143838.658050:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143838.658050:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465088 00000100:00100000:3.0:1746143838.658061:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143838.658067:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465600 00000100:00100000:0.0:1746143838.658069:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465600 00000100:00100000:3.0:1746143838.658081:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466112 00000100:00100000:3.0:1746143838.658084:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466112 00000100:00100000:0.0:1746143838.658084:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466624 00000100:00100000:0.0:1746143838.658087:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466624 00000100:00100000:0.0:1746143838.658095:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465216 00000100:00100000:3.0:1746143838.658096:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465728 00000100:00100000:0.0:1746143838.658096:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465216 00000100:00100000:3.0:1746143838.658098:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465728 00000100:00100000:0.0:1746143838.658102:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466240 00000100:00100000:0.0:1746143838.658104:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466240 00000100:00100000:3.0:1746143838.658105:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466752 00000100:00100000:3.0:1746143838.658106:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466752 00000100:00100000:0.0:1746143838.658113:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16477 00000100:00100000:0.0:1746143838.658117:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627465088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143838.658143:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627466368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.658163:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143838.658171:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627466880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143838.658178:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627465088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (266us total) trans 21474841221 rc 0/0 00000100:00100000:2.0:1746143838.658181:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143838.658195:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143838.658201:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627465984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.658215:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143838.658221:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627466496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.658235:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143838.658248:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466368 00000100:00100000:2.0:1746143838.658250:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466368 00000100:00100000:3.0:1746143838.658333:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16478 00000100:00100000:0.0:1746143838.658338:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16477 00000100:00100000:3.0:1746143838.658339:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627465600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143838.658350:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466880 00000100:00100000:0.0:1746143838.658352:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466880 00000100:00100000:0.0:1746143838.658373:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627465984 00000100:00100000:0.0:1746143838.658375:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627465984 00000100:00100000:0.0:1746143838.658381:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627466496 00000100:00100000:0.0:1746143838.658383:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627466496 00002000:00010000:3.0:1746143838.658389:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00000100:00100000:0.0:1746143838.658390:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16479 00002000:00010000:3.0:1746143838.658391:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000100:00100000:0.0:1746143838.658393:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627466624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143838.658394:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143838.658395:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143838.658397:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143838.658414:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627465600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (466us total) trans 21474841222 rc 0/0 00000100:00100000:3.0:1746143838.658420:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16478 00000100:00100000:3.0:1746143838.658431:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16480 00000100:00100000:3.0:1746143838.658435:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143838.658459:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (474us total) trans 17179873943 rc 0/0 00000100:00100000:0.0:1746143838.658465:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16479 00000100:00100000:0.0:1746143838.658475:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16481 00000100:00100000:0.0:1746143838.658479:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627465216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143838.658484:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (517us total) trans 17179873944 rc 0/0 00000100:00100000:0.0:1746143838.658525:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627465216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (516us total) trans 21474841223 rc 0/0 00000100:00100000:0.0:1746143838.658530:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16481 00000100:00100000:0.0:1746143838.658538:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16482 00000100:00100000:0.0:1746143838.658542:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627465728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143838.658586:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627465728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (559us total) trans 21474841224 rc 0/0 00000100:00100000:0.0:1746143838.658591:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16482 00000100:00100000:0.0:1746143838.658600:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16483 00000100:00100000:0.0:1746143838.658604:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143838.658617:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16480 00000100:00100000:3.0:1746143838.658627:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16484 00000100:00100000:3.0:1746143838.658632:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143838.658647:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (604us total) trans 17179873945 rc 0/0 00000100:00100000:0.0:1746143838.658652:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16483 00000100:00100000:0.0:1746143838.658660:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16485 00000100:00100000:0.0:1746143838.658664:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627466880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143838.658665:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143838.658667:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143838.658669:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143838.658671:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143838.658673:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:3.0:1746143838.658688:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627466752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (626us total) trans 17179873946 rc 0/0 00000100:00100000:3.0:1746143838.658692:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16484 00002000:00010000:0.0:1746143838.658698:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00000100:00100000:3.0:1746143838.658700:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16486 00002000:00010000:0.0:1746143838.658700:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143838.658703:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746143838.658704:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627465984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143838.658704:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143838.658706:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143838.658727:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627466880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (544us total) trans 17179873947 rc 0/0 00000100:00100000:0.0:1746143838.658732:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16485 00000100:00100000:0.0:1746143838.658741:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16487 00000100:00100000:0.0:1746143838.658745:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627466496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143838.658747:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627465984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (531us total) trans 17179873948 rc 0/0 00000100:00100000:3.0:1746143838.658754:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16486 00000004:00080000:3.0:1746143838.658775:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880087df5180/2, rc 0, transno 21474841223 00000100:00100000:3.0:1746143838.658778:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143838.658784:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31f80/2, rc 0, transno 21474841224 00000100:00100000:3.0:1746143838.658787:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143838.658790:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627466496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (553us total) trans 17179873949 rc 0/0 00000100:00100000:3.0:1746143838.658794:0:3773:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873936 gen 2 00000100:00100000:0.0:1746143838.658795:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16487 00000004:00080000:3.0:1746143838.658796:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb5880, transno 17179873885 00000004:00080000:3.0:1746143838.658801:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdc380, transno 17179873886 00000004:00080000:3.0:1746143838.658804:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4380, transno 17179873887 00000004:00080000:3.0:1746143838.658805:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdd180, transno 17179873888 00000004:00080000:3.0:1746143838.658807:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bde300, transno 17179873889 00000004:00080000:3.0:1746143838.658809:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4a80, transno 17179873890 00000004:00080000:3.0:1746143838.658811:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdf800, transno 17179873891 00000004:00080000:3.0:1746143838.658812:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdf100, transno 17179873892 00000004:00080000:3.0:1746143838.658814:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdea00, transno 17179873893 00000004:00080000:3.0:1746143838.658816:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096941500, transno 17179873894 00000004:00080000:3.0:1746143838.658818:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096941c00, transno 17179873895 00000004:00080000:3.0:1746143838.658820:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096941180, transno 17179873896 00000004:00080000:3.0:1746143838.658821:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096940700, transno 17179873897 00000004:00080000:3.0:1746143838.658823:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096942d80, transno 17179873898 00000004:00080000:3.0:1746143838.658825:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096943b80, transno 17179873899 00000004:00080000:3.0:1746143838.658826:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096942680, transno 17179873900 00000004:00080000:3.0:1746143838.658828:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096941880, transno 17179873901 00000004:00080000:3.0:1746143838.658831:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6c700, transno 17179873902 00000004:00080000:3.0:1746143838.658833:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6aa00, transno 17179873910 00000004:00080000:3.0:1746143838.658835:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6a300, transno 17179873911 00000004:00080000:3.0:1746143838.658837:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c68a80, transno 17179873912 00000004:00080000:3.0:1746143838.658839:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6b480, transno 17179873913 00000004:00080000:3.0:1746143838.658841:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a6680, transno 17179873914 00000004:00080000:3.0:1746143838.658843:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c69c00, transno 17179873915 00000004:00080000:3.0:1746143838.658845:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6b100, transno 17179873916 00000004:00080000:3.0:1746143838.658846:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c69500, transno 17179873917 00000004:00080000:3.0:1746143838.658848:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c68000, transno 17179873918 00000004:00080000:3.0:1746143838.658850:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35bb80, transno 17179873919 00000100:00100000:2.0:1746143838.658943:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16488 00000100:00100000:2.0:1746143838.658948:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963627466368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.659003:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627466368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (839us total) trans 17179873950 rc 0/0 00000100:00100000:2.0:1746143838.659009:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16488 00000004:00080000:1.0:1746143838.659333:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880087df7b80/2, rc 0, transno 21474841217 00000100:00100000:1.0:1746143838.659338:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627464960:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143838.659346:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880087df6a00/2, rc 0, transno 21474841219 00000100:00100000:1.0:1746143838.659348:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627465472:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143838.659536:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 40 done 00000004:00080000:3.0:1746143838.659589:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35a680, transno 17179873920 00000004:00080000:3.0:1746143838.659591:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e359f80, transno 17179873921 00000004:00080000:3.0:1746143838.659594:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358a80, transno 17179873922 00000004:00080000:3.0:1746143838.659596:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35b480, transno 17179873923 00000004:00080000:3.0:1746143838.659598:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e359c00, transno 17179873924 00000004:00080000:3.0:1746143838.659600:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e35a300, transno 17179873925 00000004:00080000:3.0:1746143838.659602:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358e00, transno 17179873926 00000004:00080000:3.0:1746143838.659605:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7bb80, transno 17179873927 00000004:00080000:3.0:1746143838.659606:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136634000, transno 17179873928 00000004:00080000:3.0:1746143838.659608:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c72a00, transno 17179873929 00000004:00080000:3.0:1746143838.659610:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c71f80, transno 17179873930 00000004:00080000:3.0:1746143838.659612:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136635c00, transno 17179873931 00000004:00080000:3.0:1746143838.659613:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136635500, transno 17179873932 00000004:00080000:3.0:1746143838.659615:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093c70380, transno 17179873933 00000004:00080000:3.0:1746143838.659617:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136635f80, transno 17179873934 00000004:00080000:3.0:1746143838.659619:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094197100, transno 17179873935 00000004:00080000:3.0:1746143838.659621:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136637100, transno 17179873936 00000100:00100000:3.0:1746143838.659625:0:3773:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880136334380 x1830963627466240/t17179873945(17179873945) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143854 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746143838.659690:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334380/2, rc 0, transno 17179873945 00000100:00100000:3.0:1746143838.659694:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466240:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143838.659706:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b45880/2, rc 0, transno 17179873946 00000100:00100000:3.0:1746143838.659709:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466752:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143838.659715:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880087df5880/2, rc 0, transno 21474841221 00000100:00100000:3.0:1746143838.659717:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465088:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143838.659723:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880087df7100/2, rc 0, transno 21474841222 00000100:00100000:3.0:1746143838.659725:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627465600:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143838.659731:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136336a00/2, rc 0, transno 17179873944 00000100:00100000:3.0:1746143838.659733:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466112:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143838.659738:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136335500/2, rc 0, transno 17179873943 00000100:00100000:3.0:1746143838.659741:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627466624:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746143838.659777:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136334e00 reply state ffff8800a8283c00 transno 8589945023 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659792:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659799:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.659802:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143838.659805:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746143838.659859:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143838.659869:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624971008:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 13340us (13542us total) trans 8589945023 rc 0/0 00000100:00100000:3.0:1746143838.659874:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13965 00010000:00010000:3.0:1746143838.659891:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659897:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659903:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659908:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd87000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143838.659937:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659943:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659952:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.659954:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143838.659957:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.659961:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4ef4 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000004:00080000:2.0:1746143838.660209:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136337480/2, rc 0, transno 17179873948 00000100:00100000:2.0:1746143838.660213:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627465984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143838.660224:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136335c00/2, rc 0, transno 17179873949 00000100:00100000:2.0:1746143838.660227:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627466496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143838.660235:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334700/2, rc 0, transno 17179873950 00000100:00100000:2.0:1746143838.660238:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627466368:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143838.660243:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b47800/2, rc 0, transno 17179873947 00000004:00080000:0.0:1746143838.660244:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 47 in progress, 1 in flight, 6 done 00000100:00100000:2.0:1746143838.660246:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627466880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143838.660385:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 39 done 00000100:00100000:2.0:1746143838.660522:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746143838.660533:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627467008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.660558:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143838.660578:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627467008 00000100:00100000:2.0:1746143838.660581:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627467008 00000100:00100000:2.0:1746143838.660598:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16489 00000100:00100000:2.0:1746143838.660602:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627467008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.660668:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963627467008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (109us total) trans 17179873951 rc 0/0 00000100:00100000:2.0:1746143838.660673:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16489 00000004:00080000:3.0:1746143838.660805:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46a00/2, rc 0, transno 17179873951 00000100:00100000:3.0:1746143838.660809:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627467008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143838.663564:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.663640:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971776 00000100:00100000:3.0:1746143838.663647:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971776 00000100:00100000:3.0:1746143838.663698:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13966 00000100:00100000:3.0:1746143838.663706:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2719:x1830963624971776:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.663725:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.663746:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841192b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.663793:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.663805:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.663821:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.663823:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143838.663826:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53e00, rc 0) 00000100:00100000:3.0:1746143838.663873:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624971776:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 168us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.663879:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13966 00000100:00100000:0.0:1746143838.666880:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143838.667265:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624971904 00000100:00100000:2.0:1746143838.667272:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624971904 00000100:00100000:3.0:1746143838.667441:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13967 00000100:00100000:3.0:1746143838.667449:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624971904:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.667475:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.667491:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411932 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.667561:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.667572:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.667581:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143838.667605:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143838.667608:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143838.667620:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143838.667639:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.667669:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.667675:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143838.667677:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143838.667679:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53c00, rc 0) 00000100:00100000:3.0:1746143838.667727:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2719:x1830963624971904:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 279us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.667732:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13967 00000100:00100000:0.0:1746143838.675970:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.676002:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.676020:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.676048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143838.676063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.676082:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972032 00000100:00100000:3.0:1746143838.676090:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972032 00000100:00100000:3.0:1746143838.676126:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972288 00000100:00100000:3.0:1746143838.676128:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972288 00000100:00100000:3.0:1746143838.676140:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972544 00000100:00100000:3.0:1746143838.676142:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972544 00000100:00100000:3.0:1746143838.676149:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972160 00000100:00100000:3.0:1746143838.676151:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972160 00000100:00100000:3.0:1746143838.676159:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972416 00000100:00100000:3.0:1746143838.676161:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972416 00000100:00100000:3.0:1746143838.676179:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16490 00000100:00100000:3.0:1746143838.676186:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963624972032:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.676201:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.676217:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411939 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143838.676236:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a5e, atime: 0x68140a5d, ctime: 0x68140a5e, blocks: 0x748 00010000:00010000:3.0:1746143838.676251:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.676254:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.676261:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.676274:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.676288:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529600, rc 0) 00000100:00100000:3.0:1746143838.676323:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624972032:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.676323:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16491 00000100:00100000:3.0:1746143838.676328:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16490 00000100:00100000:1.0:1746143838.676330:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963624972288:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143838.676337:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143838.676340:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16492 00000100:00100000:3.0:1746143838.676343:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624972544:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143838.676346:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411947 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.676348:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.676353:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411955 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143838.676357:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a5e, atime: 0x68140a5a, ctime: 0x68140a5e, blocks: 0x808 00002000:00010000:3.0:1746143838.676372:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a5e, atime: 0x68140a5e, ctime: 0x68140a5e, blocks: 0x1510 00010000:00010000:1.0:1746143838.676375:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.676377:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143838.676377:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.676378:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.676381:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.676381:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.676389:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143838.676389:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.676396:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52400, rc 0) 00010000:00010000:1.0:1746143838.676396:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25000, rc 0) 00000100:00100000:3.0:1746143838.676410:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624972544:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 66us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.676415:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16492 00000100:00100000:3.0:1746143838.676424:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16493 00000100:00100000:3.0:1746143838.676428:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624972160:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.676432:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143838.676438:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411940 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143838.676447:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a5e, atime: 0x68140a5e, ctime: 0x68140a5e, blocks: 0x808 00000100:00100000:2.0:1746143838.676448:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16494 00010000:00010000:3.0:1746143838.676454:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143838.676454:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624972416:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143838.676456:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143838.676459:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.676459:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.676465:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841194e expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143838.676467:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143838.676473:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53800, rc 0) 00002000:00010000:2.0:1746143838.676474:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a5e, atime: 0x68140a59, ctime: 0x68140a5e, blocks: 0x808 00010000:00010000:2.0:1746143838.676480:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.676481:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.676484:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.676543:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.676549:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5acc00, rc 0) 00000100:00100000:1.0:1746143838.676585:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624972288:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 256us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143838.676590:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16491 00000100:00100000:3.0:1746143838.677155:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624972160:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 726us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143838.677160:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16493 00000100:00100000:0.0:1746143838.677339:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143838.677397:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972672 00000100:00100000:3.0:1746143838.677401:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972672 00000100:00100000:2.0:1746143838.677519:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624972416:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 1065us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.677524:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16494 00000100:00100000:2.0:1746143838.677537:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16495 00000100:00100000:2.0:1746143838.677542:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624972672:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143838.677549:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143838.677558:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841195c expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143838.677568:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a5e, atime: 0x68140a5e, ctime: 0x68140a5e, blocks: 0x1008 00010000:00010000:2.0:1746143838.677577:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.677578:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143838.677582:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.677591:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 10 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143838.677598:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad600, rc 0) 00000100:00100000:2.0:1746143838.677613:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624972672:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143838.677617:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16495 00010000:00010000:3.0:1746143838.968016:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143839.684382:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.684428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.684983:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.685297:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.685313:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972928 00000100:00100000:2.0:1746143839.685321:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972928 00000100:00100000:2.0:1746143839.685368:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624972800 00000100:00100000:2.0:1746143839.685371:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624972800 00000100:00100000:2.0:1746143839.685388:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973184 00000100:00100000:2.0:1746143839.685390:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973184 00000100:00100000:2.0:1746143839.685402:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16496 00000100:00100000:2.0:1746143839.685409:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624972928:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.685506:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624972928:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 96us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.685512:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16496 00000100:00100000:2.0:1746143839.685527:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16497 00000100:00100000:2.0:1746143839.685532:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624972800:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.685569:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624972800:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 36us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.685574:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16497 00000100:00100000:2.0:1746143839.685583:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16498 00000100:00100000:2.0:1746143839.685587:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624973184:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.685612:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624973184:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.685616:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16498 00000100:00100000:3.0:1746143839.686086:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973056 00000100:00100000:3.0:1746143839.686090:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973056 00000100:00100000:3.0:1746143839.686119:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16499 00000100:00100000:3.0:1746143839.686124:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624973056:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:3.0:1746143839.686188:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624973056:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 63us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.686193:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16499 00000100:00100000:0.0:1746143839.686516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.686548:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.687517:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973312 00000100:00100000:3.0:1746143839.687521:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973312 00000100:00100000:3.0:1746143839.687543:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973440 00000100:00100000:3.0:1746143839.687545:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973440 00000100:00100000:3.0:1746143839.687563:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16500 00000100:00100000:3.0:1746143839.687570:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624973312:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:3.0:1746143839.687624:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624973312:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 54us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.687629:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16500 00000100:00100000:3.0:1746143839.687783:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16501 00000100:00100000:3.0:1746143839.687788:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624973440:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:3.0:1746143839.687820:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624973440:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 33us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.687825:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16501 00000100:00100000:0.0:1746143839.691407:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.691445:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.691650:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.691663:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.691773:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.691978:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.691993:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973696 00000100:00100000:2.0:1746143839.692002:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973696 00000100:00100000:2.0:1746143839.692035:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973952 00000100:00100000:2.0:1746143839.692037:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973952 00000100:00100000:3.0:1746143839.692102:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624974208 00000100:00100000:3.0:1746143839.692105:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624974208 00000100:00100000:2.0:1746143839.692326:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973568 00000100:00100000:2.0:1746143839.692329:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973568 00000100:00100000:2.0:1746143839.692343:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624973824 00000100:00100000:2.0:1746143839.692345:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624973824 00000100:00100000:2.0:1746143839.692363:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624974080 00000100:00100000:2.0:1746143839.692365:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624974080 00000100:00100000:2.0:1746143839.692382:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16502 00000100:00100000:2.0:1746143839.692389:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624973696:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.692474:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624973696:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 86us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.692480:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16502 00000100:00100000:2.0:1746143839.692494:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16503 00000100:00100000:2.0:1746143839.692499:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624973952:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.692531:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624973952:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 31us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.692536:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16503 00000100:00100000:2.0:1746143839.692544:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16504 00000100:00100000:2.0:1746143839.692548:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624974208:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.692572:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624974208:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 24us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.692577:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16504 00000100:00100000:2.0:1746143839.692586:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16505 00000100:00100000:2.0:1746143839.692590:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624973568:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.692614:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963624973568:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 23us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.692618:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16505 00000100:00100000:2.0:1746143839.692625:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16506 00000100:00100000:2.0:1746143839.692629:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624973824:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.692651:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624973824:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 21us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.692655:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16506 00000100:00100000:2.0:1746143839.692662:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16507 00000100:00100000:2.0:1746143839.692666:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624974080:12345-192.168.202.3@tcp:23:mirror_io.0 00000100:00100000:2.0:1746143839.692687:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624974080:12345-192.168.202.3@tcp:23:mirror_io.0 Request processed in 21us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.692692:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16507 00000100:00100000:0.0:1746143839.699341:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.699740:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624974336 00000100:00100000:2.0:1746143839.699748:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624974336 00000100:00100000:2.0:1746143839.699842:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16508 00000100:00100000:2.0:1746143839.699851:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624974336:12345-192.168.202.3@tcp:22:mirror_io.0 00002000:00010000:2.0:1746143839.700025:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143839.700028:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143839.700030:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143839.700032:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143839.700033:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143839.700295:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c490050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624974336:12345-192.168.202.3@tcp:22:mirror_io.0 Request processed in 445us (961us total) trans 21474841225 rc 0/0 00000100:00100000:2.0:1746143839.700306:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16508 00000100:00100000:0.0:1746143839.703140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.703695:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624974464 00000100:00100000:2.0:1746143839.703703:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624974464 00000100:00100000:2.0:1746143839.703967:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16509 00000100:00100000:2.0:1746143839.703975:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624974464:12345-192.168.202.3@tcp:22:mirror_io.0 00002000:00010000:2.0:1746143839.704134:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143839.704137:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143839.704139:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143839.704140:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143839.704142:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:2.0:1746143839.704465:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624974464:12345-192.168.202.3@tcp:22:mirror_io.0 Request processed in 489us (1329us total) trans 17179873952 rc 0/0 00000100:00100000:2.0:1746143839.704471:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16509 00000100:00100000:0.0:1746143839.712719:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.712747:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.712767:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.712793:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.712825:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624974720 00000100:00100000:0.0:1746143839.712831:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624974720 00000100:00100000:0.0:1746143839.712869:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624974976 00000100:00100000:0.0:1746143839.712870:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624974976 00000100:00100000:0.0:1746143839.712880:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624975232 00000100:00100000:0.0:1746143839.712881:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624975232 00000100:00100000:0.0:1746143839.712891:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624975488 00000100:00100000:0.0:1746143839.712892:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624975488 00000100:00100000:0.0:1746143839.712902:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7167 00000100:00100000:0.0:1746143839.712908:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624974720:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143839.712954:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.712966:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.712967:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.712971:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.712981:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.713092:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7168 00000100:00100000:2.0:1746143839.713101:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963624974976:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143839.713118:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.713125:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143839.713126:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143839.713129:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.713137:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143839.713493:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7169 00000100:00100000:0.0:1746143839.713499:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624975232:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143839.713513:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.713521:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.713522:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.713524:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.713532:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.714332:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7170 00000100:00100000:2.0:1746143839.714340:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963624975488:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:2.0:1746143839.714367:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.714375:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143839.714376:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143839.714378:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.714386:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143839.718742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.718773:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.718796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.718814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.718849:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624975744 00000100:00100000:0.0:1746143839.718856:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624975744 00000100:00100000:0.0:1746143839.718896:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624976000 00000100:00100000:0.0:1746143839.718898:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624976000 00000100:00100000:0.0:1746143839.718926:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624976256 00000100:00100000:0.0:1746143839.718928:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624976256 00000100:00100000:0.0:1746143839.718940:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624976512 00000100:00100000:0.0:1746143839.718941:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624976512 00000100:00100000:0.0:1746143839.718954:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7171 00000100:00100000:0.0:1746143839.718961:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963624975744:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143839.718989:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.718999:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.719001:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.719005:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.719020:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143839.719609:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7172 00000100:00100000:0.0:1746143839.719615:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2009:x1830963624976000:12345-192.168.202.3@tcp:3:mirror_io.0 00000100:00100000:3.0:1746143839.719627:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7173 00010000:00010000:0.0:1746143839.719631:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.719633:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963624976256:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143839.719638:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.719639:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.719642:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.719645:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.719650:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.719655:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.719656:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.719659:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.719665:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143839.720213:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7174 00000100:00100000:0.0:1746143839.720219:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963624976512:12345-192.168.202.3@tcp:3:mirror_io.0 00010000:00010000:0.0:1746143839.720233:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.720239:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.720240:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.720242:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.720248:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735684:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735697:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735704:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735708:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143839.735711:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735718:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735733:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.735738:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b4f3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.735825:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963624974720:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 22913us (23110us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1746143839.735835:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7167 00010000:00010000:2.0:1746143839.743816:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.743830:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.743837:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.743843:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7d400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143839.743846:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.743853:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.743867:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.743878:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d400/0x87925e4cb73b4f41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.745123:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963624974976:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 32018us (32368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.745134:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7168 00010000:00010000:3.0:1746143839.748378:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.748393:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.748400:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.748406:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143839.748409:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.748416:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.748431:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.748437:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c800/0x87925e4cb73b4f4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.748501:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963624975488:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 34157us (35701us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.748511:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7170 00010000:00010000:1.0:1746143839.752513:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.752527:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.752534:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.752541:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5aac00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143839.752544:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.753712:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.753730:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.753745:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b4f48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143839.753822:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963624975232:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 40320us (41050us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143839.753832:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7169 00010000:00010000:0.0:1746143839.754939:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.754951:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.754959:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.754965:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143839.754969:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.754976:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.754987:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.754994:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b4f56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143839.756297:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963624975744:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 37332us (37557us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143839.756306:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7171 00010000:00010000:2.0:1746143839.757089:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.757098:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.757104:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.757109:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143839.757112:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.757118:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.757139:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.757144:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b4f5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.757198:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963624976000:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 37582us (38423us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.757204:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7172 00010000:00010000:3.0:1746143839.761623:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.761636:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.761643:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.761650:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a53400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143839.761654:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.761661:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.761676:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.761682:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53400/0x87925e4cb73b4f64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.761752:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624976256:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 42115us (42950us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.761761:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7173 00010000:00010000:2.0:1746143839.763877:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.763890:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.763896:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.763901:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143839.763904:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.763927:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.763940:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.763945:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b4f6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.764001:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624976512:12345-192.168.202.3@tcp:3:mirror_io.0 Request processed in 43779us (45183us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.764009:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7174 00000100:00100000:0.0:1746143839.769822:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.769884:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624976640 00000100:00100000:1.0:1746143839.769892:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624976640 00000100:00080000:2.0:1746143839.769977:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143839.769978:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 991 00000100:00100000:1.0:1746143839.769985:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2719:x1830963624976640:12345-192.168.202.3@tcp:103:mirror_io.0 00010000:00010000:1.0:1746143839.769998:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143839.770019:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b4eb5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841191d expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.770035:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.770039:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143839.770072:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624976640:12345-192.168.202.3@tcp:103:mirror_io.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.770078:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 991 00000100:00100000:0.0:1746143839.771651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.771702:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624976896 00000100:00100000:2.0:1746143839.771708:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624976896 00000100:00100000:2.0:1746143839.771747:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5404 00000100:00100000:2.0:1746143839.771753:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2719:x1830963624976896:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143839.771940:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2719:x1830963624976896:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 186us (292us total) trans 8589945024 rc 0/0 00000100:00100000:2.0:1746143839.771946:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5404 00000100:00100000:0.0:1746143839.773422:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.773764:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624977152 00000100:00100000:2.0:1746143839.773770:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624977152 00000100:00100000:2.0:1746143839.773808:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5405 00000100:00100000:2.0:1746143839.773815:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2719:x1830963624977152:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143839.773963:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2719:x1830963624977152:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 148us (542us total) trans 8589945025 rc 0/0 00000100:00100000:2.0:1746143839.773969:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5405 00000100:00100000:0.0:1746143839.815324:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.815382:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.815412:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624977408 00000100:00100000:3.0:1746143839.815421:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624977408 00000100:00100000:3.0:1746143839.815467:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624977664 00000100:00100000:3.0:1746143839.815470:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624977664 00000100:00100000:3.0:1746143839.815490:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13968 00000100:00100000:3.0:1746143839.815496:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2732:x1830963624977408:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143839.815517:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.815531:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3600/0x87925e4cb73b4f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411963 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.815560:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13969 00000100:00100000:2.0:1746143839.815568:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+260:2733:x1830963624977664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143839.815576:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143839.815581:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4f79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841196a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.815591:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.815601:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.815602:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143839.815612:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.815614:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143839.815620:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.815623:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.815626:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.815627:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143839.815632:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.815632:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143839.815636:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00080000:0.0:1746143839.816098:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143839.816540:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816548:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816554:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143839.816561:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143839.816612:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816617:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816621:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816625:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816629:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143839.816632:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816638:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816646:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143839.816649:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143839.816651:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.816656:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b4f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143839.816770:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816781:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816786:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143839.816791:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143839.816814:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816818:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816822:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816826:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816829:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143839.816831:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816834:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816839:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143839.816841:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143839.816843:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816846:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c400/0x87925e4cb73b4f87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816859:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816863:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816867:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816871:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7dc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143839.816873:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816878:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816883:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093754d00) 00010000:00010000:3.0:1746143839.816885:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143839.816887:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816891:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7dc00/0x87925e4cb73b4f95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.816931:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b4f79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.816941:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.816947:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143839.816949:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143839.816951:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87000, rc 0) 00000100:00100000:3.0:1746143839.816988:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2733:x1830963624977664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1421us (1606us total) trans 8589945027 rc 0/0 00000100:00100000:3.0:1746143839.816993:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13969 00010000:00010000:2.0:1746143839.819433:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819445:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819450:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819455:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb3800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143839.819458:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819463:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819476:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093754d00) 00010000:00010000:2.0:1746143839.819478:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143839.819481:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819489:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b4f8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.819544:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3600/0x87925e4cb73b4f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.819554:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.819559:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143839.819560:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143839.819562:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:2.0:1746143839.819606:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2732:x1830963624977408:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4109us (4288us total) trans 8589945026 rc 0/0 00000100:00100000:2.0:1746143839.819612:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13968 00000100:00100000:0.0:1746143839.820668:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.820726:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624977792 00000100:00100000:0.0:1746143839.820726:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.820732:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624977792 00000100:00100000:0.0:1746143839.820740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.820742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00080000:0.0:1746143839.820758:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143839.820761:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624977920 00000100:00100000:1.0:1746143839.820764:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624977920 00000100:00100000:3.0:1746143839.820771:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978048 00000100:00100000:0.0:1746143839.820772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.820773:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978048 00000100:00100000:3.0:1746143839.820789:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978176 00000100:00100000:3.0:1746143839.820791:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978176 00000100:00100000:1.0:1746143839.820798:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16510 00000100:00100000:1.0:1746143839.820804:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624977792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.820816:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.821028:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411971 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143839.821045:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143839.821047:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16511 00010000:00010000:1.0:1746143839.821047:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.821049:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143839.821053:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963624978048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.821056:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.821061:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143839.821062:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143839.821069:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.821071:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841197f expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.821076:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086c00, rc 0) 00000100:00100000:0.0:1746143839.821080:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143839.821081:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.821083:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.821087:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.821098:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 26 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143839.821102:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978304 00000100:00100000:1.0:1746143839.821103:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624977792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 299us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143839.821104:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978304 00010000:00010000:3.0:1746143839.821105:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fbb000, rc 0) 00000100:00100000:1.0:1746143839.821108:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16510 00000100:00100000:1.0:1746143839.821119:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978432 00000100:00100000:3.0:1746143839.821121:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624978048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 68us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.821121:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978432 00000100:00100000:0.0:1746143839.821121:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16512 00000100:00100000:0.0:1746143839.821125:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624977920:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143839.821126:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16511 00010000:00010000:0.0:1746143839.821131:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143839.821134:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16513 00010000:00010000:0.0:1746143839.821136:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411978 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.821138:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16514 00000100:00100000:3.0:1746143839.821142:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624978304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143839.821145:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.821146:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143839.821146:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.821150:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.821151:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841198d expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821158:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.821158:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.821159:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.821162:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143839.821169:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428e00, rc 0) 00010000:00010000:3.0:1746143839.821170:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.821175:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb2c00, rc 0) 00000100:00100000:0.0:1746143839.821181:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624977920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 55us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.821185:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624978304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143839.821185:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16512 00000100:00100000:3.0:1746143839.821189:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16514 00000100:00100000:0.0:1746143839.821194:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16515 00000100:00100000:0.0:1746143839.821198:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624978432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143839.821202:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143839.821207:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411994 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.821215:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.821216:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.821219:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143839.821223:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978688 00000100:00100000:3.0:1746143839.821225:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978688 00010000:00010000:0.0:1746143839.821227:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143839.821233:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429600, rc 0) 00000100:00100000:3.0:1746143839.821243:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13970 00000100:00100000:0.0:1746143839.821244:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624978432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.821247:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:2730:x1830963624978688:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143839.821248:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16515 00010000:00010000:3.0:1746143839.821257:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.821265:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b4fdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841199b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821333:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143839.821344:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821360:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821366:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821372:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143839.821393:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821403:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 263 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143839.821413:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467136:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143839.821463:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821471:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 8 pid: 7245 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143839.821478:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467264:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143839.821502:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.821509:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143839.821516:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467392:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143839.821531:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143839.822451:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624978176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.822460:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.822468:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411986 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.822480:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.822481:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.822485:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.822493:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.822500:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086600, rc 0) 00000100:00100000:1.0:1746143839.822982:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624978176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1841us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.822989:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16513 00000100:00100000:0.0:1746143839.829434:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.829676:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978944 00000100:00100000:1.0:1746143839.829684:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978944 00010000:00010000:1.0:1746143839.829714:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 9 pid: 7245 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.829738:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8041 00000100:00100000:1.0:1746143839.829744:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2010:x1830963624978944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143839.829755:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143839.829760:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 9 pid: 7245 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.829769:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 9 pid: 7245 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.829787:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.829791:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.829798:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.829802:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143839.830145:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467136:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143839.830155:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b4f9c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411963 expref: 9 pid: 7245 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143839.830167:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467264:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143839.830173:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467392:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143839.830192:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746143839.830886:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963624978944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1138us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.830893:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8041 00000100:00100000:0.0:1746143839.831034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.831364:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.831379:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624978816 00000100:00100000:0.0:1746143839.831383:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624978816 00010000:00010000:0.0:1746143839.831401:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 264 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143839.831418:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8042 00000100:00100000:0.0:1746143839.831423:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:2008:x1830963624978816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143839.831432:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143839.831437:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 264 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143839.831445:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 264 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143839.831458:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b4faa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841196a expref: 264 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.831648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.831659:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979072 00000100:00100000:1.0:1746143839.831661:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979072 00010000:00010000:1.0:1746143839.831672:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.831687:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8043 00000100:00100000:1.0:1746143839.831692:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624979072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143839.831697:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143839.831700:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.831708:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.831719:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b4f09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411932 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.831734:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.831738:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.831744:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.831750:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143839.831832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143839.832630:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143839.832658:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624979072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 965us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.832664:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8043 00010000:00010000:1.0:1746143839.832747:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.832753:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143839.833052:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143839.833055:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143839.833074:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963624978816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1651us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143839.833080:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8042 00000100:00100000:3.0:1746143839.833292:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979328 00000100:00100000:3.0:1746143839.833297:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979328 00000100:00100000:3.0:1746143839.833307:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979456 00000100:00100000:3.0:1746143839.833309:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979456 00000100:00100000:2.0:1746143839.833318:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.833506:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979584 00000100:00100000:3.0:1746143839.833510:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979584 00000100:00100000:3.0:1746143839.833526:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13971 00000100:00100000:3.0:1746143839.833531:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2733:x1830963624979456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143839.833544:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.833554:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119a9 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.833594:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1746143839.833594:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143839.833605:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.833617:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143839.833619:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143839.833621:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31c00, rc 0) 00000100:00100000:3.0:1746143839.833642:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2733:x1830963624979456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 111us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.833647:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13971 00000100:00100000:3.0:1746143839.833660:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13972 00000100:00100000:3.0:1746143839.833665:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2732:x1830963624979584:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143839.833674:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.833678:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b4ffe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119b0 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.833685:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b4fdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.833694:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b4ffe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b0 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.833705:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.834925:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b4ffe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b0 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.834943:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143839.834945:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143839.834948:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00000100:00100000:3.0:1746143839.834972:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2732:x1830963624979584:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1306us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.834977:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13972 00000100:00100000:3.0:1746143839.835019:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13973 00000100:00100000:3.0:1746143839.835024:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2731:x1830963624979328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143839.835031:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.835038:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b5005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119a2 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.835077:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835084:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835091:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835098:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835103:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835107:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835161:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b501a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835167:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b501a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835172:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b501a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143839.835178:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143839.835210:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835214:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835219:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835223:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835227:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143839.835230:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835235:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835241:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143839.835243:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143839.835245:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835249:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b500c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835257:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835264:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835268:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835271:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143839.835272:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835276:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835280:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880093754300) 00010000:00010000:3.0:1746143839.835281:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143839.835283:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835286:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30c00/0x87925e4cb73b5013 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143839.835308:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30800/0x87925e4cb73b5005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a2 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.835314:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b501a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a2 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.835318:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143839.835320:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143839.835321:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:3.0:1746143839.835336:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2731:x1830963624979328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 312us (4302us total) trans 8589945029 rc 0/0 00000100:00100000:3.0:1746143839.835342:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13973 00010000:00010000:1.0:1746143839.835700:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.835702:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143839.835704:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:1.0:1746143839.835722:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:2730:x1830963624978688:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14474us (14981us total) trans 8589945028 rc 0/0 00000100:00100000:1.0:1746143839.835727:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13970 00000100:00100000:0.0:1746143839.853500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.853528:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.853553:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.853576:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.853594:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979712 00000100:00100000:0.0:1746143839.853601:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979712 00000100:00100000:3.0:1746143839.853614:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979840 00000100:00100000:3.0:1746143839.853618:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979840 00000100:00100000:0.0:1746143839.853629:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624979968 00000100:00100000:0.0:1746143839.853631:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624979968 00000100:00100000:3.0:1746143839.853637:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624980096 00000100:00100000:3.0:1746143839.853639:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624980096 00000100:00100000:0.0:1746143839.853643:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16516 00000100:00100000:0.0:1746143839.853649:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963624979712:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143839.853653:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16517 00000100:00100000:3.0:1746143839.853657:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624979840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143839.853662:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.853664:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.853673:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119be expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.853674:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119b7 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.853689:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.853689:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.853690:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.853690:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.853697:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143839.853697:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.853708:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143839.853709:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143839.853716:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00010000:00010000:0.0:1746143839.853716:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:2.0:1746143839.853783:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16518 00000100:00100000:2.0:1746143839.853791:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624979968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143839.853797:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143839.853803:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119c5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.853812:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143839.853813:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143839.853817:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143839.853830:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143839.853837:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d000, rc 0) 00000100:00100000:1.0:1746143839.853886:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16519 00000100:00100000:1.0:1746143839.853892:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624980096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.853897:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.853903:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119cc expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.853934:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.853935:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.853940:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.853948:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.853955:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087800, rc 0) 00000100:00100000:3.0:1746143839.854191:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624979840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 532us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.854197:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16517 00000100:00100000:2.0:1746143839.854250:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624979968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 460us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.854256:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16518 00000100:00100000:3.0:1746143839.854376:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.854399:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624979712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 746us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143839.854405:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16516 00000100:00100000:1.0:1746143839.854527:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624980096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 635us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.854533:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16519 00000100:00100000:0.0:1746143839.854775:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624980224 00000100:00100000:0.0:1746143839.854779:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624980224 00000100:00100000:0.0:1746143839.854796:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16520 00000100:00100000:0.0:1746143839.854801:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963624980224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143839.854807:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143839.854813:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119d3 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.854827:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.854828:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143839.854832:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143839.854840:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143839.854847:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428600, rc 0) 00000100:00100000:0.0:1746143839.854861:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624980224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 60us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143839.854865:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16520 00000100:00100000:3.0:1746143839.854998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.855013:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.855028:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.855042:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624980608 00000100:00100000:3.0:1746143839.855045:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624980608 00002000:00100000:3.0:1746143839.855066:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012b1d8e00 x1830963624980608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.855074:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963624980608 ext(0->1048575) 00002000:00010000:3.0:1746143839.855077:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:3.0:1746143839.855087:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624980864 00000100:00100000:3.0:1746143839.855089:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624980864 00002000:00100000:3.0:1746143839.855098:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095c3aa00 x1830963624980864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.855104:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3aa00 with x1830963624980864 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.855106:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3aa00 00000100:00100000:3.0:1746143839.855115:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7175 00000100:00100000:3.0:1746143839.855119:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624980608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143839.855696:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.855751:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624980352 00000100:00100000:1.0:1746143839.855755:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624980352 00000100:00100000:1.0:1746143839.855783:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16521 00000100:00100000:1.0:1746143839.855789:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624980352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.855795:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.855803:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119da expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.855815:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.855816:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.855820:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.855828:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.855834:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087c00, rc 0) 00000100:00100000:1.0:1746143839.855853:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624980352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 65us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.855857:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16521 00000100:00100000:1.0:1746143839.855872:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624981120 00000100:00100000:1.0:1746143839.855875:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624981120 00002000:00100000:1.0:1746143839.855887:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c39180 x1830963624981120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143839.855893:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39180 with x1830963624981120 ext(1048576->2097151) 00002000:00010000:1.0:1746143839.855896:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c39180 00000100:00100000:1.0:1746143839.855907:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7176 00000100:00100000:1.0:1746143839.855925:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624980864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143839.856377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.856420:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.856436:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624981376 00000100:00100000:3.0:1746143839.856439:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624981376 00002000:00100000:3.0:1746143839.856454:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c38700 x1830963624981376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.856461:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38700 with x1830963624981376 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.856463:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c38700 00000100:00100000:3.0:1746143839.856481:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7177 00000100:00100000:1.0:1746143839.856482:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624981632 00000100:00100000:1.0:1746143839.856485:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624981632 00000100:00100000:3.0:1746143839.856486:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624981120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143839.856506:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13974 00000100:00100000:1.0:1746143839.856510:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2732:x1830963624981632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143839.856521:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.856523:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746143839.856538:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b4ffe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b0 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856555:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b501a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a2 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856562:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.856566:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143839.856584:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73b5052 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119e1 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856614:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.856623:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856629:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856634:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.856654:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856663:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 263 pid: 10936 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.856676:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467520:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.856719:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.856726:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 8 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.856732:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467648:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143839.856747:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143839.857039:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7178 00000100:00100000:3.0:1746143839.857045:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624981376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143839.872096:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.872241:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963624980864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16327us (17209us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143839.872252:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7176 00000100:00100000:2.0:1746143839.872260:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624980608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17139us (17244us total) trans 0 rc 1048576/1048576 00002000:00100000:0.0:1746143839.872262:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095c3aa00 x1830963624980864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143839.872266:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7175 00002000:00100000:0.0:1746143839.872270:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3aa00 with x1830963624980864 ext(1048576->2097151) 00002000:00100000:2.0:1746143839.872272:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012b1d8e00 x1830963624980608/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746143839.872275:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3aa00 00002000:00100000:2.0:1746143839.872279:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8e00 with x1830963624980608 ext(0->1048575) 00002000:00010000:2.0:1746143839.872282:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1d8e00 00000100:00100000:1.0:1746143839.872359:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624981760 00000100:00100000:1.0:1746143839.872365:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624981760 00000100:00100000:1.0:1746143839.872392:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13975 00000100:00100000:1.0:1746143839.872397:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2731:x1830963624981760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.872410:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.872422:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119e8 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.872457:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.872464:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.872476:0:10936:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.872484:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.872494:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.872496:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143839.872498:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.872502:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27000, rc 0) 00000100:00100000:1.0:1746143839.872528:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2731:x1830963624981760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 132us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.872532:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13975 00000100:00100000:0.0:1746143839.876668:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.876760:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467520:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143839.876825:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624981888 00000100:00100000:2.0:1746143839.876831:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624981888 00010000:00010000:2.0:1746143839.876857:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 264 pid: 10936 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143839.876888:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8044 00000100:00100000:2.0:1746143839.876894:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:2008:x1830963624981888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143839.876905:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143839.876938:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 264 pid: 10936 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.876951:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 264 pid: 10936 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.876968:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b4ff0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119a9 expref: 264 pid: 10936 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.876986:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143839.876990:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.876995:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.877000:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143839.877028:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963624981888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 135us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.877035:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8044 00000100:00100000:0.0:1746143839.878553:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.878692:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624982016 00000100:00100000:3.0:1746143839.878696:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624981120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22209us (23000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.878697:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624982016 00000100:00100000:3.0:1746143839.878705:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7177 00002000:00100000:3.0:1746143839.878712:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c39180 x1830963624981120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143839.878715:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00002000:00100000:3.0:1746143839.878720:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c39180 with x1830963624981120 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.878724:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c39180 00000100:00100000:2.0:1746143839.878733:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8045 00000100:00100000:2.0:1746143839.878737:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624982016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143839.878745:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143839.878749:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.878761:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.878774:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143839.878778:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.878784:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143839.878788:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53e00/0x87925e4cb73b4efb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841192b expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.878790:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143839.878798:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143839.878802:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627467648:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143839.878809:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143839.878817:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143839.878824:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963624982016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143839.878827:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143839.878829:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8045 00010000:00010000:1.0:1746143839.878831:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000040:00080000:1.0:1746143839.879088:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3239, 88 off272888 00000004:00080000:1.0:1746143839.879094:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103181501ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879113:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3234, 88 off272096 00000004:00080000:1.0:1746143839.879118:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103205431ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879128:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3235, 88 off272184 00000004:00080000:1.0:1746143839.879131:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103219310ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879138:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3240, 88 off272976 00000004:00080000:1.0:1746143839.879141:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103228628ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879147:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3241, 88 off273064 00000004:00080000:1.0:1746143839.879150:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103237364ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879156:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3236, 88 off272272 00000004:00080000:1.0:1746143839.879159:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103246828ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879166:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3237, 88 off272360 00000004:00080000:1.0:1746143839.879168:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103256293ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879174:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3238, 88 off272448 00000004:00080000:1.0:1746143839.879177:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103264683ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879183:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3242, 88 off273152 00000004:00080000:1.0:1746143839.879185:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103273205ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879191:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3239, 88 off272536 00000004:00080000:1.0:1746143839.879193:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103281319ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879199:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3243, 88 off273240 00000004:00080000:1.0:1746143839.879201:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103288811ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879207:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3240, 88 off272624 00000004:00080000:1.0:1746143839.879209:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103296833ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143839.879214:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3244, 88 off273328 00000004:00080000:1.0:1746143839.879216:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103304255ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879222:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3245, 88 off273416 00000004:00080000:1.0:1746143839.879224:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103311775ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879229:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3246, 88 off273504 00000004:00080000:1.0:1746143839.879232:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103319479ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879237:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3247, 88 off273592 00000004:00080000:1.0:1746143839.879239:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 899103327268ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143839.879246:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3241, 88 off272712 00000004:00080000:1.0:1746143839.879247:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 899103335424ns, next at 850789974850ns, rc = 0 00000100:00100000:3.0:1746143839.881301:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624981376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24249us (24917us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.881311:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7178 00002000:00100000:3.0:1746143839.881320:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c38700 x1830963624981376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.881328:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38700 with x1830963624981376 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.881333:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c38700 00000001:00080000:2.0:1746143839.883665:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945030 is committed 00000004:00080000:2.0:1746143839.883675:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2454 committed 00000004:00080000:2.0:1746143839.883691:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2463 committed 00000004:00080000:2.0:1746143839.883705:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2462 committed 00000004:00080000:2.0:1746143839.883706:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2461 committed 00000004:00080000:2.0:1746143839.883708:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2460 committed 00000004:00080000:2.0:1746143839.883709:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2453 committed 00000004:00080000:2.0:1746143839.883710:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2459 committed 00000004:00080000:2.0:1746143839.883711:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2452 committed 00000004:00080000:2.0:1746143839.883713:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2458 committed 00000004:00080000:2.0:1746143839.883715:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2451 committed 00000004:00080000:2.0:1746143839.883716:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2450 committed 00000004:00080000:2.0:1746143839.883717:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2449 committed 00000004:00080000:2.0:1746143839.883719:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2457 committed 00000004:00080000:2.0:1746143839.883720:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2456 committed 00000004:00080000:2.0:1746143839.883722:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2448 committed 00000004:00080000:2.0:1746143839.883723:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2447 committed 00000004:00080000:2.0:1746143839.883725:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2455 committed 00000001:00080000:2.0:1746143839.883733:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945028 is committed 00000001:00080000:2.0:1746143839.883739:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945025 is committed 00000100:00100000:1.0:1746143839.883883:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143839.883939:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143839.883958:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143839.883969:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143839.883981:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143839.883985:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143839.883994:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143839.884001:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143839.884010:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143839.884027:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468160 00000100:00100000:1.0:1746143839.884032:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468160 00000100:00100000:1.0:1746143839.884060:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468672 00000100:00100000:1.0:1746143839.884062:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468672 00000100:00100000:1.0:1746143839.884069:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468032 00000100:00100000:1.0:1746143839.884071:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468032 00000100:00100000:1.0:1746143839.884082:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468544 00000100:00100000:1.0:1746143839.884083:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468544 00000100:00100000:1.0:1746143839.884094:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16522 00000100:00100000:1.0:1746143839.884100:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627468160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143839.884206:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627468160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (266us total) trans 17179873953 rc 0/0 00000100:00100000:1.0:1746143839.884211:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16522 00000100:00100000:1.0:1746143839.884221:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16523 00000100:00100000:1.0:1746143839.884224:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627468672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143839.884261:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:1.0:1746143839.884265:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143839.884267:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143839.884269:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143839.884271:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:1.0:1746143839.884288:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627468672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (318us total) trans 17179873954 rc 0/0 00000100:00100000:1.0:1746143839.884293:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16523 00000100:00100000:1.0:1746143839.884301:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16524 00000100:00100000:1.0:1746143839.884305:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627468032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143839.884342:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:1.0:1746143839.884344:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143838 -> 1746143838 00002000:00010000:1.0:1746143839.884345:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143838 -> 1746143838 00002000:00010000:1.0:1746143839.884360:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143838 -> 1746143838 00002000:00010000:1.0:1746143839.884362:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:1.0:1746143839.884379:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627468032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (384us total) trans 17179873955 rc 0/0 00000100:00100000:1.0:1746143839.884384:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16524 00000100:00100000:1.0:1746143839.884393:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16525 00000100:00100000:1.0:1746143839.884396:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627468544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143839.884432:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143839.884434:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143839.884435:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143839.884437:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143839.884439:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:1.0:1746143839.884454:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627468544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (442us total) trans 17179873956 rc 0/0 00000100:00100000:1.0:1746143839.884461:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16525 00000100:00080000:1.0:1746143839.884473:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746143839.884493:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b8000/2, rc 0, transno 17179873955 00000100:00100000:1.0:1746143839.884500:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468032:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143839.884507:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9180/2, rc 0, transno 17179873956 00000100:00100000:1.0:1746143839.884509:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143839.884515:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b8a80/2, rc 0, transno 17179873953 00000100:00100000:1.0:1746143839.884517:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143839.884521:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b8e00/2, rc 0, transno 17179873954 00000100:00100000:1.0:1746143839.884523:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627468672:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143839.884580:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.884590:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143839.884592:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746143839.884596:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.884604:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.884610:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.884629:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143839.884642:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627468928:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143839.884692:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143839.884834:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627467776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.884853:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143839.884863:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627468288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.884872:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143839.884878:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627468800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.884887:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143839.884905:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143839.884908:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627467904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.884934:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143839.884942:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627468416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.884952:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143839.884964:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627467776 00000100:00100000:3.0:1746143839.884967:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627467776 00000100:00100000:3.0:1746143839.884979:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468288 00000100:00100000:3.0:1746143839.884980:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468288 00000100:00100000:3.0:1746143839.884986:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468800 00000100:00100000:3.0:1746143839.884987:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468800 00000100:00100000:3.0:1746143839.884993:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627467904 00000100:00100000:3.0:1746143839.884994:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627467904 00000100:00100000:3.0:1746143839.885001:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627468416 00000100:00100000:3.0:1746143839.885002:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627468416 00000100:00100000:3.0:1746143839.885010:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16526 00000100:00100000:3.0:1746143839.885013:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627467776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143839.885050:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143839.885052:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143838 -> 1746143838 00002000:00010000:3.0:1746143839.885054:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143837 -> 1746143837 00002000:00010000:3.0:1746143839.885055:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143838 -> 1746143838 00002000:00010000:3.0:1746143839.885057:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:3.0:1746143839.885072:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627467776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (218us total) trans 17179873957 rc 0/0 00000100:00100000:3.0:1746143839.885076:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16526 00000100:00100000:3.0:1746143839.885085:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16527 00000100:00100000:3.0:1746143839.885088:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627468288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.885122:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627468288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 34us (249us total) trans 17179873958 rc 0/0 00000100:00100000:3.0:1746143839.885126:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16527 00000100:00100000:3.0:1746143839.885133:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16528 00000100:00100000:3.0:1746143839.885136:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627468800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.885170:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627468800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (282us total) trans 17179873959 rc 0/0 00000100:00100000:3.0:1746143839.885175:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16528 00000100:00100000:3.0:1746143839.885182:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16529 00000100:00100000:3.0:1746143839.885186:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627467904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143839.885219:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143839.885221:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143838 -> 1746143838 00002000:00010000:3.0:1746143839.885223:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143833 -> 1746143833 00002000:00010000:3.0:1746143839.885225:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143838 -> 1746143838 00002000:00010000:3.0:1746143839.885226:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143839.885242:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627467904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (307us total) trans 17179873960 rc 0/0 00000100:00100000:3.0:1746143839.885247:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16529 00000100:00100000:3.0:1746143839.885254:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16530 00000100:00100000:3.0:1746143839.885258:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627468416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143839.885301:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627468416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (347us total) trans 17179873961 rc 0/0 00000100:00100000:3.0:1746143839.885306:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16530 00000004:00080000:3.0:1746143839.885325:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9880/2, rc 0, transno 17179873960 00000100:00100000:3.0:1746143839.885328:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627467904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143839.885333:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bb480/2, rc 0, transno 17179873961 00000100:00100000:3.0:1746143839.885336:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627468416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143839.885339:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9500/2, rc 0, transno 17179873957 00000100:00100000:3.0:1746143839.885341:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627467776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143839.885345:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bb100/2, rc 0, transno 17179873958 00000100:00100000:3.0:1746143839.885358:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627468288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143839.885364:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334a80/2, rc 0, transno 17179873959 00000100:00100000:3.0:1746143839.885366:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627468800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143839.885471:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143839.885490:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143839.885499:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143839.885510:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143839.885517:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143839.885520:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143839.885530:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143839.885536:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143839.885547:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143839.885558:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469312 00000100:00100000:0.0:1746143839.885560:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469312 00000100:00100000:0.0:1746143839.885577:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469824 00000100:00100000:0.0:1746143839.885579:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469824 00000100:00100000:0.0:1746143839.885586:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469184 00000100:00100000:0.0:1746143839.885587:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469184 00000100:00100000:0.0:1746143839.885595:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469696 00000100:00100000:0.0:1746143839.885597:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469696 00000100:00100000:0.0:1746143839.885605:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16531 00000100:00100000:0.0:1746143839.885609:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3772:x1830963627469312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143839.885660:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143839.885662:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143838 -> 1746143838 00002000:00010000:0.0:1746143839.885664:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143838 -> 1746143838 00002000:00010000:0.0:1746143839.885666:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143838 -> 1746143838 00002000:00010000:0.0:1746143839.885667:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143839.885687:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627469312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (195us total) trans 21474841226 rc 0/0 00000100:00100000:0.0:1746143839.885692:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16531 00000100:00100000:0.0:1746143839.885701:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16532 00000100:00100000:0.0:1746143839.885705:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3772:x1830963627469824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143839.885752:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627469824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (240us total) trans 21474841227 rc 0/0 00000100:00100000:0.0:1746143839.885757:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16532 00000100:00100000:0.0:1746143839.885765:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16533 00000100:00100000:0.0:1746143839.885769:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3772:x1830963627469184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143839.885802:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143839.885805:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143838 -> 1746143838 00002000:00010000:0.0:1746143839.885806:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143834 -> 1746143834 00002000:00010000:0.0:1746143839.885808:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143838 -> 1746143838 00002000:00010000:0.0:1746143839.885809:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143839.885823:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627469184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (293us total) trans 21474841228 rc 0/0 00000100:00100000:0.0:1746143839.885827:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16533 00000100:00100000:0.0:1746143839.885834:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16534 00000100:00100000:0.0:1746143839.885838:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3772:x1830963627469696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143839.885863:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143839.885865:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143839.885867:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143839.885868:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143839.885870:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143839.885881:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627469696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (334us total) trans 21474841229 rc 0/0 00000100:00100000:0.0:1746143839.885885:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16534 00000100:00080000:0.0:1746143839.885896:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746143839.885908:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610f100/2, rc 0, transno 21474841228 00000100:00100000:0.0:1746143839.885927:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143839.885934:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610d180/2, rc 0, transno 21474841229 00000100:00100000:0.0:1746143839.885937:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143839.885941:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610d880/2, rc 0, transno 21474841226 00000100:00100000:0.0:1746143839.885943:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143839.885948:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610d500/2, rc 0, transno 21474841227 00000100:00100000:0.0:1746143839.885949:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627469824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886366:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886389:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143839.886403:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886417:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143839.886427:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143839.886431:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886442:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143839.886450:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886459:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143839.886472:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469056 00000100:00100000:2.0:1746143839.886475:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469056 00000100:00100000:2.0:1746143839.886486:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469568 00000100:00100000:2.0:1746143839.886487:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469568 00000100:00100000:2.0:1746143839.886491:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469440 00000100:00100000:2.0:1746143839.886492:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469440 00000100:00100000:2.0:1746143839.886496:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627469952 00000100:00100000:2.0:1746143839.886498:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627469952 00000100:00100000:2.0:1746143839.886503:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16535 00000100:00100000:2.0:1746143839.886506:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627469056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143839.886546:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143839.886549:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143838 -> 1746143838 00002000:00010000:2.0:1746143839.886550:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143838 -> 1746143838 00002000:00010000:2.0:1746143839.886552:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143838 -> 1746143838 00002000:00010000:2.0:1746143839.886553:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143839.886569:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627469056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (180us total) trans 21474841230 rc 0/0 00000100:00100000:2.0:1746143839.886573:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16535 00000100:00100000:2.0:1746143839.886581:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16536 00000100:00100000:2.0:1746143839.886584:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627469568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886618:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627469568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 33us (200us total) trans 21474841231 rc 0/0 00000100:00100000:2.0:1746143839.886622:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16536 00000100:00100000:2.0:1746143839.886628:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16537 00000100:00100000:2.0:1746143839.886631:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627469440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143839.886656:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143839.886658:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143839.886659:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143839.886661:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143839.886662:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143839.886673:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627469440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (231us total) trans 21474841232 rc 0/0 00000100:00100000:2.0:1746143839.886677:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16537 00000100:00100000:2.0:1746143839.886682:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16538 00000100:00100000:2.0:1746143839.886686:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627469952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143839.886717:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627469952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 31us (257us total) trans 21474841233 rc 0/0 00000100:00100000:2.0:1746143839.886721:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16538 00000004:00080000:2.0:1746143839.886734:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610f480/2, rc 0, transno 21474841232 00000100:00100000:2.0:1746143839.886737:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469440:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143839.886742:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610fb80/2, rc 0, transno 21474841233 00000100:00100000:2.0:1746143839.886744:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469952:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143839.886748:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610df80/2, rc 0, transno 21474841230 00000100:00100000:2.0:1746143839.886749:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143839.886753:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610f800/2, rc 0, transno 21474841231 00000100:00100000:2.0:1746143839.886755:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627469568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143839.886981:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.887679:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624982144 00000100:00100000:3.0:1746143839.887683:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624982144 00000100:00100000:3.0:1746143839.887734:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13976 00000100:00100000:3.0:1746143839.887740:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+261:2733:x1830963624982144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143839.887752:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.887763:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119ef expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.887798:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.887808:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.887821:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143839.887823:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143839.887825:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133567400, rc 0) 00000100:00100000:3.0:1746143839.888088:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2733:x1830963624982144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 347us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.888096:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13976 00000100:00100000:1.0:1746143839.889563:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627468928:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143839.889591:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082086a00/0x87925e4cb73b5052 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 10 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746143839.889605:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.889629:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087400, rc 0) 00000100:00100000:1.0:1746143839.889658:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2732:x1830963624981632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 33146us (33236us total) trans 8589945030 rc 0/0 00000100:00100000:1.0:1746143839.889664:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13974 00000100:00100000:2.0:1746143839.890018:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.890189:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624982272 00000100:00100000:1.0:1746143839.890193:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624982272 00000100:00100000:1.0:1746143839.890218:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5406 00000100:00100000:1.0:1746143839.890224:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2731:x1830963624982272:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:1.0:1746143839.890336:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2731:x1830963624982272:12345-192.168.202.3@tcp:49:cat.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.890341:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5406 00000100:00100000:0.0:1746143839.902050:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.902265:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624982400 00000100:00100000:2.0:1746143839.902274:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624982400 00000100:00100000:2.0:1746143839.902325:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5407 00000100:00100000:2.0:1746143839.902333:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2732:x1830963624982400:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:2.0:1746143839.902445:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2732:x1830963624982400:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 113us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.902451:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5407 00000100:00100000:0.0:1746143839.907999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.909340:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.909379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.909421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.909500:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624982528 00000100:00100000:1.0:1746143839.909508:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624982528 00000100:00100000:3.0:1746143839.909527:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624982912 00000100:00100000:3.0:1746143839.909530:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624982912 00000100:00100000:1.0:1746143839.909545:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16539 00000100:00100000:1.0:1746143839.909551:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2732:x1830963624982528:12345-192.168.202.3@tcp:101:multiop.0 00002000:00100000:3.0:1746143839.909555:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009c4d7100 x1830963624982912/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.909562:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963624982912 ext(1048576->2097151) 00010000:00010000:1.0:1746143839.909564:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746143839.909567:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7100 00000100:00100000:3.0:1746143839.909576:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624983040 00010000:00010000:1.0:1746143839.909577:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119f6 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.909578:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624983040 00010000:00010000:1.0:1746143839.909599:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746143839.909601:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d4000 x1830963624983040/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.909607:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4000 with x1830963624983040 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.909610:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4000 00010000:00010000:1.0:1746143839.909612:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.909618:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143839.909623:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624983168 00000100:00100000:3.0:1746143839.909624:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624983168 00010000:00010000:1.0:1746143839.909626:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.909628:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.909632:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3817472->4001791] (req 3817472->4001791) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143839.909633:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009c4d6680 x1830963624983168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.909639:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6680 with x1830963624983168 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.909641:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d6680 00000100:00100000:3.0:1746143839.909650:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7179 00000100:00100000:3.0:1746143839.909653:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624982912:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143839.909660:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.909673:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 28 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.909685:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470080:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.909753:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.909768:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 11 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.909774:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470208:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.909804:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 10 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.909811:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 10 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.909820:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470336:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143839.909840:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143839.910136:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7180 00000100:00100000:2.0:1746143839.910145:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624983040:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143839.910197:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7181 00000100:00100000:3.0:1746143839.910202:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624983168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143839.915134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.915172:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.915198:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.915210:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.915254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.915267:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.915290:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.915365:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624984576 00000100:00100000:1.0:1746143839.915371:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624984576 00010000:00010000:1.0:1746143839.915400:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 12 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.915421:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624984448 00000100:00100000:1.0:1746143839.915423:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624984448 00010000:00010000:1.0:1746143839.915433:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 30 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.915444:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624984704 00000100:00100000:1.0:1746143839.915446:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624984704 00010000:00010000:1.0:1746143839.915456:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 11 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.915474:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8046 00000100:00100000:1.0:1746143839.915480:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624984576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143839.915490:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143839.915508:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 12 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143839.915515:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8047 00010000:00010000:1.0:1746143839.915516:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 12 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143839.915522:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624984448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143839.915529:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143839.915535:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143839.915537:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 30 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.915543:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 30 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.915552:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143839.915561:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624984576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.915563:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624984448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.915567:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8046 00000100:00100000:3.0:1746143839.915569:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8047 00000100:00100000:3.0:1746143839.915579:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8048 00000100:00100000:3.0:1746143839.915583:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963624984704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143839.915589:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143839.915594:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 11 pid: 9586 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.915602:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 11 pid: 9586 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.915612:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.915614:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.915620:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.915628:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143839.915874:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624983680 00000100:00100000:2.0:1746143839.915878:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624983680 00002000:00100000:2.0:1746143839.915907:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009c4d4700 x1830963624983680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.915934:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4700 with x1830963624983680 ext(0->1048575) 00002000:00010000:2.0:1746143839.915937:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d4700 00000100:00100000:2.0:1746143839.915949:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624983808 00000100:00100000:2.0:1746143839.915951:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624983808 00002000:00100000:2.0:1746143839.915961:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009c4d6d80 x1830963624983808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.915968:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6d80 with x1830963624983808 ext(1048576->2097151) 00002000:00010000:2.0:1746143839.915970:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d6d80 00000100:00100000:2.0:1746143839.915979:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624984192 00000100:00100000:2.0:1746143839.915980:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624984192 00002000:00100000:2.0:1746143839.915989:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009c4d5500 x1830963624984192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.915995:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5500 with x1830963624984192 ext(1048576->2097151) 00002000:00010000:2.0:1746143839.915997:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5500 00010000:00010000:3.0:1746143839.916048:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.916059:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627470464:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143839.916101:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624984064 00000100:00100000:2.0:1746143839.916104:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624984064 00002000:00100000:2.0:1746143839.916116:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d5c00 x1830963624984064/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.916121:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5c00 with x1830963624984064 ext(1048576->2097151) 00002000:00010000:2.0:1746143839.916124:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5c00 00000100:00100000:2.0:1746143839.916135:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7182 00000100:00100000:2.0:1746143839.916139:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2010:x1830963624983680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143839.916672:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143839.916693:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7183 00000100:00100000:3.0:1746143839.916699:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2010:x1830963624983808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143839.917241:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7184 00000100:00100000:3.0:1746143839.917247:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2010:x1830963624984192:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143839.917792:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7185 00000100:00100000:2.0:1746143839.917799:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2010:x1830963624984064:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:1.0:1746143839.918084:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb2c00/0x87925e4cb73b4fcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841198d expref: 29 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.918101:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470080:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.918110:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b5044 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119d3 expref: 15 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.918118:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470208:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.918126:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b4f1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411955 expref: 11 pid: 9586 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.918137:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470336:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.918156:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.918164:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7d200, rc 0) 00000100:00100000:1.0:1746143839.918181:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2732:x1830963624982528:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8631us (10363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.918187:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16539 00000100:00100000:3.0:1746143839.922021:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624982912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12358us (12676us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.922032:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7179 00002000:00100000:3.0:1746143839.922041:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009c4d7100 x1830963624982912/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.922050:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963624982912 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.922055:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7100 00000100:00100000:2.0:1746143839.924551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.924595:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627470464:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143839.924612:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143839.924703:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624984960 00000100:00100000:3.0:1746143839.924709:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624984960 00002000:00100000:3.0:1746143839.924740:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3817472->3821567) req@ffff880093cfaa00 x1830963624984960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.924749:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfaa00 with x1830963624984960 ext(3817472->3821567) 00002000:00010000:3.0:1746143839.924753:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cfaa00 00000100:00100000:3.0:1746143839.924772:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7186 00000100:00100000:3.0:1746143839.924778:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963624984960:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143839.925765:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624984704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10179us (10472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.925774:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8048 00000100:00100000:3.0:1746143839.928266:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963624984960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3478us (3712us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143839.928278:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7186 00002000:00100000:3.0:1746143839.928288:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3817472->3821567) req@ffff880093cfaa00 x1830963624984960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/4536 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.928299:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfaa00 with x1830963624984960 ext(3817472->3821567) 00002000:00010000:3.0:1746143839.928303:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cfaa00 00000100:00100000:3.0:1746143839.933734:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624983168:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23524us (24305us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.933745:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7181 00002000:00100000:3.0:1746143839.933755:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009c4d6680 x1830963624983168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.933763:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6680 with x1830963624983168 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.933768:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d6680 00000100:00100000:3.0:1746143839.938943:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624983040:12345-192.168.202.3@tcp:3:cat.0 Request processed in 28792us (29555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.938954:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7180 00002000:00100000:3.0:1746143839.938964:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d4000 x1830963624983040/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.938974:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4000 with x1830963624983040 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.938979:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4000 00000100:00100000:2.0:1746143839.939314:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963624983808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22614us (24140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.939320:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7183 00002000:00100000:2.0:1746143839.939325:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009c4d6d80 x1830963624983808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.939331:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6d80 with x1830963624983808 ext(1048576->2097151) 00002000:00010000:2.0:1746143839.939334:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d6d80 00000100:00100000:2.0:1746143839.941669:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2010:x1830963624983680:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25522us (26534us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.941679:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7182 00002000:00100000:2.0:1746143839.941688:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009c4d4700 x1830963624983680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.941696:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4700 with x1830963624983680 ext(0->1048575) 00002000:00010000:2.0:1746143839.941700:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d4700 00000100:00100000:3.0:1746143839.948419:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963624984192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 31164us (33211us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143839.948430:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7184 00002000:00100000:3.0:1746143839.948441:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009c4d5500 x1830963624984192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.948450:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5500 with x1830963624984192 ext(1048576->2097151) 00002000:00010000:3.0:1746143839.948454:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5500 00000100:00100000:2.0:1746143839.949409:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963624984064:12345-192.168.202.3@tcp:3:cat.0 Request processed in 31608us (34195us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143839.949416:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7185 00002000:00100000:2.0:1746143839.949422:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d5c00 x1830963624984064/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/440 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.949429:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5c00 with x1830963624984064 ext(1048576->2097151) 00002000:00010000:2.0:1746143839.949432:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5c00 00000100:00100000:0.0:1746143839.954902:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.954961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.955034:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624985088 00000100:00100000:1.0:1746143839.955042:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624985088 00000100:00100000:1.0:1746143839.955072:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624985216 00000100:00100000:1.0:1746143839.955073:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624985216 00000100:00100000:1.0:1746143839.955090:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16540 00000100:00100000:1.0:1746143839.955095:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2730:x1830963624985088:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143839.955109:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.955121:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a04 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.955143:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.955151:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.955157:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.955163:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.955165:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.955167:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1552384->2097151] (req 1552384->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.955191:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.955200:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 29 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.955211:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627470592:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.955290:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.955299:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 9 pid: 1947 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.955307:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627470720:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.955330:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143839.955338:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 9 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.955360:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627470848:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143839.955376:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143839.955392:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16541 00000100:00100000:1.0:1746143839.955397:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624985216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.955404:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.955410:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b20ac600/0x87925e4cb73b507c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484119fd expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143839.955435:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470976:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143839.955454:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143839.956513:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.956630:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624985472 00000100:00100000:2.0:1746143839.956639:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624985472 00002000:00100000:2.0:1746143839.956667:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3997696->4001791) req@ffff880093414e00 x1830963624985472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.956675:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963624985472 ext(3997696->4001791) 00002000:00010000:2.0:1746143839.956679:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:2.0:1746143839.956703:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7187 00000100:00100000:2.0:1746143839.956708:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624985472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143839.957813:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963624985472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 1098us (1295us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143839.957821:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7187 00002000:00100000:2.0:1746143839.957828:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3997696->4001791) req@ffff880093414e00 x1830963624985472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/4536 e 0 to 0 dl 1746143850 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.957835:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963624985472 ext(3997696->4001791) 00002000:00010000:2.0:1746143839.957838:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:1.0:1746143839.961041:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627470592:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143839.961051:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627470720:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143839.961057:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627470848:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143839.961080:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1552384->2097151] (req 1552384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.961094:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85e00, rc 0) 00000100:00100000:1.0:1746143839.961127:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2730:x1830963624985088:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6031us (6232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.961135:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16540 00000100:00100000:0.0:1746143839.962106:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.962138:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.962150:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.962163:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624985728 00000100:00100000:3.0:1746143839.962170:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624985728 00000100:00100000:0.0:1746143839.962178:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143839.962193:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 10 pid: 1947 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143839.962211:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624985856 00000100:00100000:3.0:1746143839.962213:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624985856 00010000:00010000:3.0:1746143839.962223:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143839.962234:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624985600 00000100:00100000:3.0:1746143839.962236:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624985600 00010000:00010000:3.0:1746143839.962243:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 30 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143839.962266:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8049 00000100:00100000:3.0:1746143839.962272:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963624985728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143839.962283:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143839.962301:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 10 pid: 1947 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.962310:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8050 00010000:00010000:3.0:1746143839.962313:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 10 pid: 1947 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143839.962315:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963624985856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143839.962322:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143839.962329:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.962339:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b503d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119cc expref: 10 pid: 1947 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143839.962343:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143839.962359:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5acc00/0x87925e4cb73b4f2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841194e expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.962360:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143839.962369:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143839.962381:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963624985728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.962381:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963624985856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143839.962386:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8050 00000100:00100000:3.0:1746143839.963510:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8049 00000100:00100000:3.0:1746143839.963529:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8051 00000100:00100000:3.0:1746143839.963536:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963624985600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143839.963544:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143839.963553:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 30 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.963562:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 30 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.963575:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086600/0x87925e4cb73b4fe9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411986 expref: 30 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143839.963583:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.963585:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.963591:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.963599:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.963625:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143839.963635:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627471104:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143839.963675:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143839.964434:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624986112 00000100:00100000:1.0:1746143839.964441:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624986112 00000100:00100000:1.0:1746143839.964463:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5408 00000100:00100000:1.0:1746143839.964468:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2732:x1830963624986112:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143839.964621:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2732:x1830963624986112:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 152us (2442us total) trans 8589945031 rc 0/0 00000100:00100000:1.0:1746143839.964626:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5408 00000100:00100000:1.0:1746143839.964967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143839.964987:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624986240 00000100:00100000:1.0:1746143839.964990:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624986240 00000100:00100000:1.0:1746143839.965021:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16542 00000100:00100000:1.0:1746143839.965026:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2731:x1830963624986240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143839.965035:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143839.965043:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a0b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.965059:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.965064:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143839.965066:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143839.965068:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 10 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.965084:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.965092:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.965099:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627471232:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143839.965132:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78b600 going to sleep for 11 seconds 00002000:00010000:2.0:1746143839.965322:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143838 -> 1746143840 00002000:00010000:2.0:1746143839.965325:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143838 -> 1746143840 00002000:00010000:2.0:1746143839.965327:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime: 1746143838 -> 1746143840 00000100:00100000:2.0:1746143839.965335:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627470976:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143839.965362:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b20ac600/0x87925e4cb73b507c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119fd expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143839.965375:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b20ac600/0x87925e4cb73b507c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119fd expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143839.965385:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b20ac600, rc 0) 00000100:00100000:2.0:1746143839.965401:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624985216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10004us (10439us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143839.965405:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16541 00010000:00010000:1.0:1746143839.969606:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143839.969682:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627471232:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143839.969707:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 10 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.969721:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521c00, rc 0) 00000100:00100000:0.0:1746143839.969820:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2731:x1830963624986240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4792us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143839.969828:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16542 00000100:00100000:1.0:1746143839.969875:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.970007:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627471104:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143839.970018:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143839.970040:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963624985600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6505us (7888us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.970047:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8051 00000100:00100000:0.0:1746143839.970194:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624986368 00000100:00100000:0.0:1746143839.970199:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624986368 00000100:00100000:0.0:1746143839.970222:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16543 00000100:00100000:0.0:1746143839.970227:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:2733:x1830963624986368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143839.970238:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143839.970247:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a12 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.970266:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.970272:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143839.970274:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143839.970276:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.970296:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 9 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143839.970304:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 9 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143839.970314:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627471360:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143839.970368:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143839.971672:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.972491:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624986624 00000100:00100000:2.0:1746143839.972497:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624986624 00002000:00100000:2.0:1746143839.972532:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1552384->1556479) req@ffff880093415f80 x1830963624986624/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.972541:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963624986624 ext(1552384->1556479) 00010000:00010000:2.0:1746143839.972547:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.972557:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143839.972562:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093415f80 00000100:00100000:2.0:1746143839.972765:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2658 00000100:00100000:2.0:1746143839.972773:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624986624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143839.972877:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624986624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 105us (1207us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143839.972883:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2658 00002000:00100000:2.0:1746143839.972889:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1552384->1556479) req@ffff880093415f80 x1830963624986624/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/4536 e 0 to 0 dl 1746143850 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.972895:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963624986624 ext(1552384->1556479) 00010000:00010000:2.0:1746143839.972900:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.972907:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 29 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143839.972929:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093415f80 00000100:00100000:0.0:1746143839.973744:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.973930:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624986752 00000100:00100000:3.0:1746143839.973935:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624986752 00002000:00100000:3.0:1746143839.973955:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3817472->4001791) req@ffff880093416d80 x1830963624986752/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.973961:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963624986752 ext(3817472->4001791) 00010000:00010000:3.0:1746143839.973966:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 10 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143839.973973:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 10 pid: 3135 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143839.973982:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093416d80 00000100:00100000:3.0:1746143839.973994:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2659 00000100:00100000:3.0:1746143839.973999:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963624986752:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143839.974209:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627471360:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143839.974228:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143839.974239:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a400, rc 0) 00000100:00100000:2.0:1746143839.974269:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2733:x1830963624986368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4041us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143839.974275:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16543 00000100:00100000:0.0:1746143839.982672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.982717:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143839.982810:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624987136 00000100:00100000:2.0:1746143839.982817:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624987136 00002000:00100000:2.0:1746143839.982852:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1552384->2097151) req@ffff880093417480 x1830963624987136/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/0 e 0 to 0 dl 1746143850 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.982860:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417480 with x1830963624987136 ext(1552384->2097151) 00010000:00010000:2.0:1746143839.982868:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 28 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.982884:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 28 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143839.982890:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093417480 00000100:00100000:2.0:1746143839.982907:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2660 00000100:00100000:2.0:1746143839.982936:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624987136:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143839.983123:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624987008 00000100:00100000:3.0:1746143839.983127:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624987008 00000100:00100000:3.0:1746143839.983148:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16544 00000100:00100000:3.0:1746143839.983152:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2730:x1830963624987008:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143839.983160:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143839.983173:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a19 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.983190:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143839.983194:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.983198:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143839.983201:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.983228:0:13436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.983237:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.983248:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f6d600, rc 0) 00000100:00100000:3.0:1746143839.983270:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2730:x1830963624987008:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 117us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143839.983275:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16544 00000100:00100000:3.0:1746143839.992558:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624986752:12345-192.168.202.3@tcp:4:cat.0 Request processed in 18548us (18804us total) trans 17179873962 rc 0/0 00000100:00100000:3.0:1746143839.992569:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2659 00002000:00100000:3.0:1746143839.992580:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3817472->4001791) req@ffff880093416d80 x1830963624986752/t17179873962(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:235/0 lens 488/448 e 0 to 0 dl 1746143850 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143839.992589:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963624986752 ext(3817472->4001791) 00010000:00010000:3.0:1746143839.992598:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 12 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143839.992611:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 12 pid: 3135 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143839.992617:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093416d80 00000100:00100000:2.0:1746143839.994839:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963624987136:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11919us (12114us total) trans 17179873963 rc 0/0 00000100:00100000:2.0:1746143839.994849:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2660 00002000:00100000:2.0:1746143839.994858:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1552384->2097151) req@ffff880093417480 x1830963624987136/t17179873963(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:235/0 lens 488/448 e 0 to 0 dl 1746143850 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143839.994867:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417480 with x1830963624987136 ext(1552384->2097151) 00010000:00010000:2.0:1746143839.994875:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143839.994885:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143839.994891:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093417480 00000100:00100000:0.0:1746143839.997343:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143839.997434:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143839.997613:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624987264 00000100:00100000:3.0:1746143839.997621:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624987264 00010000:00010000:3.0:1746143839.997649:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 12 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.997731:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624987392 00000100:00100000:1.0:1746143839.997734:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624987392 00010000:00010000:1.0:1746143839.997746:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143839.997773:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8052 00000100:00100000:1.0:1746143839.997780:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963624987392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143839.997790:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143839.997803:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143838 -> 1746143840 00002000:00010000:1.0:1746143839.997805:0:7229:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143838 -> 1746143840 00010000:00010000:1.0:1746143839.997809:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.997818:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143839.997835:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85e00/0x87925e4cb73b5075 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a04 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143839.998026:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8053 00000100:00100000:3.0:1746143839.998332:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963624987264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143839.998342:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143839.998358:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 12 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143839.998367:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 12 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143839.998376:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7d200/0x87925e4cb73b506e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3817472->4001791) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119f6 expref: 12 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143839.998397:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.998399:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143839.998404:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.998412:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.998457:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.998458:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143839.998463:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.998470:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143839.998490:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143839.998500:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627471616:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143839.998551:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143839.999136:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143839.999145:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143839.999154:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627471744:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143839.999195:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.004980:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627471744:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143840.005000:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.005044:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2010:x1830963624987264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7012us (7706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.005053:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8053 00000100:00100000:1.0:1746143840.005120:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627471616:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143840.005131:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.005147:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963624987392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7368us (7714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.005152:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8052 00000100:00100000:0.0:1746143840.006268:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.006541:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624987648 00000100:00100000:3.0:1746143840.006548:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624987648 00002000:00100000:3.0:1746143840.006602:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009322ed80 x1830963624987648/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.006611:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ed80 with x1830963624987648 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.006615:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322ed80 00000100:00100000:3.0:1746143840.006640:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7188 00000100:00100000:3.0:1746143840.006648:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624987648:12345-192.168.202.3@tcp:3:cat.0 00000100:00080000:0.0:1746143840.006742:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143840.015985:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.016977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.017276:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624987904 00000100:00100000:2.0:1746143840.017285:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624987904 00002000:00100000:2.0:1746143840.017322:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009322f100 x1830963624987904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.017332:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f100 with x1830963624987904 ext(2097152->4194303) 00010000:00010000:2.0:1746143840.017341:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.017363:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143840.017371:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322f100 00000100:00100000:2.0:1746143840.017402:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624988160 00000100:00100000:2.0:1746143840.017405:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624988160 00002000:00100000:2.0:1746143840.017418:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009322ce00 x1830963624988160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.017425:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ce00 with x1830963624988160 ext(2097152->4194303) 00002000:00010000:2.0:1746143840.017428:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ce00 00000100:00100000:2.0:1746143840.017440:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2661 00000100:00100000:2.0:1746143840.017446:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624987904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.018467:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7189 00000100:00100000:1.0:1746143840.018484:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624988160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143840.019987:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624987648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13337us (13722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143840.019995:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7188 00002000:00100000:3.0:1746143840.020004:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009322ed80 x1830963624987648/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.020012:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ed80 with x1830963624987648 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.020017:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322ed80 00000100:00100000:0.0:1746143840.043987:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.044205:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963624987904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26751us (28220us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143840.044217:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2661 00002000:00100000:2.0:1746143840.044225:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009322f100 x1830963624987904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.044234:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f100 with x1830963624987904 ext(2097152->4194303) 00000100:00100000:3.0:1746143840.044242:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624988288 00010000:00010000:2.0:1746143840.044242:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.044249:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624988288 00010000:00010000:2.0:1746143840.044254:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 30 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143840.044260:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322f100 00000100:00100000:3.0:1746143840.044281:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16545 00000100:00100000:3.0:1746143840.044287:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2731:x1830963624988288:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.044300:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.044312:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a20 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.044331:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.044336:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.044342:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143840.044357:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.044391:0:13436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2338815] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 29 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.044402:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.044410:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32800, rc 0) 00000100:00100000:3.0:1746143840.044428:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2731:x1830963624988288:12345-192.168.202.3@tcp:101:cat.0 Request processed in 141us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.044433:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16545 00000100:00100000:1.0:1746143840.052987:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624988160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 34504us (36003us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143840.052998:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7189 00002000:00100000:1.0:1746143840.053009:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009322ce00 x1830963624988160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.053017:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ce00 with x1830963624988160 ext(2097152->4194303) 00002000:00010000:1.0:1746143840.053023:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ce00 00000100:00100000:0.0:1746143840.058117:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.058213:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624988416 00000100:00100000:3.0:1746143840.058224:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624988416 00000100:00100000:3.0:1746143840.058288:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16546 00000100:00100000:3.0:1746143840.058296:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2733:x1830963624988416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.058312:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.058327:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a27 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.058362:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.058365:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.058371:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.058385:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 31 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.058394:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0ca00, rc 0) 00000100:00100000:3.0:1746143840.058454:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2733:x1830963624988416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 159us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.058460:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16546 00000100:00100000:0.0:1746143840.059596:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.061418:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624988544 00000100:00100000:1.0:1746143840.061428:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624988544 00010000:00010000:1.0:1746143840.061461:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.061499:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8054 00000100:00100000:1.0:1746143840.061506:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963624988544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.061516:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.061532:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.061543:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.061568:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d0a400/0x87925e4cb73b508a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a12 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.061593:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.061595:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.061601:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.061609:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.061637:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.061651:0:7229:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 30 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.061671:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627472000:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143840.061736:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.066134:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627472000:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143840.066158:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.066222:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624988544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4714us (6627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.066233:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8054 00000100:00100000:0.0:1746143840.066746:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.067882:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624988800 00000100:00100000:1.0:1746143840.067892:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624988800 00002000:00100000:1.0:1746143840.067954:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009322c000 x1830963624988800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.067963:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c000 with x1830963624988800 ext(3145728->4194303) 00002000:00010000:1.0:1746143840.067966:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322c000 00000100:00100000:0.0:1746143840.068499:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.070650:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624989056 00000100:00100000:1.0:1746143840.070662:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624989056 00002000:00100000:1.0:1746143840.070711:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2334720->2338815) req@ffff88009322f480 x1830963624989056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.070721:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f480 with x1830963624989056 ext(2334720->2338815) 00010000:00010000:1.0:1746143840.070730:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.070745:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143840.070751:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322f480 00000100:00100000:1.0:1746143840.070769:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2662 00000100:00100000:1.0:1746143840.070776:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963624989056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.070932:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963624989056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 156us (2434us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143840.070937:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2662 00002000:00100000:1.0:1746143840.070942:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2334720->2338815) req@ffff88009322f480 x1830963624989056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.070949:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f480 with x1830963624989056 ext(2334720->2338815) 00010000:00010000:1.0:1746143840.070953:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.070961:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 31 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143840.070966:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322f480 00000100:00100000:3.0:1746143840.070975:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7190 00000100:00100000:3.0:1746143840.070994:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963624988800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143840.080694:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.082562:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624989312 00000100:00100000:1.0:1746143840.082575:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624989312 00002000:00100000:1.0:1746143840.082622:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2338815) req@ffff88009322c380 x1830963624989312/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.082633:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c380 with x1830963624989312 ext(2097152->2338815) 00010000:00010000:1.0:1746143840.082642:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 32 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.082656:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 32 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143840.082662:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322c380 00000100:00100000:1.0:1746143840.082697:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2663 00000100:00100000:1.0:1746143840.082705:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624989312:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143840.083023:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624988800:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12029us (16270us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143840.083032:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7190 00002000:00100000:3.0:1746143840.083042:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009322c000 x1830963624988800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.083051:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c000 with x1830963624988800 ext(3145728->4194303) 00002000:00010000:3.0:1746143840.083056:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322c000 00000100:00100000:0.0:1746143840.090085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.090126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.090294:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624989440 00000100:00100000:3.0:1746143840.090306:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624989440 00000100:00100000:3.0:1746143840.090365:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624989568 00000100:00100000:3.0:1746143840.090368:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624989568 00000100:00100000:3.0:1746143840.090390:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16547 00000100:00100000:3.0:1746143840.090397:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624989440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.090412:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.090426:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a2e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.090444:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.090446:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.090453:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.090466:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.090475:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:1.0:1746143840.090500:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16548 00000100:00100000:1.0:1746143840.090514:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624989568:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143840.090525:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624989440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 127us (452us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143840.090529:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143840.090531:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16547 00010000:00010000:1.0:1746143840.090543:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73b50ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a35 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.090574:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73b50ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a35 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.090583:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520e00/0x87925e4cb73b50ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a35 expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.091277:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520e00, rc 0) 00000100:00100000:1.0:1746143840.091318:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963624989568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 807us (1190us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143840.091324:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16548 00000100:00100000:3.0:1746143840.093090:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624989312:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10380us (12402us total) trans 17179873964 rc 0/0 00000100:00100000:3.0:1746143840.093229:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2663 00002000:00100000:3.0:1746143840.093240:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2338815) req@ffff88009322c380 x1830963624989312/t17179873964(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.093248:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c380 with x1830963624989312 ext(2097152->2338815) 00010000:00010000:3.0:1746143840.093257:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 33 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.093272:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 33 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143840.093276:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322c380 00000100:00100000:0.0:1746143840.098135:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.098192:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.098240:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624989824 00000100:00100000:1.0:1746143840.098257:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624989824 00010000:00010000:1.0:1746143840.098292:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 33 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.098338:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8055 00000100:00100000:1.0:1746143840.098344:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624989824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.098362:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.098380:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 33 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.098390:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 33 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.098410:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b5091 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2338815) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a19 expref: 33 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.098428:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.098430:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.098436:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.098442:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.098473:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143840.098484:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627472128:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143840.098567:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.098615:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624989952 00000100:00100000:3.0:1746143840.098619:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624989952 00002000:00100000:3.0:1746143840.098644:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095e30700 x1830963624989952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.098651:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30700 with x1830963624989952 ext(4194304->4853759) 00000100:00100000:0.0:1746143840.098652:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:3.0:1746143840.098655:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e30700 00000100:00100000:3.0:1746143840.098670:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7191 00000100:00100000:3.0:1746143840.098675:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963624989952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.098799:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624990208 00000100:00100000:2.0:1746143840.098803:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624990208 00000100:00100000:2.0:1746143840.098832:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13977 00000100:00100000:2.0:1746143840.098837:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2737:x1830963624990208:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.098848:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.098859:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b50b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a3c expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.098904:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.098936:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.098944:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.098954:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.098958:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.098962:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.099820:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.099828:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.099834:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143840.099840:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.099894:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.099899:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.099903:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.099907:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100301:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.100304:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100310:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100319:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.100321:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.100324:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100328:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100339:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100359:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100363:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100367:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ce00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.100370:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100373:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100379:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ed00) 00010000:00010000:2.0:1746143840.100381:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.100383:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100387:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b50c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.100419:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b50b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 13 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.100429:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.100434:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.100436:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143840.100438:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ca00, rc 0) 00000100:00100000:2.0:1746143840.100471:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2737:x1830963624990208:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1634us (1820us total) trans 8589945032 rc 0/0 00000100:00100000:2.0:1746143840.100478:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13977 00000100:00100000:0.0:1746143840.106032:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627472128:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143840.106057:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.106122:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624989824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7776us (7995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.106136:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8055 00000100:00100000:3.0:1746143840.113570:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624989952:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14885us (15367us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143840.113581:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7191 00002000:00100000:3.0:1746143840.113590:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095e30700 x1830963624989952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.113599:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30700 with x1830963624989952 ext(4194304->4853759) 00002000:00010000:3.0:1746143840.113604:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e30700 00000100:00100000:0.0:1746143840.117155:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.117445:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624990464 00000100:00100000:3.0:1746143840.117459:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624990464 00002000:00100000:3.0:1746143840.117502:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880095e32680 x1830963624990464/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.117516:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32680 with x1830963624990464 ext(2097152->4194303) 00002000:00010000:3.0:1746143840.117520:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32680 00000100:00100000:3.0:1746143840.118831:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7192 00000100:00100000:3.0:1746143840.118842:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624990464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.122125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.123649:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624990720 00000100:00100000:2.0:1746143840.123661:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624990720 00002000:00100000:2.0:1746143840.123732:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b49180 x1830963624990720/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.123741:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963624990720 ext(2097152->4194303) 00002000:00010000:2.0:1746143840.123746:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49180 00000100:00100000:2.0:1746143840.123783:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7193 00000100:00100000:2.0:1746143840.123792:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624990720:12345-192.168.202.3@tcp:3:cat.0 00000100:00080000:0.0:1746143840.124440:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143840.133683:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.134098:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624990848 00000100:00100000:2.0:1746143840.134111:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624990848 00000100:00100000:2.0:1746143840.134175:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16549 00000100:00100000:2.0:1746143840.134182:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963624990848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.134198:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.134212:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a43 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.134230:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.134231:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.134237:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.134249:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.134258:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c800, rc 0) 00000100:00100000:2.0:1746143840.134301:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963624990848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 120us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.134306:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16549 00000100:00100000:3.0:1746143840.139468:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624990464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20616us (22311us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143840.139482:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7192 00002000:00100000:3.0:1746143840.139494:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880095e32680 x1830963624990464/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.139504:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32680 with x1830963624990464 ext(2097152->4194303) 00002000:00010000:3.0:1746143840.139510:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32680 00000100:00100000:2.0:1746143840.149866:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624990720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 26068us (27738us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143840.149877:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7193 00002000:00100000:2.0:1746143840.149888:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b49180 x1830963624990720/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.149896:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963624990720 ext(2097152->4194303) 00002000:00010000:2.0:1746143840.149901:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49180 00000100:00100000:0.0:1746143840.157546:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.157589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.157675:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624991232 00000100:00100000:3.0:1746143840.157688:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624991232 00000100:00100000:3.0:1746143840.157752:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5409 00000100:00100000:3.0:1746143840.157761:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2733:x1830963624991232:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143840.157977:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624990976 00000100:00100000:1.0:1746143840.157985:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624990976 00000100:00100000:3.0:1746143840.158015:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2733:x1830963624991232:12345-192.168.202.3@tcp:35:cat.0 Request processed in 254us (424us total) trans 8589945033 rc 0/0 00000100:00100000:3.0:1746143840.158022:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5409 00000100:00100000:1.0:1746143840.158034:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16550 00000100:00100000:1.0:1746143840.158041:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2737:x1830963624990976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143840.158057:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.158071:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a4a expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.158095:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.158103:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.158109:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.158110:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.158114:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->2904063] (req 2617344->2904063) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.158138:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 32 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.158149:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 32 pid: 13430 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143840.158160:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627472256:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143840.158236:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.158244:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 13 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.158252:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627472384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.159051:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.161673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.161772:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624991488 00000100:00100000:2.0:1746143840.161782:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624991488 00002000:00100000:2.0:1746143840.161832:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095e30380 x1830963624991488/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.161843:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30380 with x1830963624991488 ext(4194304->4853759) 00010000:00010000:2.0:1746143840.161851:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.161864:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143840.161871:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095e30380 00000100:00100000:2.0:1746143840.162132:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2664 00000100:00100000:2.0:1746143840.162140:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624991488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.165623:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.165684:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624991616 00000100:00100000:0.0:1746143840.165693:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624991616 00010000:00010000:0.0:1746143840.165730:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 33 pid: 13430 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746143840.165758:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8056 00000100:00100000:0.0:1746143840.165765:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624991616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.165779:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.165800:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 33 pid: 13430 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746143840.165811:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 33 pid: 13430 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746143840.165837:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.165884:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963624991616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.165890:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8056 00010000:00010000:1.0:1746143840.166043:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b50d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a43 expref: 32 pid: 13430 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143840.166069:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627472256:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.166079:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627472384:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143840.166106:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2617344->2904063] (req 2617344->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.166117:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849c00, rc 0) 00000100:00100000:1.0:1746143840.166140:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2737:x1830963624990976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8100us (8601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.166147:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16550 00000100:00100000:2.0:1746143840.168845:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624991488:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6694us (7173us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143840.168856:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2664 00002000:00100000:2.0:1746143840.168867:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095e30380 x1830963624991488/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.168877:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30380 with x1830963624991488 ext(4194304->4853759) 00010000:00010000:2.0:1746143840.168887:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 13 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.168900:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 13 pid: 13436 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143840.168907:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095e30380 00000100:00100000:0.0:1746143840.174403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.174453:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.174544:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624991744 00000100:00100000:1.0:1746143840.174554:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624991744 00000100:00100000:2.0:1746143840.174669:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624991872 00000100:00100000:2.0:1746143840.174673:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624991872 00010000:00010000:2.0:1746143840.174697:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.174733:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8057 00000100:00100000:2.0:1746143840.174741:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963624991872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.174755:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.174777:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.174789:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.174861:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32800/0x87925e4cb73b5098 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a20 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.174887:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.174889:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.174896:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.174903:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143840.175136:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16551 00000100:00100000:1.0:1746143840.175203:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624991744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.175219:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.175230:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848e00/0x87925e4cb73b50e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a51 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.175244:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.175248:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848e00/0x87925e4cb73b50e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a51 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.175255:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848e00/0x87925e4cb73b50e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a51 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143840.175256:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cf8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627472512:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143840.175266:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848e00, rc 0) 00000100:00100000:1.0:1746143840.175309:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624991744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 108us (921us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143840.175594:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.176102:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16551 00000100:00100000:0.0:1746143840.177085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.177496:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624992000 00000100:00100000:1.0:1746143840.177505:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624992000 00000100:00100000:1.0:1746143840.177560:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16552 00000100:00100000:1.0:1746143840.177567:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2731:x1830963624992000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.177586:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.177600:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a58 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.177627:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.177628:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.177641:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.177653:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.177666:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848600, rc 0) 00000100:00100000:1.0:1746143840.177706:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2731:x1830963624992000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 140us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.177711:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16552 00000100:00100000:0.0:1746143840.179337:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cf8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627472512:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143840.179364:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.179405:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624991872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4664us (4950us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.179414:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8057 00000100:00100000:0.0:1746143840.181098:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.181146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.181199:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624992256 00000100:00100000:2.0:1746143840.181208:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624992256 00002000:00100000:2.0:1746143840.181248:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2617344->2621439) req@ffff880095e32a00 x1830963624992256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.181258:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963624992256 ext(2617344->2621439) 00002000:00010000:2.0:1746143840.181263:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32a00 00000100:00100000:2.0:1746143840.181291:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7194 00000100:00100000:2.0:1746143840.181298:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963624992256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.181370:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624992384 00000100:00100000:1.0:1746143840.181374:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624992384 00000100:00100000:2.0:1746143840.181448:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963624992256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 150us (354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143840.181455:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7194 00002000:00100000:2.0:1746143840.181460:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2617344->2621439) req@ffff880095e32a00 x1830963624992256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.181465:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e32a00 with x1830963624992256 ext(2617344->2621439) 00002000:00010000:2.0:1746143840.181468:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e32a00 00000100:00100000:1.0:1746143840.181878:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16553 00000100:00100000:1.0:1746143840.181884:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624992384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.181892:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.181907:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b50f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a5f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.181961:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b50f3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a5f expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.181970:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848000/0x87925e4cb73b50f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a5f expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.181985:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848000, rc 0) 00000100:00100000:1.0:1746143840.182012:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624992384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 129us (866us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143840.182017:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16553 00000100:00100000:0.0:1746143840.185532:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.185850:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624992640 00000100:00100000:2.0:1746143840.185861:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624992640 00002000:00100000:2.0:1746143840.185908:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880095e31c00 x1830963624992640/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.185942:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31c00 with x1830963624992640 ext(4849664->4853759) 00002000:00010000:2.0:1746143840.185947:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31c00 00000100:00100000:2.0:1746143840.185980:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7195 00000100:00100000:2.0:1746143840.185987:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2010:x1830963624992640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.186314:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2010:x1830963624992640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 326us (792us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143840.186321:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7195 00002000:00100000:2.0:1746143840.186327:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880095e31c00 x1830963624992640/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.186334:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31c00 with x1830963624992640 ext(4849664->4853759) 00002000:00010000:2.0:1746143840.186336:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31c00 00000100:00100000:0.0:1746143840.186625:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.186673:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624992896 00000100:00100000:2.0:1746143840.186678:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624992896 00002000:00100000:2.0:1746143840.186692:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2899968->2904063) req@ffff880095e31880 x1830963624992896/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.186704:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31880 with x1830963624992896 ext(2899968->2904063) 00002000:00010000:2.0:1746143840.186707:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31880 00000100:00100000:2.0:1746143840.186725:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7196 00000100:00100000:2.0:1746143840.186730:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624992896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.186880:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624992896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 149us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143840.186886:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7196 00002000:00100000:2.0:1746143840.187032:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2899968->2904063) req@ffff880095e31880 x1830963624992896/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.187041:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31880 with x1830963624992896 ext(2899968->2904063) 00002000:00010000:2.0:1746143840.187044:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31880 00000100:00100000:0.0:1746143840.191076:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.191227:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624993152 00000100:00100000:2.0:1746143840.191239:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624993152 00000100:00100000:2.0:1746143840.191299:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5410 00000100:00100000:2.0:1746143840.191307:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2731:x1830963624993152:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143840.191527:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2731:x1830963624993152:12345-192.168.202.3@tcp:35:cat.0 Request processed in 221us (463us total) trans 8589945034 rc 0/0 00000100:00100000:2.0:1746143840.191534:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5410 00000100:00100000:0.0:1746143840.192994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.193041:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624993408 00000100:00100000:3.0:1746143840.193048:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624993408 00000100:00100000:3.0:1746143840.193092:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5411 00000100:00100000:3.0:1746143840.193098:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2737:x1830963624993408:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143840.193238:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2737:x1830963624993408:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 139us (247us total) trans 8589945035 rc 0/0 00000100:00100000:3.0:1746143840.193245:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5411 00000100:00100000:0.0:1746143840.200078:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.200405:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624993664 00000100:00100000:2.0:1746143840.200417:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624993664 00000100:00100000:2.0:1746143840.200483:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13978 00000100:00100000:2.0:1746143840.200492:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:2740:x1830963624993664:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.200517:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.200538:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a66 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.200618:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200631:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200641:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200654:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200659:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200664:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200764:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200773:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200779:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143840.200789:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.200870:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200877:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200883:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200888:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200893:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408cc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.200897:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.200903:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201062:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.201066:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.201070:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201076:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408cc00/0x87925e4cb73b5101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201090:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201094:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201099:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201103:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ce00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.201105:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.201113:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.202736:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ec00) 00010000:00010000:2.0:1746143840.202740:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.202746:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.202752:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5108 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.202818:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b50fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.202829:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 265 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.202835:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.202837:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143840.202840:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408dc00, rc 0) 00000100:00100000:2.0:1746143840.203116:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:2740:x1830963624993664:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2624us (3047us total) trans 8589945036 rc 0/0 00000100:00100000:2.0:1746143840.203124:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13978 00000100:00100000:0.0:1746143840.205799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.205884:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624993920 00000100:00100000:2.0:1746143840.205894:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624993920 00000100:00100000:2.0:1746143840.205982:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5412 00000100:00100000:2.0:1746143840.205990:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:2740:x1830963624993920:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143840.206179:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:2740:x1830963624993920:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 190us (389us total) trans 8589945037 rc 0/0 00000100:00100000:2.0:1746143840.206187:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5412 00000100:00100000:0.0:1746143840.228481:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.228724:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624994048 00000100:00100000:3.0:1746143840.228736:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624994048 00000100:00100000:3.0:1746143840.228801:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16554 00000100:00100000:3.0:1746143840.228809:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2740:x1830963624994048:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143840.228829:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.228847:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a6d expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.228878:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.228886:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.228893:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.228899:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.228901:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.228904:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1167360->1613823] (req 1167360->1613823) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.228973:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 28 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.228991:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 28 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.229005:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627472640:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.229108:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.229115:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 11 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.230185:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627472768:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.230356:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.230367:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 10 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.230376:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627472896:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.230401:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.232510:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627472640:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.232521:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627472768:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143840.235892:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.236124:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624994176 00000100:00100000:2.0:1746143840.236133:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624994176 00010000:00010000:2.0:1746143840.236172:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 12 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.236209:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8058 00000100:00100000:2.0:1746143840.236221:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963624994176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.236238:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.236259:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 12 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.236269:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 12 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.236290:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b5036 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119c5 expref: 12 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746143840.236320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143840.236323:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.236401:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627472896:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.236434:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1167360->1613823] (req 1167360->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.236451:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32a00, rc 0) 00000100:00100000:0.0:1746143840.236515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.236531:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624994176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 314us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.236537:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624994432 00000100:00100000:2.0:1746143840.236539:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8058 00000100:00100000:0.0:1746143840.236540:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624994432 00000100:00100000:2.0:1746143840.236554:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624994304 00010000:00010000:0.0:1746143840.236555:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 29 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.236557:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624994304 00000100:00100000:0.0:1746143840.236572:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8059 00010000:00010000:2.0:1746143840.236576:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 11 pid: 12327 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746143840.236577:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963624994432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.236584:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.236593:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 29 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746143840.236601:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 29 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.236602:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8060 00000100:00100000:2.0:1746143840.236607:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963624994304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.236614:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.236619:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b4fbf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841197f expref: 29 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.236621:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 11 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.236630:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 11 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746143840.236636:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143840.236642:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b4f17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411947 expref: 11 pid: 12327 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.236651:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143840.236652:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963624994432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (332us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143840.236654:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143840.236657:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8059 00010000:00010000:2.0:1746143840.236659:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746143840.236664:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143840.236667:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.236695:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143840.236706:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627473024:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.236740:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2740:x1830963624994048:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7931us (8270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.236746:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16554 00000100:00100000:2.0:1746143840.236757:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800938549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.240165:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.240237:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624994688 00000100:00100000:3.0:1746143840.240246:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624994688 00000100:00100000:2.0:1746143840.240273:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627473024:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143840.240293:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143840.240295:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1167360->1171455) req@ffff88009322e300 x1830963624994688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.240304:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322e300 with x1830963624994688 ext(1167360->1171455) 00002000:00010000:3.0:1746143840.240308:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322e300 00000100:00100000:2.0:1746143840.240342:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963624994304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3734us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.240360:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8060 00000100:00100000:3.0:1746143840.241168:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7197 00000100:00100000:3.0:1746143840.241177:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624994688:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143840.241321:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624994688:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 145us (1166us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143840.241328:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7197 00002000:00100000:3.0:1746143840.241334:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1167360->1171455) req@ffff88009322e300 x1830963624994688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.241342:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322e300 with x1830963624994688 ext(1167360->1171455) 00002000:00010000:3.0:1746143840.241356:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322e300 00000100:00100000:0.0:1746143840.249167:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.249371:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624994944 00000100:00100000:2.0:1746143840.249383:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624994944 00002000:00100000:2.0:1746143840.249431:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1609728->1613823) req@ffff88009322e680 x1830963624994944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.249441:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322e680 with x1830963624994944 ext(1609728->1613823) 00002000:00010000:2.0:1746143840.249446:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322e680 00000100:00100000:2.0:1746143840.249478:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7198 00000100:00100000:2.0:1746143840.249485:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624994944:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143840.249948:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624994944:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 462us (790us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143840.249955:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7198 00002000:00100000:2.0:1746143840.249960:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1609728->1613823) req@ffff88009322e680 x1830963624994944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.249966:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322e680 with x1830963624994944 ext(1609728->1613823) 00002000:00010000:2.0:1746143840.249969:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322e680 00000100:00100000:0.0:1746143840.324883:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.325155:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624995200 00000100:00100000:2.0:1746143840.325197:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624995200 00000100:00100000:2.0:1746143840.325252:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13979 00000100:00100000:2.0:1746143840.325260:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2746:x1830963624995200:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.325287:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.325319:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a74 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.325410:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325423:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325433:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325446:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325452:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325461:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325572:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5139 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325582:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5139 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325588:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5139 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143840.325596:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.325670:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325676:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325682:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325688:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325693:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7fa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.325696:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325702:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325713:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.325715:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.325719:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325724:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b512b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325739:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325744:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325748:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325751:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.325753:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325762:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325767:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ed00) 00010000:00010000:2.0:1746143840.325769:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.325771:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325775:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b5132 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.325811:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a74 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.325822:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5139 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a74 expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.325828:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.325829:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143840.325832:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ce00, rc 0) 00000100:00100000:2.0:1746143840.325880:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2746:x1830963624995200:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 621us (1009us total) trans 8589945038 rc 0/0 00000100:00100000:2.0:1746143840.325887:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13979 00000100:00100000:0.0:1746143840.330364:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.330580:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624995328 00000100:00100000:2.0:1746143840.330589:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624995328 00000100:00100000:2.0:1746143840.330657:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 992 00000100:00100000:2.0:1746143840.330665:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963624995328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.330680:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.330708:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5139 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a74 expref: 16 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.330725:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.330729:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.330775:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963624995328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.330782:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 992 00000100:00100000:0.0:1746143840.390475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.390609:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624995584 00000100:00100000:2.0:1746143840.390620:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624995584 00000100:00100000:2.0:1746143840.390686:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13980 00000100:00100000:2.0:1746143840.390694:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:2749:x1830963624995584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.390719:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.390741:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a7b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.390819:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.390832:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.390844:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.390858:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.390864:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.390869:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391010:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b515c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391020:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b515c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391026:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b515c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143840.391034:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.391108:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391114:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391119:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391124:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391129:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.391133:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391139:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391148:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.391151:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.391155:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391164:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408c800/0x87925e4cb73b514e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391187:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391192:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391197:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391201:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7f800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.391203:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391208:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391214:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ec00) 00010000:00010000:2.0:1746143840.391216:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.391218:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391222:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7f800/0x87925e4cb73b5155 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143840.391259:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ce00/0x87925e4cb73b5147 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a7b expref: 269 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.391269:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b515c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a7b expref: 268 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.391280:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.391281:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143840.391283:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7fa00, rc 0) 00000100:00100000:2.0:1746143840.391332:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+268:2749:x1830963624995584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 639us (868us total) trans 8589945039 rc 0/0 00000100:00100000:2.0:1746143840.391338:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13980 00000100:00100000:0.0:1746143840.400762:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.402634:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624995712 00000100:00100000:2.0:1746143840.402650:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624995712 00000100:00100000:2.0:1746143840.402740:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 993 00000100:00100000:2.0:1746143840.402750:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+268:2011:x1830963624995712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.402768:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.402797:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b515c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a7b expref: 268 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143840.403080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143840.403115:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.403177:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.403230:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+267:2011:x1830963624995712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 482us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.403237:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 993 00000100:00100000:3.0:1746143840.403497:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624995840 00000100:00100000:3.0:1746143840.403502:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624995840 00000100:00100000:3.0:1746143840.403533:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16555 00000100:00100000:3.0:1746143840.403538:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624995840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.403555:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.403568:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33400/0x87925e4cb73b516a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a82 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.403639:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33400/0x87925e4cb73b516a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a82 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.403649:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33400/0x87925e4cb73b516a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a82 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.403716:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33400, rc 0) 00000100:00100000:3.0:1746143840.403749:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624995840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 210us (669us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143840.403754:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16555 00000100:00100000:0.0:1746143840.409191:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.410115:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624995968 00000100:00100000:3.0:1746143840.410125:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624995968 00000100:00100000:3.0:1746143840.410278:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16556 00000100:00100000:3.0:1746143840.410287:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2746:x1830963624995968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143840.410306:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.410324:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a89 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.410366:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.410374:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.410387:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.410393:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.410394:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.410397:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3190784->3878911] (req 3190784->3878911) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.410426:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 26 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.410436:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 26 pid: 9585 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.410447:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627473152:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.412501:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.412518:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 12 pid: 1947 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.412531:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627473280:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.412681:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.412694:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 9 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.412702:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627473408:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.412722:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.416265:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.416370:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624996224 00000100:00100000:1.0:1746143840.416382:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624996224 00000100:00100000:1.0:1746143840.416445:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13981 00000100:00100000:1.0:1746143840.416452:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2752:x1830963624996224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.416472:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.416486:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a90 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.416544:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416554:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416563:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416574:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416579:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416584:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416671:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095db2200/0x87925e4cb73b518d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416678:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095db2200/0x87925e4cb73b518d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416682:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095db2200/0x87925e4cb73b518d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143840.416689:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143840.416746:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416751:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416757:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416761:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416766:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143840.416770:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416775:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416782:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143840.416785:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143840.416788:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416793:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b517f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416814:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416818:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416822:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416825:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4fbb000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143840.416827:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416830:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416835:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b11700) 00010000:00010000:1.0:1746143840.416836:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143840.416838:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416841:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b5186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.416867:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a90 expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.416875:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095db2200/0x87925e4cb73b518d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a90 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.416881:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143840.416882:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143840.416884:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095db2200, rc 0) 00000100:00100000:1.0:1746143840.416968:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2752:x1830963624996224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 515us (713us total) trans 8589945040 rc 0/0 00000100:00100000:1.0:1746143840.416973:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13981 00000100:00100000:3.0:1746143840.422000:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627473152:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143840.422088:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.422148:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.422178:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.422212:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624996480 00000100:00100000:0.0:1746143840.422219:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624996480 00002000:00100000:0.0:1746143840.422264:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096942680 x1830963624996480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.422273:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096942680 with x1830963624996480 ext(0->1048575) 00002000:00010000:0.0:1746143840.422278:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096942680 00000100:00100000:0.0:1746143840.422292:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624996864 00000100:00100000:0.0:1746143840.422294:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624996864 00002000:00100000:0.0:1746143840.422305:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880096941880 x1830963624996864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 504/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.422311:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096941880 with x1830963624996864 ext(1048576->2097151) 00002000:00010000:0.0:1746143840.422314:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096941880 00000100:00100000:0.0:1746143840.422324:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7199 00000100:00100000:0.0:1746143840.422331:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963624996480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.422534:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7200 00000100:00100000:2.0:1746143840.422543:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963624996864:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143840.422981:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627473280:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.422991:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627473408:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.423031:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3190784->3878911] (req 3190784->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.423047:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32800, rc 0) 00000100:00100000:3.0:1746143840.423111:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2746:x1830963624995968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12825us (13930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.423119:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16556 00000100:00100000:3.0:1746143840.423159:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624996608 00000100:00100000:3.0:1746143840.423163:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624996608 00010000:00010000:3.0:1746143840.423177:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 29 pid: 9585 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.423194:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8061 00000100:00100000:3.0:1746143840.423199:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963624996608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.423208:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.423222:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 29 pid: 9585 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143840.423232:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 29 pid: 9585 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143840.423253:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b4fd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411994 expref: 29 pid: 9585 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143840.423274:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.423288:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963624996608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.423293:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8061 00000100:00100000:1.0:1746143840.427979:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.428894:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.428939:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.428963:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997248 00000100:00100000:1.0:1746143840.428972:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997248 00010000:00010000:1.0:1746143840.429005:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143840.429028:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997376 00000100:00100000:1.0:1746143840.429030:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997376 00000100:00100000:1.0:1746143840.429046:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8062 00000100:00100000:1.0:1746143840.429052:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963624997248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.429064:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.429083:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143840.429094:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746143840.429104:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 994 00000100:00100000:0.0:1746143840.429112:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963624997376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.429116:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b4f33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841195c expref: 10 pid: 12328 timeout: 999 lvb_type: 1 00010000:00010000:0.0:1746143840.429121:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.429132:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143840.429137:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095db2200/0x87925e4cb73b518d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a90 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.429155:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143840.429160:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.429162:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963624997248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 110us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.429168:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8062 00000100:00100000:0.0:1746143840.429177:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963624997376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.429183:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 994 00000100:00100000:1.0:1746143840.429201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.429225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.429233:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997504 00000100:00100000:0.0:1746143840.429237:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997504 00000100:00100000:0.0:1746143840.429268:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997632 00000100:00100000:0.0:1746143840.429271:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997632 00000100:00100000:0.0:1746143840.429294:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16557 00000100:00100000:0.0:1746143840.429298:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624997504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143840.429314:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.429324:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b519b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a97 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143840.429385:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627473536:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143840.429441:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.429458:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16558 00000100:00100000:0.0:1746143840.429464:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963624997632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143840.429471:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.429480:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466600/0x87925e4cb73b51a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411a9e expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.429496:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466600/0x87925e4cb73b51a2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a9e expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.429505:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466600/0x87925e4cb73b51a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a9e expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.429513:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466600, rc 0) 00000100:00100000:0.0:1746143840.429531:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963624997632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 68us (305us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143840.429536:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16558 00000100:00100000:2.0:1746143840.430285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.430679:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997120 00000100:00100000:3.0:1746143840.430686:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997120 00002000:00100000:3.0:1746143840.430724:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b48a80 x1830963624997120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.430734:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48a80 with x1830963624997120 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.430739:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48a80 00000100:00100000:3.0:1746143840.430759:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7201 00000100:00100000:3.0:1746143840.430764:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963624997120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.431330:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997760 00000100:00100000:1.0:1746143840.431335:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997760 00000100:00100000:1.0:1746143840.431377:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16559 00000100:00100000:1.0:1746143840.431383:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963624997760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.431392:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143840.431401:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143840.431408:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b51a9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411aa5 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143840.431419:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624997888 00000100:00100000:2.0:1746143840.431423:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624997888 00010000:00010000:1.0:1746143840.431423:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.431433:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b51a9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aa5 expref: 16 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.431442:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 16 pid: 1947 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143840.431443:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b51a9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aa5 expref: 16 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.431457:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:2.0:1746143840.431463:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8063 00000100:00100000:2.0:1746143840.431467:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624997888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.431475:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143840.431488:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624997760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 105us (1212us total) trans 0 rc 301/301 00010000:00010000:2.0:1746143840.431490:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 15 pid: 1947 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143840.431494:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16559 00010000:00010000:2.0:1746143840.431499:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 15 pid: 1947 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.431514:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b504b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119da expref: 14 pid: 1947 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.431536:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.431538:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.431546:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.431553:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.431580:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143840.431590:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627473664:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143840.431646:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143840.437494:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963624996864:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14942us (15303us total) trans 0 rc 602112/602112 00000100:00100000:2.0:1746143840.437507:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7200 00002000:00100000:2.0:1746143840.437519:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880096941880 x1830963624996864/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 504/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 602112/602112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.437530:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096941880 with x1830963624996864 ext(1048576->2097151) 00002000:00010000:2.0:1746143840.437536:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096941880 00000100:00100000:2.0:1746143840.441699:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096942680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963624996480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19355us (19537us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143840.441713:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7199 00002000:00100000:2.0:1746143840.441725:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096942680 x1830963624996480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.441735:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096942680 with x1830963624996480 ext(0->1048575) 00002000:00010000:2.0:1746143840.441740:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096942680 00000100:00100000:2.0:1746143840.443224:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963624997120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12453us (15250us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143840.443233:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7201 00002000:00100000:2.0:1746143840.443242:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b48a80 x1830963624997120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.443251:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48a80 with x1830963624997120 ext(1048576->2097151) 00002000:00010000:2.0:1746143840.443255:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48a80 00002000:00010000:0.0:1746143840.443262:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143838 -> 1746143840 00002000:00010000:0.0:1746143840.443266:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143834 -> 1746143840 00002000:00010000:0.0:1746143840.443268:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143838 -> 1746143840 00000100:00100000:0.0:1746143840.443283:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627473536:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143840.443311:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b519b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a97 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.443324:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b519b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a97 expref: 13 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.443335:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:0.0:1746143840.443365:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963624997504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 14065us (14163us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143840.443372:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16557 00000100:00100000:0.0:1746143840.444313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.444322:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627473664:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143840.444337:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.444373:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963624997888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12905us (12972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.444382:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8063 00000100:00100000:3.0:1746143840.444512:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624998144 00000100:00100000:3.0:1746143840.444519:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624998144 00002000:00100000:3.0:1746143840.444555:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3190784->3194879) req@ffff880096940a80 x1830963624998144/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.444564:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096940a80 with x1830963624998144 ext(3190784->3194879) 00002000:00010000:3.0:1746143840.444568:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096940a80 00000100:00100000:3.0:1746143840.444592:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7202 00000100:00100000:3.0:1746143840.444599:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624998144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143840.444715:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963624998144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 116us (405us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143840.444721:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7202 00002000:00100000:3.0:1746143840.444725:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3190784->3194879) req@ffff880096940a80 x1830963624998144/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.444732:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096940a80 with x1830963624998144 ext(3190784->3194879) 00002000:00010000:3.0:1746143840.444735:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096940a80 00000100:00100000:0.0:1746143840.458028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.458111:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.458162:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.458244:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624998272 00000100:00100000:2.0:1746143840.458255:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624998272 00000100:00100000:2.0:1746143840.458306:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624998400 00000100:00100000:2.0:1746143840.458308:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624998400 00000100:00100000:2.0:1746143840.458330:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16560 00000100:00100000:2.0:1746143840.458339:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2749:x1830963624998272:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143840.458339:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16561 00000100:00100000:0.0:1746143840.458353:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2752:x1830963624998400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.458367:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.458367:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.458385:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411aac expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.458385:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ab3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.458414:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.458414:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.458421:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143840.458423:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143840.458425:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143840.458426:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143840.458427:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.458429:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.458454:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.458454:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.458464:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 25 pid: 13430 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143840.458475:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627473792:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143840.458543:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00010000:00010000:2.0:1746143840.458622:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 12 pid: 1947 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.458625:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624998656 00000100:00100000:3.0:1746143840.458629:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624998656 00000100:00100000:2.0:1746143840.458634:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627473920:192.168.202.3@tcp:104: 00002000:00100000:3.0:1746143840.458656:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3874816->3878911) req@ffff880091bdf800 x1830963624998656/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143840.458657:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00002000:00100000:3.0:1746143840.458664:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf800 with x1830963624998656 ext(3874816->3878911) 00002000:00010000:3.0:1746143840.458668:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf800 00000100:00100000:3.0:1746143840.458691:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7203 00000100:00100000:3.0:1746143840.458697:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624998656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143840.458865:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963624998656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 167us (702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143840.458871:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7203 00002000:00100000:3.0:1746143840.458878:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3874816->3878911) req@ffff880091bdf800 x1830963624998656/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.458884:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf800 with x1830963624998656 ext(3874816->3878911) 00002000:00010000:3.0:1746143840.458888:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf800 00000100:00100000:2.0:1746143840.461439:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627473792:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.461442:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627473920:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.461468:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.461468:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 12 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.461484:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9400, rc 0) 00010000:00010000:2.0:1746143840.461484:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:2.0:1746143840.461538:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2752:x1830963624998400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3192us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.461546:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16561 00000100:00100000:3.0:1746143840.461780:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2749:x1830963624998272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3441us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.461786:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16560 00000100:00100000:2.0:1746143840.461953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.462008:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.462040:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624999168 00000100:00100000:2.0:1746143840.462047:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624999168 00000100:00100000:2.0:1746143840.462082:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5413 00000100:00100000:2.0:1746143840.462089:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2746:x1830963624999168:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143840.462113:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624998784 00000100:00100000:3.0:1746143840.462117:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624998784 00002000:00100000:3.0:1746143840.462147:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1167360->1613823) req@ffff880093cfb480 x1830963624998784/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.462156:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfb480 with x1830963624998784 ext(1167360->1613823) 00010000:00010000:3.0:1746143840.462162:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 26 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.462174:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 26 pid: 13430 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143840.462181:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cfb480 00000100:00100000:3.0:1746143840.462194:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2665 00000100:00100000:3.0:1746143840.462200:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963624998784:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143840.462282:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2746:x1830963624999168:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 192us (272us total) trans 8589945041 rc 0/0 00000100:00100000:2.0:1746143840.462288:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5413 00000100:00100000:0.0:1746143840.462539:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.462945:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624998912 00000100:00100000:3.0:1746143840.462949:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624998912 00002000:00100000:3.0:1746143840.462970:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2617344->2904063) req@ffff880091bdea00 x1830963624998912/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.462978:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdea00 with x1830963624998912 ext(2617344->2904063) 00010000:00010000:3.0:1746143840.462983:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 13 pid: 1947 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.462992:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 13 pid: 1947 timeout: 999 lvb_type: 0 00002000:00010000:3.0:1746143840.462996:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdea00 00000100:00100000:3.0:1746143840.463022:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2666 00000100:00100000:3.0:1746143840.463027:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963624998912:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143840.474038:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624998784:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11829us (12078us total) trans 21474841234 rc 0/0 00000100:00100000:0.0:1746143840.474049:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2665 00002000:00100000:0.0:1746143840.474059:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1167360->1613823) req@ffff880093cfb480 x1830963624998784/t21474841234(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.474067:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfb480 with x1830963624998784 ext(1167360->1613823) 00010000:00010000:0.0:1746143840.474076:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.474086:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 999 lvb_type: 0 00002000:00010000:0.0:1746143840.474093:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cfb480 00000100:00100000:2.0:1746143840.474856:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963624998912:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11827us (12315us total) trans 17179873965 rc 0/0 00000100:00100000:2.0:1746143840.474863:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2666 00002000:00100000:2.0:1746143840.474869:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2617344->2904063) req@ffff880091bdea00 x1830963624998912/t17179873965(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.474877:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdea00 with x1830963624998912 ext(2617344->2904063) 00010000:00010000:2.0:1746143840.474883:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.474891:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 999 lvb_type: 0 00002000:00010000:2.0:1746143840.474897:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdea00 00000100:00100000:0.0:1746143840.480239:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.480334:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.481011:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624999296 00000100:00100000:2.0:1746143840.481024:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624999296 00010000:00010000:2.0:1746143840.481075:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.481092:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624999424 00000100:00100000:1.0:1746143840.481096:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624999424 00010000:00010000:1.0:1746143840.481114:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.481141:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8064 00000100:00100000:1.0:1746143840.481149:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963624999296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.481164:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.481186:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.481196:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.481220:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849c00/0x87925e4cb73b50de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2617344->3145727] (req 2617344->2904063) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a4a expref: 15 pid: 1947 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.481238:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.481240:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.481248:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.481255:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.481289:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143840.481306:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627474048:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143840.481336:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8065 00000100:00100000:0.0:1746143840.481355:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963624999424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.481364:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.481378:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.481386:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.481398:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32a00/0x87925e4cb73b511d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1613823) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a6d expref: 28 pid: 13430 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.481405:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00010000:00010000:0.0:1746143840.481411:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143840.481413:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143840.481417:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.481422:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.481439:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143840.481451:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627474176:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143840.481472:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.483308:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627474048:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143840.483330:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.483378:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963624999296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2230us (3149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.483388:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8064 00000100:00100000:0.0:1746143840.483592:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.483877:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bde300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627474176:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143840.483889:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.483905:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963624999424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2563us (3571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.483934:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8065 00000100:00100000:1.0:1746143840.484056:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624999680 00000100:00100000:1.0:1746143840.484063:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624999680 00000100:00100000:1.0:1746143840.484099:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13982 00000100:00100000:1.0:1746143840.484105:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:2754:x1830963624999680:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143840.484130:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.484149:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b51be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411aba expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.484227:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484241:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484251:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484263:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484268:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484274:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484384:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b51d3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484393:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b51d3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484399:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b51d3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143840.484408:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143840.484482:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484488:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484493:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484498:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484503:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143840.484506:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484512:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484522:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143840.484524:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143840.484528:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484532:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b51c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484548:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484554:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484558:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484561:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143840.484563:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484567:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484573:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b11100) 00010000:00010000:1.0:1746143840.484574:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143840.484576:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484581:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b51cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.484616:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b51be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aba expref: 270 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.484626:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b51d3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aba expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.484633:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143840.484634:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143840.484637:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:1.0:1746143840.484662:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:2754:x1830963624999680:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 557us (1070us total) trans 8589945042 rc 0/0 00000100:00100000:1.0:1746143840.484667:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13982 00000100:00100000:2.0:1746143840.489780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.489840:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.489868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.489939:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625000448 00000100:00100000:3.0:1746143840.489950:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625000448 00000100:00100000:3.0:1746143840.489998:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5414 00000100:00100000:3.0:1746143840.490006:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:2754:x1830963625000448:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143840.490325:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963624999936 00000100:00100000:0.0:1746143840.490329:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963624999936 00002000:00100000:0.0:1746143840.490382:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093cf8000 x1830963624999936/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.490392:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8000 with x1830963624999936 ext(2097152->3145727) 00002000:00010000:0.0:1746143840.490397:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8000 00000100:00100000:0.0:1746143840.490413:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625000192 00000100:00100000:0.0:1746143840.490416:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625000192 00002000:00100000:0.0:1746143840.490426:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095e33800 x1830963625000192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.490432:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33800 with x1830963625000192 ext(1048576->2097151) 00002000:00010000:0.0:1746143840.490435:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33800 00000100:00100000:0.0:1746143840.490443:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7204 00000100:00100000:0.0:1746143840.490603:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624999936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.490646:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7205 00000100:00100000:1.0:1746143840.490654:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625000192:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143840.490829:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:2754:x1830963625000448:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 823us (958us total) trans 8589945043 rc 0/0 00000100:00100000:3.0:1746143840.490848:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5414 00000100:00100000:2.0:1746143840.491049:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.491075:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625000576 00000100:00100000:0.0:1746143840.491079:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625000576 00000100:00100000:0.0:1746143840.491111:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 995 00000100:00100000:0.0:1746143840.491116:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+270:2010:x1830963625000576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.491126:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.491152:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b51d3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aba expref: 270 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.491169:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143840.491173:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.491189:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+269:2010:x1830963625000576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.491195:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 995 00000100:00100000:2.0:1746143840.503450:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963624999936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12837us (13667us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143840.503463:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7204 00002000:00100000:2.0:1746143840.503475:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093cf8000 x1830963624999936/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.503484:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8000 with x1830963624999936 ext(2097152->3145727) 00002000:00010000:2.0:1746143840.503490:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8000 00000100:00100000:1.0:1746143840.503622:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625000192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12967us (13780us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143840.503635:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7205 00002000:00100000:1.0:1746143840.503640:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095e33800 x1830963625000192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.503647:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33800 with x1830963625000192 ext(1048576->2097151) 00002000:00010000:1.0:1746143840.503651:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33800 00000100:00100000:0.0:1746143840.514690:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.515363:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625000704 00000100:00100000:3.0:1746143840.515374:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625000704 00000100:00100000:3.0:1746143840.515548:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16562 00000100:00100000:3.0:1746143840.515556:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2749:x1830963625000704:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.515576:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.515622:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ac1 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.515658:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.515665:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143840.515666:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143840.515670:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.515701:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.515712:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 11 pid: 13430 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.515723:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627474304:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.515820:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.516823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.517174:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625000832 00000100:00100000:2.0:1746143840.517181:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625000832 00000100:00100000:2.0:1746143840.517230:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16563 00000100:00100000:2.0:1746143840.517237:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2752:x1830963625000832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.517250:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.517264:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ac8 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.517283:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.517285:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.517292:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.517305:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.517315:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9c00, rc 0) 00000100:00100000:2.0:1746143840.517369:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2752:x1830963625000832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 132us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.517374:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16563 00000100:00100000:3.0:1746143840.521700:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627474304:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143840.521700:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143840.521736:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.521755:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a400, rc 0) 00000100:00100000:3.0:1746143840.521808:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2749:x1830963625000704:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6252us (7130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.521817:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16562 00000100:00100000:1.0:1746143840.522308:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625000960 00000100:00100000:1.0:1746143840.522315:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625000960 00002000:00100000:1.0:1746143840.522366:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3190784->3878911) req@ffff880091bde300 x1830963625000960/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.522375:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde300 with x1830963625000960 ext(3190784->3878911) 00010000:00010000:1.0:1746143840.522382:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 12 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.522399:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 12 pid: 13430 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143840.522406:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bde300 00000100:00100000:1.0:1746143840.522689:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2667 00000100:00100000:1.0:1746143840.522696:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625000960:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143840.525458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.525548:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625001216 00000100:00100000:2.0:1746143840.525557:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625001216 00002000:00100000:2.0:1746143840.525599:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880091bdd880 x1830963625001216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.525608:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963625001216 ext(2097152->3145727) 00002000:00010000:2.0:1746143840.525613:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdd880 00000100:00100000:2.0:1746143840.525645:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7206 00000100:00100000:2.0:1746143840.525652:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625001216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.541163:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625000960:12345-192.168.202.3@tcp:4:cat.0 Request processed in 18450us (19458us total) trans 21474841235 rc 0/0 00000100:00100000:1.0:1746143840.541179:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2667 00002000:00100000:1.0:1746143840.541194:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3190784->3878911) req@ffff880091bde300 x1830963625000960/t21474841235(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.541205:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde300 with x1830963625000960 ext(3190784->3878911) 00010000:00010000:1.0:1746143840.541216:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 14 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.541233:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 14 pid: 13430 timeout: 999 lvb_type: 0 00002000:00010000:1.0:1746143840.541241:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bde300 00000100:00100000:2.0:1746143840.544601:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625001216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18937us (19140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143840.544614:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7206 00002000:00100000:2.0:1746143840.544625:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880091bdd880 x1830963625001216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.544636:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963625001216 ext(2097152->3145727) 00002000:00010000:2.0:1746143840.544643:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdd880 00000100:00100000:0.0:1746143840.545190:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.545691:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625001344 00000100:00100000:1.0:1746143840.545700:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625001344 00010000:00010000:1.0:1746143840.545735:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 14 pid: 13430 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.545775:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8066 00000100:00100000:1.0:1746143840.545781:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625001344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.545795:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143840.545812:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143838 -> 1746143840 00002000:00010000:1.0:1746143840.545815:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143838 -> 1746143840 00010000:00010000:1.0:1746143840.545820:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 14 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.545834:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 14 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.545862:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b5171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3190784->3878911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a89 expref: 14 pid: 13430 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.547060:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.547064:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.547076:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.547086:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.547128:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143840.547146:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627474432:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143840.547234:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.551801:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.551865:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625001472 00000100:00100000:3.0:1746143840.551876:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625001472 00000100:00100000:3.0:1746143840.551969:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16564 00000100:00100000:3.0:1746143840.551979:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2752:x1830963625001472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.552002:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.552023:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411acf expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.552054:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.552056:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.552066:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.552083:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.552095:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ba00, rc 0) 00000100:00100000:3.0:1746143840.552183:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2752:x1830963625001472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 203us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.552190:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16564 00000100:00100000:0.0:1746143840.558550:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.558673:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627474432:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143840.558697:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.558759:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625001344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 12977us (13569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.558772:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8066 00000100:00100000:2.0:1746143840.559293:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625001728 00000100:00100000:2.0:1746143840.559303:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625001728 00002000:00100000:2.0:1746143840.559354:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880091bdf100 x1830963625001728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.559364:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf100 with x1830963625001728 ext(2097152->4194303) 00002000:00010000:2.0:1746143840.559368:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf100 00000100:00100000:2.0:1746143840.559391:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7207 00000100:00100000:2.0:1746143840.559396:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625001728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143840.568093:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.571603:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625001984 00000100:00100000:1.0:1746143840.571619:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625001984 00002000:00100000:1.0:1746143840.571675:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096943b80 x1830963625001984/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.571685:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096943b80 with x1830963625001984 ext(2097152->4194303) 00002000:00010000:1.0:1746143840.571691:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096943b80 00000100:00100000:1.0:1746143840.571736:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7208 00000100:00100000:1.0:1746143840.571743:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625001984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143840.576618:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.576691:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625002240 00000100:00100000:3.0:1746143840.576703:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625002240 00002000:00100000:3.0:1746143840.576750:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092b48e00 x1830963625002240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.576759:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48e00 with x1830963625002240 ext(3145728->4194303) 00002000:00010000:3.0:1746143840.576765:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48e00 00000100:00100000:3.0:1746143840.576786:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7209 00000100:00100000:3.0:1746143840.576793:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625002240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143840.576810:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625001728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17413us (18272us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143840.576817:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7207 00002000:00100000:0.0:1746143840.576822:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880091bdf100 x1830963625001728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.576828:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf100 with x1830963625001728 ext(2097152->4194303) 00002000:00010000:0.0:1746143840.576832:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdf100 00000100:00100000:0.0:1746143840.599817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.599856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.599895:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625002496 00000100:00100000:0.0:1746143840.599904:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625002496 00000100:00100000:0.0:1746143840.599961:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625002624 00000100:00100000:0.0:1746143840.599963:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625002624 00000100:00100000:0.0:1746143840.599977:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13983 00000100:00100000:0.0:1746143840.599983:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2757:x1830963625002496:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143840.600009:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.600028:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b51f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ad6 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.600099:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600112:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600122:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600134:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600140:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600145:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600249:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b520b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600259:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b520b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600265:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b520b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143840.600273:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143840.600357:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600363:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600368:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600373:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600379:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143840.600382:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600388:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600397:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143840.600400:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143840.600404:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600409:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b51fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600426:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600431:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600435:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600439:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143840.600441:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600446:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600451:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030e00) 00010000:00010000:0.0:1746143840.600454:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143840.600456:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600461:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b5204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600495:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b51f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ad6 expref: 20 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.600507:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b520b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ad6 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.600513:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143840.600515:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143840.600517:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97a00, rc 0) 00000100:00100000:0.0:1746143840.600565:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2757:x1830963625002496:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 581us (757us total) trans 8589945044 rc 0/0 00000100:00100000:0.0:1746143840.600571:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13983 00000100:00100000:0.0:1746143840.600587:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13984 00000100:00100000:0.0:1746143840.600592:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2758:x1830963625002624:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143840.600603:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.600608:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b5219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411add expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.600636:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600642:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600647:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600655:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600661:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600666:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600690:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600702:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 268 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.600709:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.600740:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 268 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.600751:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 268 pid: 7245 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143840.600762:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627474560:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143840.600833:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.601186:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625001984:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29443us (33103us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143840.601195:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7208 00002000:00100000:1.0:1746143840.601203:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096943b80 x1830963625001984/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.601212:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096943b80 with x1830963625001984 ext(2097152->4194303) 00002000:00010000:1.0:1746143840.601216:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096943b80 00000100:00100000:2.0:1746143840.604612:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.604980:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625002752 00000100:00100000:0.0:1746143840.604991:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625002752 00000100:00100000:0.0:1746143840.605054:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16565 00000100:00100000:0.0:1746143840.605062:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625002752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143840.605084:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.605101:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ae4 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.605126:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143840.605127:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143840.605136:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 29 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.605153:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 29 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.605167:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2600, rc 0) 00000100:00100000:0.0:1746143840.605226:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625002752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 164us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.605233:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16565 00000100:00100000:3.0:1746143840.606856:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625002240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 30057us (30247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143840.606866:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7209 00002000:00100000:3.0:1746143840.606877:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092b48e00 x1830963625002240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.606886:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48e00 with x1830963625002240 ext(3145728->4194303) 00002000:00010000:3.0:1746143840.606890:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48e00 00000100:00100000:0.0:1746143840.607887:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.608394:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625002880 00000100:00100000:1.0:1746143840.608402:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625002880 00000100:00100000:1.0:1746143840.608454:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 996 00000100:00100000:1.0:1746143840.608460:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625002880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.608473:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.608499:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b520b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ad6 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.608524:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143840.608530:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.608537:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.608541:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.608545:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.608574:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625002880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.608579:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 996 00000100:00100000:1.0:1746143840.616078:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.616133:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.616313:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625003264 00000100:00100000:0.0:1746143840.616324:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625003264 00010000:00010000:0.0:1746143840.616371:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 269 pid: 7245 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.616383:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627474560:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143840.616404:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8067 00010000:00010000:2.0:1746143840.616408:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143840.616412:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+269:2008:x1830963625003264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.616436:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.616442:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 269 pid: 7245 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.616454:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 269 pid: 7245 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.616478:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b4fe2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841199b expref: 269 pid: 7245 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.616496:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143840.616518:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.616529:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.616537:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.616574:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.616618:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+268:2008:x1830963625003264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 206us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.616625:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8067 00000100:00100000:3.0:1746143840.616856:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625003136 00000100:00100000:3.0:1746143840.616861:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625003136 00000100:00100000:3.0:1746143840.616888:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5415 00000100:00100000:3.0:1746143840.616892:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:2749:x1830963625003136:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143840.617120:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:2749:x1830963625003136:12345-192.168.202.3@tcp:35:cat.0 Request processed in 226us (1054us total) trans 8589945045 rc 0/0 00000100:00100000:3.0:1746143840.617126:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5415 00010000:00010000:2.0:1746143840.617239:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617247:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143840.617288:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143840.617293:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143840.617306:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617315:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617326:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617332:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617337:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617350:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617356:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.617359:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617365:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617374:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.617376:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.617379:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617383:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b5220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617411:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617416:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617420:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617424:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.617426:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617430:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617435:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030a00) 00010000:00010000:2.0:1746143840.617437:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.617440:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617444:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b5227 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.617472:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b5219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.617483:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.617489:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.617492:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143840.617494:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97400, rc 0) 00000100:00100000:2.0:1746143840.617530:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2758:x1830963625002624:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 16938us (17673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.617536:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13984 00000100:00100000:0.0:1746143840.619018:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.619104:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625003520 00000100:00100000:3.0:1746143840.619112:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625003520 00002000:00100000:3.0:1746143840.619149:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880135b08380 x1830963625003520/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.619158:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08380 with x1830963625003520 ext(4194304->4849663) 00002000:00010000:3.0:1746143840.619163:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b08380 00000100:00100000:3.0:1746143840.619190:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7210 00000100:00100000:3.0:1746143840.619197:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625003520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.622966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.623008:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.623022:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.623043:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625003776 00000100:00100000:2.0:1746143840.623052:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625003776 00000100:00100000:2.0:1746143840.623113:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625004032 00000100:00100000:2.0:1746143840.623115:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625004032 00000100:00100000:2.0:1746143840.623127:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625003648 00000100:00100000:2.0:1746143840.623129:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625003648 00000100:00100000:2.0:1746143840.623141:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16566 00000100:00100000:2.0:1746143840.623148:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625003776:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143840.623168:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.623186:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411af2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.623210:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.623212:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.623221:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.623238:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.623250:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:2.0:1746143840.623295:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625003776:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.623301:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16566 00000100:00100000:2.0:1746143840.623318:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16567 00000100:00100000:2.0:1746143840.623323:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625004032:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143840.623330:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.623339:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b00 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.623362:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143840.623584:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16568 00000100:00100000:0.0:1746143840.623593:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625003648:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143840.623600:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.623609:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411aeb expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.623620:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143840.623622:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143840.623627:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143840.623632:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143840.623638:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.623645:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2c00, rc 0) 00000100:00100000:3.0:1746143840.623646:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625003904 00000100:00100000:3.0:1746143840.623650:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625003904 00000100:00100000:0.0:1746143840.623664:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625003648:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 73us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.623666:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16569 00000100:00100000:0.0:1746143840.623670:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16568 00000100:00100000:3.0:1746143840.623671:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625003904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143840.623677:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.623685:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411af9 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.623696:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.623697:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.623702:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.623710:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.623717:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b600, rc 0) 00000100:00100000:3.0:1746143840.623730:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625003904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 59us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.623735:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16569 00000100:00080000:3.0:1746143840.623796:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143840.624339:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.624358:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.624369:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.624376:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31600, rc 0) 00000100:00100000:2.0:1746143840.624434:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625004032:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1110us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.624439:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16567 00000100:00100000:3.0:1746143840.632670:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625003520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13458us (13642us total) trans 0 rc 655360/655360 00000100:00100000:3.0:1746143840.632684:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7210 00002000:00100000:3.0:1746143840.632700:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880135b08380 x1830963625003520/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.632710:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08380 with x1830963625003520 ext(4194304->4849663) 00002000:00010000:3.0:1746143840.632716:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b08380 00000100:00100000:0.0:1746143840.640390:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.640869:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625004288 00000100:00100000:2.0:1746143840.640881:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625004288 00000100:00100000:2.0:1746143840.641007:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13985 00000100:00100000:2.0:1746143840.641018:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2758:x1830963625004288:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143840.641042:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.641066:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b5258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b07 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.641189:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.641206:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.641215:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.641254:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.641268:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 8 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.641282:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627474688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.641412:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.642050:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.642260:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625004544 00000100:00100000:3.0:1746143840.642267:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625004544 00000100:00100000:3.0:1746143840.642326:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5416 00000100:00100000:3.0:1746143840.642335:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2752:x1830963625004544:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143840.647179:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2752:x1830963625004544:12345-192.168.202.3@tcp:35:cat.0 Request processed in 4830us (5116us total) trans 8589945046 rc 0/0 00000100:00100000:3.0:1746143840.647194:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5416 00000100:00100000:3.0:1746143840.648942:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627474688:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.649030:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.649068:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625004672 00000100:00100000:0.0:1746143840.649076:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625004672 00010000:00010000:0.0:1746143840.649109:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143840.649145:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8068 00010000:00010000:3.0:1746143840.649146:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143840.649152:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625004672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.649253:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.649260:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.649273:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.649295:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b522e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411add expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:0.0:1746143840.649321:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143840.649326:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.649336:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.649358:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143840.649390:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143840.649590:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625004672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 437us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.649600:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8068 00010000:00010000:3.0:1746143840.649613:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.649620:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143840.649689:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143840.649934:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b5258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.649949:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.649955:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143840.649958:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143840.649960:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:3.0:1746143840.649993:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2758:x1830963625004288:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8977us (9617us total) trans 8589945047 rc 0/0 00000100:00100000:3.0:1746143840.650003:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13985 00000100:00100000:0.0:1746143840.657020:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.657239:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625004800 00000100:00100000:3.0:1746143840.657250:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625004800 00000100:00100000:3.0:1746143840.657306:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13986 00000100:00100000:3.0:1746143840.657314:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2758:x1830963625004800:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143840.657339:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.657371:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b526d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b0e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.658197:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.658213:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.658219:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.658252:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.658263:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 9 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.658273:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627474816:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.659199:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.659629:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.659693:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625004928 00000100:00100000:2.0:1746143840.659701:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625004928 00000100:00100000:2.0:1746143840.659744:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16570 00000100:00100000:2.0:1746143840.659750:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2754:x1830963625004928:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.659763:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.659776:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b15 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.659801:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.659813:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.659820:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.659826:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.659828:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.659831:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1581056->2097151] (req 1581056->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.659852:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.659861:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.659871:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627474944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.659937:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.659946:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 10 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.659953:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627475072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.659993:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.660001:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.660008:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627475200:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.660021:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.662987:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.663107:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627474816:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.663128:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625005056 00000100:00100000:1.0:1746143840.663135:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625005056 00010000:00010000:3.0:1746143840.663137:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.663167:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.663206:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8069 00000100:00100000:1.0:1746143840.663214:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625005056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.663229:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.663235:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.663245:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.663266:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b525f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b07 expref: 10 pid: 6587 timeout: 999 lvb_type: 0 00010000:00010000:1.0:1746143840.663291:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143840.663295:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.663305:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.663312:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.664764:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.664825:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627474944:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.664951:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625005056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1736us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.664960:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8069 00010000:00010000:2.0:1746143840.665026:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.665034:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143840.665241:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143840.665246:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143840.665264:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.665298:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b526d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.665334:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.665348:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.665351:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143840.665354:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0de00, rc 0) 00000100:00100000:2.0:1746143840.665381:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2758:x1830963625004800:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8068us (8374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.665387:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13986 00000100:00100000:0.0:1746143840.666802:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.666898:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627475072:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.667352:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625005184 00000100:00100000:1.0:1746143840.667359:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625005184 00000100:00100000:0.0:1746143840.667359:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.667365:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627475200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143840.667399:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [1581056->2097151] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143840.667413:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625005312 00010000:00010000:3.0:1746143840.667416:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30800, rc 0) 00000100:00100000:2.0:1746143840.667417:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625005312 00010000:00010000:2.0:1746143840.667429:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.667460:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2754:x1830963625004928:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7710us (7833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.667463:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8070 00000100:00100000:3.0:1746143840.667468:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16570 00000100:00100000:2.0:1746143840.667469:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625005312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.667481:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.667502:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.667511:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.667532:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b523c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af2 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.667541:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.667557:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625005312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.667563:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8070 00010000:00010000:1.0:1746143840.667603:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 35 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:1.0:1746143840.667620:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8071 00000100:00100000:1.0:1746143840.667625:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625005184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.667634:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143840.667640:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143840.667648:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143840.667658:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33c00/0x87925e4cb73b50a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a2e expref: 34 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:1.0:1746143840.667677:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143840.667695:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625005184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.667700:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8071 00000100:00100000:0.0:1746143840.669678:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.669765:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625005568 00000100:00100000:3.0:1746143840.669774:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625005568 00000100:00100000:3.0:1746143840.669861:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16571 00000100:00100000:3.0:1746143840.669869:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625005568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143840.669887:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.669902:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b5282 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b1c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.669945:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.669957:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b5282 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b1c expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.669968:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b5282 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b1c expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.669996:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53e00, rc 0) 00000100:00100000:3.0:1746143840.670035:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625005568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 167us (365us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143840.670040:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16571 00000100:00100000:0.0:1746143840.670153:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.670215:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625005440 00000100:00100000:3.0:1746143840.670218:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625005440 00010000:00010000:3.0:1746143840.670232:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 15 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.670251:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8072 00000100:00100000:3.0:1746143840.670255:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625005440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.670264:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.670283:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 15 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.670292:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 15 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.670309:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e521c00/0x87925e4cb73b5083 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a0b expref: 15 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.670319:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.670320:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.670327:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.670339:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.670475:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.670489:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627475328:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.670555:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.684425:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627475328:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143840.684449:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.684496:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625005440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 14239us (14343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.684508:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8072 00000100:00100000:0.0:1746143840.684537:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.684947:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625005824 00000100:00100000:2.0:1746143840.684955:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625005824 00000100:00100000:2.0:1746143840.685003:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13987 00000100:00100000:2.0:1746143840.685010:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2758:x1830963625005824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143840.685030:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.685049:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b5289 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b23 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.685146:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685160:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685170:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685180:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685185:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685191:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685195:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.685198:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685204:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685211:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.685213:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143840.685217:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685224:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30200/0x87925e4cb73b5290 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.685261:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b5289 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b23 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.685268:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b5289 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b23 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.685275:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:2.0:1746143840.685299:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2758:x1830963625005824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 290us (762us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143840.685304:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13987 00000100:00100000:0.0:1746143840.686855:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.686945:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625006080 00000100:00100000:3.0:1746143840.686952:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625006080 00000100:00100000:3.0:1746143840.686987:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5417 00000100:00100000:3.0:1746143840.686994:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2758:x1830963625006080:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143840.687163:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2758:x1830963625006080:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 168us (314us total) trans 8589945048 rc 0/0 00000100:00100000:3.0:1746143840.687169:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5417 00000100:00100000:0.0:1746143840.692287:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.692644:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625006208 00000100:00100000:2.0:1746143840.692654:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625006208 00000100:00100000:2.0:1746143840.692714:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16572 00000100:00100000:2.0:1746143840.692723:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2754:x1830963625006208:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.692740:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.692760:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b2a expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.692792:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.692801:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.692813:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.692819:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.692821:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.692824:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.692857:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.692868:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 13 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.692880:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627475456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.693000:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.693008:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 9 pid: 3135 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.693017:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627475584:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.693415:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.693429:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.693438:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627475712:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.694008:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a3300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.695161:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143840.695177:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627475840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746143840.695232:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143840.695301:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627475840 00000100:00100000:0.0:1746143840.695308:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627475840 00000100:00100000:0.0:1746143840.695592:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1746143840.695600:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3773:x1830963627475840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746143840.696223:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:1.0:1746143840.696382:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3773:x1830963627475840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 780us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.696390:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1746143840.696567:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627475840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746143840.699719:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627475456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.705073:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627475584:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.705083:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627475712:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.705115:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->2433023] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.705132:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:2.0:1746143840.705169:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2754:x1830963625006208:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12447us (12892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.705177:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16572 00000100:00100000:0.0:1746143840.716246:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.716670:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625006336 00000100:00100000:3.0:1746143840.717236:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625006336 00000100:00100000:0.0:1746143840.717385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.717476:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.717497:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625006464 00000100:00100000:0.0:1746143840.717501:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625006464 00010000:00010000:0.0:1746143840.717530:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 10 pid: 3135 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143840.717531:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143840.717567:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625006592 00000100:00100000:0.0:1746143840.717570:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625006592 00010000:00010000:0.0:1746143840.717582:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143840.717600:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8073 00000100:00100000:0.0:1746143840.717607:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625006464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.717621:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.717643:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 10 pid: 3135 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.717645:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8074 00010000:00010000:0.0:1746143840.717655:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 10 pid: 3135 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.717667:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625006592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143840.717679:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b600/0x87925e4cb73b5251 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411af9 expref: 10 pid: 3135 timeout: 999 lvb_type: 1 00010000:00010000:2.0:1746143840.717684:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143840.717701:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143840.717707:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.717720:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.717732:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8075 00000100:00100000:3.0:1746143840.717739:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625006336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.717741:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9400/0x87925e4cb73b51b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aac expref: 34 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:0.0:1746143840.717746:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625006464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 139us (364us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143840.717747:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143840.717753:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8073 00010000:00010000:3.0:1746143840.717755:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.717765:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.717782:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.717828:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625006592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.717835:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8074 00010000:00010000:3.0:1746143840.717931:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b51e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac8 expref: 14 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.717952:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.717954:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.717960:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.717968:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.718000:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.718017:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627475968:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.719975:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.727181:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627476224:0@lo:400:kworker.0 00000100:00100000:3.0:1746143840.727230:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963627476352:0@lo:400:kworker.0 00000100:00100000:1.0:1746143840.727254:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143840.727261:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143840.727282:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963627476864:0@lo:400:kworker.0 00000100:00100000:1.0:1746143840.727290:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3772:1830963627476736:0@lo:400:kworker.0 00000100:00100000:3.0:1746143840.727300:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143840.727311:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143840.727316:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143840.727321:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627476480:0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.727322:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963627476096:0@lo:400:kworker.0 00000100:00100000:1.0:1746143840.727325:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e30a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963627477248:0@lo:400:kworker.0 00000100:00100000:3.0:1746143840.727355:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143840.727362:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143840.727403:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476352 00000100:00100000:0.0:1746143840.727414:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476352 00000100:00100000:0.0:1746143840.727453:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476864 00000100:00100000:0.0:1746143840.727455:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476864 00000100:00100000:0.0:1746143840.727476:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476736 00000100:00100000:0.0:1746143840.727478:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476736 00000100:00100000:0.0:1746143840.727485:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627477248 00000100:00100000:0.0:1746143840.727487:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627477248 00000100:00100000:0.0:1746143840.727499:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1746143840.727505:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143840.727506:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963627476352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.727533:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627476608:0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.727556:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143840.727579:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3771:1830963627477120:0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.727583:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3773:x1830963627476352:12345-0@lo:400:kworker.0 Request processed in 78us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.727588:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1746143840.727597:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143840.727601:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627477120 00000100:00100000:0.0:1746143840.727603:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627477120 00000100:00100000:0.0:1746143840.727616:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1746143840.727621:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963627476864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.727627:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1746143840.727637:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3772:x1830963627476736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.727645:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3773:x1830963627476864:12345-0@lo:400:kworker.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.727649:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1746143840.727658:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1746143840.727662:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963627477248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.727674:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3772:x1830963627476736:12345-0@lo:400:kworker.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.727680:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1746143840.727682:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3772:x1830963627477248:12345-0@lo:400:kworker.0 Request processed in 20us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.727686:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1746143840.727696:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1746143840.727700:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3771:x1830963627477120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.727709:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476096 00000100:00100000:2.0:1746143840.727714:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476096 00000100:00100000:0.0:1746143840.727725:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3771:x1830963627477120:12345-0@lo:400:kworker.0 Request processed in 24us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.727730:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1746143840.727741:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1746143840.727745:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a42af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3771:x1830963627476096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.727769:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476224 00000100:00100000:0.0:1746143840.727772:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476224 00000100:00100000:0.0:1746143840.727790:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1746143840.727794:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963627476224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.727819:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963627476224:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.727824:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1746143840.727869:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476480 00000100:00100000:0.0:1746143840.727872:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476480 00000100:00100000:0.0:1746143840.728272:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476608 00000100:00100000:0.0:1746143840.728275:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476608 00000100:00100000:0.0:1746143840.728290:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1746143840.728295:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627476480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.728320:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627476480:12345-0@lo:400:kworker.0 Request processed in 25us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.728323:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1746143840.728330:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1746143840.728334:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627476608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.728365:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627476608:12345-0@lo:400:kworker.0 Request processed in 31us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.728370:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1746143840.728493:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a42af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3771:x1830963627476096:12345-0@lo:400:kworker.0 Request processed in 746us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.728504:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1746143840.728546:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963627476096:0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.728560:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627476608:0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.728569:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3771:1830963627477120:0@lo:400:kworker.0 00000100:00080000:2.0:1746143840.728603:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746143840.728607:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746143840.728609:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746143840.728612:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143840.729293:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627476480:0@lo:400:kworker.0 00000100:00100000:3.0:1746143840.729303:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3773:1830963627476992:0@lo:400:kworker.0 00000100:00100000:3.0:1746143840.729325:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143840.729353:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3773:1830963627476352:0@lo:400:kworker.0 00000100:00100000:3.0:1746143840.729365:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3773:1830963627476864:0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.730155:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627476992 00000100:00100000:2.0:1746143840.730161:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627476992 00000100:00100000:2.0:1746143840.730217:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1746143840.730224:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3773:x1830963627476992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143840.730268:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3773:x1830963627476992:12345-0@lo:400:kworker.0 Request processed in 45us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.730273:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1746143840.730309:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3773:1830963627476992:0@lo:400:kworker.0 00000100:00080000:3.0:1746143840.730372:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143840.730505:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3772:1830963627477248:0@lo:400:kworker.0 00000100:00100000:1.0:1746143840.730525:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627476224:0@lo:400:kworker.0 00000100:00100000:1.0:1746143840.730547:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3772:1830963627476736:0@lo:400:kworker.0 00000100:00100000:0.0:1746143840.731662:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.731854:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625006848 00000100:00100000:2.0:1746143840.731857:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627475968:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.731862:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625006848 00010000:00010000:2.0:1746143840.731875:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143840.731900:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2428928->2433023) req@ffff88007f64a680 x1830963625006848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.731909:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a680 with x1830963625006848 ext(2428928->2433023) 00002000:00010000:3.0:1746143840.731941:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64a680 00000100:00100000:2.0:1746143840.731948:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625006336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 14209us (15713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.731957:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8075 00000100:00100000:3.0:1746143840.731977:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7211 00000100:00100000:3.0:1746143840.731985:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625006848:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143840.732118:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625006848:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 134us (463us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143840.732125:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7211 00002000:00100000:3.0:1746143840.732131:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2428928->2433023) req@ffff88007f64a680 x1830963625006848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.732138:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a680 with x1830963625006848 ext(2428928->2433023) 00002000:00010000:3.0:1746143840.732140:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64a680 00000100:00100000:0.0:1746143840.743074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.743168:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625007104 00000100:00100000:2.0:1746143840.743182:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625007104 00000100:00100000:2.0:1746143840.743643:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5418 00000100:00100000:2.0:1746143840.743653:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:2754:x1830963625007104:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143840.743961:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:2754:x1830963625007104:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 309us (893us total) trans 8589945049 rc 0/0 00000100:00100000:2.0:1746143840.743968:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5418 00000100:00100000:0.0:1746143840.751758:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.752104:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625007360 00000100:00100000:2.0:1746143840.752112:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625007360 00000100:00100000:2.0:1746143840.752152:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13988 00000100:00100000:2.0:1746143840.752159:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+270:2764:x1830963625007360:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.752176:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.752190:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b529e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b31 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.752246:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.752257:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.752267:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.752277:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.752893:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.752899:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753009:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753022:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753027:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143840.753035:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.753097:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753103:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753108:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753113:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753117:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.753120:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753126:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753136:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.753138:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.753141:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753146:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b52a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753176:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753181:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753185:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753189:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.753191:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753195:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753201:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5bd5100) 00010000:00010000:2.0:1746143840.753203:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.753205:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753209:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b52ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.753241:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30400/0x87925e4cb73b529e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.753250:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 272 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.753255:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.753257:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143840.753259:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:2.0:1746143840.754608:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+272:2764:x1830963625007360:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2443us (2851us total) trans 8589945050 rc 0/0 00000100:00100000:2.0:1746143840.754616:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13988 00000100:00100000:0.0:1746143840.755307:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.755397:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625007488 00000100:00100000:2.0:1746143840.755404:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625007488 00000100:00100000:2.0:1746143840.755446:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16573 00000100:00100000:2.0:1746143840.755454:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2757:x1830963625007488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.755470:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.755488:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b38 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.755516:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.755524:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.755530:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.755537:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.755538:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.755542:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.755577:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.755588:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 15 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.755599:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627477376:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.755687:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.755695:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 10 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:2.0:1746143840.755706:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627477504:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.755734:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.755741:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 28 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.755748:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627477632:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.755765:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.759214:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.759276:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.759325:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627477376:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.759391:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625007616 00000100:00100000:1.0:1746143840.759398:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625007616 00000100:00100000:1.0:1746143840.759444:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16574 00000100:00100000:1.0:1746143840.759452:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625007616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.759472:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.759490:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048200/0x87925e4cb73b52c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b3f expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.759521:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048200/0x87925e4cb73b52c8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b3f expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.759530:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048200/0x87925e4cb73b52c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b3f expref: 34 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.759544:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048200, rc 0) 00000100:00100000:3.0:1746143840.759697:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625007744 00000100:00100000:3.0:1746143840.759702:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625007744 00010000:00010000:3.0:1746143840.759724:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:3.0:1746143840.759757:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8076 00000100:00100000:3.0:1746143840.759763:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625007744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.759773:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.759791:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143840.759801:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00010000:00010000:3.0:1746143840.759821:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143840.761204:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31600/0x87925e4cb73b5243 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b00 expref: 11 pid: 13436 timeout: 999 lvb_type: 1 00000100:00100000:0.0:1746143840.761222:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.761226:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627477504:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.761243:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627477632:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.761284:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.761296:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:2.0:1746143840.761316:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625007872 00000100:00100000:2.0:1746143840.761320:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625007872 00010000:00010000:2.0:1746143840.761357:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 16 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.761386:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8077 00000100:00100000:2.0:1746143840.761392:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625007872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.761402:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.761417:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 16 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.761429:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 16 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.761443:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b51ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411acf expref: 16 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.761450:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.761486:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625007872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.761489:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625007744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1723us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.761492:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8077 00000100:00100000:3.0:1746143840.761500:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8076 00000100:00100000:2.0:1746143840.761520:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2757:x1830963625007488:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6067us (6218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.761525:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16573 00000100:00100000:1.0:1746143840.761570:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625007616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2117us (2366us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143840.761576:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16574 00000100:00100000:0.0:1746143840.763149:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.763238:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625008000 00000100:00100000:2.0:1746143840.763244:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625008000 00010000:00010000:2.0:1746143840.763272:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 29 pid: 3135 timeout: 999 lvb_type: 0 00000100:00100000:2.0:1746143840.763310:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8078 00000100:00100000:2.0:1746143840.763320:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625008000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143840.763335:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143840.763367:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 29 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.763377:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 29 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.763396:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b51e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ac1 expref: 29 pid: 3135 timeout: 999 lvb_type: 0 00010000:00010000:2.0:1746143840.763410:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.763412:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143840.763419:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.763431:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.763465:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143840.763478:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627477760:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143840.763574:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143840.766412:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627477760:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143840.766437:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143840.766481:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625008000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3163us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.766492:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8078 00000100:00100000:0.0:1746143840.769330:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.769662:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625008256 00000100:00100000:1.0:1746143840.769672:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625008256 00002000:00100000:1.0:1746143840.769723:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3137536->3141631) req@ffff880093c70e00 x1830963625008256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.769732:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c70e00 with x1830963625008256 ext(3137536->3141631) 00002000:00010000:1.0:1746143840.769738:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c70e00 00000100:00100000:1.0:1746143840.769776:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7212 00000100:00100000:1.0:1746143840.769785:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625008256:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143840.769971:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625008256:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 186us (650us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143840.769977:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7212 00002000:00100000:1.0:1746143840.769983:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3137536->3141631) req@ffff880093c70e00 x1830963625008256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.769990:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093c70e00 with x1830963625008256 ext(3137536->3141631) 00002000:00010000:1.0:1746143840.769993:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093c70e00 00000100:00100000:0.0:1746143840.772533:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.772657:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625008384 00000100:00100000:1.0:1746143840.772665:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625008384 00000100:00100000:1.0:1746143840.772721:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16575 00000100:00100000:1.0:1746143840.772730:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2757:x1830963625008384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143840.772746:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.772764:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b46 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.772792:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.772800:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143840.772803:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143840.772807:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->3956735] (req 3145728->3956735) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.772837:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.772853:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 32 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:1.0:1746143840.772865:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627477888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.772982:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.775188:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627477888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143840.775217:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->3956735] (req 3145728->3956735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.775234:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049400, rc 0) 00000100:00100000:1.0:1746143840.775292:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2757:x1830963625008384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2562us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.775300:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16575 00000100:00100000:0.0:1746143840.776101:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.776150:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.776213:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625008640 00000100:00100000:3.0:1746143840.776220:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625008640 00002000:00100000:3.0:1746143840.776266:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880136634000 x1830963625008640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.776276:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136634000 with x1830963625008640 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.776280:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136634000 00000100:00100000:3.0:1746143840.776295:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625008896 00000100:00100000:3.0:1746143840.776298:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625008896 00002000:00100000:3.0:1746143840.776310:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1581055) req@ffff880136635c00 x1830963625008896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.776317:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635c00 with x1830963625008896 ext(1048576->1581055) 00002000:00010000:3.0:1746143840.776319:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635c00 00000100:00100000:3.0:1746143840.776333:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7213 00000100:00100000:3.0:1746143840.776348:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625008640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.776455:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7214 00000100:00100000:1.0:1746143840.776462:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625008896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.777447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.777487:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625009024 00000100:00100000:3.0:1746143840.777491:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625009024 00010000:00010000:3.0:1746143840.777513:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 35 pid: 13436 timeout: 999 lvb_type: 0 00000100:00100000:3.0:1746143840.777546:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8079 00000100:00100000:3.0:1746143840.777552:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625009024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.777562:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.777578:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 35 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.777591:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 35 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.777614:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0ca00/0x87925e4cb73b509f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a27 expref: 35 pid: 13436 timeout: 999 lvb_type: 0 00010000:00010000:3.0:1746143840.777630:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.777632:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.777639:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.777648:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.777682:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.777694:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627478016:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.777752:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.790773:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627478016:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143840.790795:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.790844:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625009024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 13291us (13398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.790855:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8079 00000100:00100000:1.0:1746143840.791128:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625008896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14666us (14977us total) trans 0 rc 532480/532480 00000100:00100000:1.0:1746143840.791137:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7214 00002000:00100000:1.0:1746143840.791148:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1581055) req@ffff880136635c00 x1830963625008896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 532480/532480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.791158:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635c00 with x1830963625008896 ext(1048576->1581055) 00002000:00010000:1.0:1746143840.791163:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635c00 00000100:00100000:3.0:1746143840.791275:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625008640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14936us (15176us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143840.791282:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7213 00002000:00100000:3.0:1746143840.791287:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880136634000 x1830963625008640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.791295:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136634000 with x1830963625008640 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.791298:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136634000 00000100:00100000:0.0:1746143840.794507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.794627:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625009280 00000100:00100000:3.0:1746143840.794637:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625009280 00002000:00100000:3.0:1746143840.794687:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3952640->3956735) req@ffff880136635500 x1830963625009280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.794696:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635500 with x1830963625009280 ext(3952640->3956735) 00002000:00010000:3.0:1746143840.794701:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635500 00000100:00100000:3.0:1746143840.794737:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7215 00000100:00100000:3.0:1746143840.794745:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625009280:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143840.794899:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625009280:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 154us (401us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143840.794906:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7215 00002000:00100000:3.0:1746143840.794943:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3952640->3956735) req@ffff880136635500 x1830963625009280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/4536 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.794950:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635500 with x1830963625009280 ext(3952640->3956735) 00002000:00010000:3.0:1746143840.794953:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635500 00000100:00100000:0.0:1746143840.798127:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.798195:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625009408 00000100:00100000:1.0:1746143840.798204:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625009408 00000100:00100000:0.0:1746143840.798226:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.799384:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625009536 00000100:00100000:1.0:1746143840.799391:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625009536 00000100:00100000:0.0:1746143840.799412:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16576 00000100:00100000:1.0:1746143840.799418:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16577 00000100:00100000:0.0:1746143840.799422:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625009408:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143840.799424:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625009536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.799440:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143840.799440:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.799457:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b52d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b54 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.799457:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73b52dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b4d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143840.799488:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73b52dd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b4d expref: 33 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.799499:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3e00/0x87925e4cb73b52dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b4d expref: 33 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143840.799510:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627478144:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143840.799530:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3e00, rc 0) 00000100:00100000:1.0:1746143840.799596:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.800453:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625009408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1013us (2316us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143840.800461:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16576 00000100:00100000:2.0:1746143840.800613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.800697:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625009792 00000100:00100000:3.0:1746143840.800702:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625009792 00000100:00100000:3.0:1746143840.800732:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5419 00000100:00100000:3.0:1746143840.800737:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2757:x1830963625009792:12345-192.168.202.3@tcp:35:multiop.0 00002000:00010000:0.0:1746143840.802038:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143840 -> 1746143841 00002000:00010000:0.0:1746143840.802044:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143838 -> 1746143841 00002000:00010000:0.0:1746143840.802046:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143840 -> 1746143841 00000100:00100000:3.0:1746143840.802419:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2757:x1830963625009792:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 1677us (1802us total) trans 8589945051 rc 0/0 00000100:00100000:3.0:1746143840.802433:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5419 00000100:00100000:0.0:1746143840.802769:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627478144:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143840.802801:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b52d6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b54 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.802819:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b52d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b54 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143840.802829:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96a00, rc 0) 00000100:00100000:0.0:1746143840.802850:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625009536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3426us (4625us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143840.802856:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16577 00000100:00100000:0.0:1746143840.809122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.809489:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010048 00000100:00100000:1.0:1746143840.809500:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010048 00002000:00100000:1.0:1746143840.809553:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2433024->3145727) req@ffff880136634700 x1830963625010048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143840.809562:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136634700 with x1830963625010048 ext(2433024->3145727) 00002000:00010000:1.0:1746143840.809569:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136634700 00000100:00100000:0.0:1746143840.810254:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7216 00000100:00100000:0.0:1746143840.810265:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625010048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143840.817335:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625010048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7059us (8216us total) trans 0 rc 712704/712704 00000100:00100000:0.0:1746143840.817358:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7216 00002000:00100000:0.0:1746143840.817371:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2433024->3145727) req@ffff880136634700 x1830963625010048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 712704/712704 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143840.817381:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136634700 with x1830963625010048 ext(2433024->3145727) 00002000:00010000:0.0:1746143840.817387:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136634700 00000100:00100000:0.0:1746143840.823460:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.824638:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010176 00000100:00100000:2.0:1746143840.824649:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010176 00000100:00100000:2.0:1746143840.824708:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16578 00000100:00100000:2.0:1746143840.824716:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2764:x1830963625010176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.824736:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.824755:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b5b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.824790:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.824803:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143840.824805:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143840.824808:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.824841:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.824853:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 13 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143840.824865:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627478272:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.825005:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143840.829448:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627478272:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.829484:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.829505:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136000, rc 0) 00000100:00100000:2.0:1746143840.829554:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2764:x1830963625010176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4838us (6105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.829562:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16578 00000100:00100000:0.0:1746143840.832860:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.833357:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010304 00000100:00100000:2.0:1746143840.833367:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010304 00002000:00100000:2.0:1746143840.833415:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3137536->3145727) req@ffff880136635180 x1830963625010304/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 8680/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.833431:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635180 with x1830963625010304 ext(3137536->3145727) 00010000:00010000:2.0:1746143840.833440:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 14 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143840.833453:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 14 pid: 13436 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143840.833460:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136635180 00000100:00100000:2.0:1746143840.833491:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2668 00000100:00100000:2.0:1746143840.833498:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625010304:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143840.835685:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625010304:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 2177us (2825us total) trans 21474841236 rc 0/0 00000100:00100000:2.0:1746143840.835698:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2668 00002000:00100000:2.0:1746143840.835709:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3137536->3145727) req@ffff880136635180 x1830963625010304/t21474841236(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 8680/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.835717:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635180 with x1830963625010304 ext(3137536->3145727) 00010000:00010000:2.0:1746143840.835726:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143840.835741:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143840.835747:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136635180 00000100:00100000:0.0:1746143840.840011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.840256:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010432 00000100:00100000:3.0:1746143840.840269:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010432 00010000:00010000:3.0:1746143840.840313:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143840.840365:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8080 00000100:00100000:3.0:1746143840.840373:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625010432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.840388:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.840411:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.840425:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.840451:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b52c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b38 expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.840548:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.840551:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.840559:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.840568:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.840602:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.840614:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627478400:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.842143:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.847061:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627478400:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143840.847087:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.847173:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625010432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6799us (7167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.847185:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8080 00000100:00100000:0.0:1746143840.848261:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.848327:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010688 00000100:00100000:2.0:1746143840.848347:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010688 00002000:00100000:2.0:1746143840.848391:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880136acb100 x1830963625010688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.848401:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963625010688 ext(2097152->3145727) 00002000:00010000:2.0:1746143840.848405:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb100 00000100:00100000:2.0:1746143840.848439:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7217 00000100:00100000:2.0:1746143840.848448:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625010688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143840.861876:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625010688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13417us (13606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143840.861889:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7217 00002000:00100000:2.0:1746143840.861902:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880136acb100 x1830963625010688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.861934:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963625010688 ext(2097152->3145727) 00002000:00010000:2.0:1746143840.861940:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143840.873701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.874123:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010816 00000100:00100000:2.0:1746143840.874133:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010816 00000100:00100000:2.0:1746143840.874181:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16579 00000100:00100000:2.0:1746143840.874189:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2764:x1830963625010816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.874209:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.874227:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b62 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.874260:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.874271:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143840.874273:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143840.874276:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.874305:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 13 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.874317:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 13 pid: 3135 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143840.874329:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627478528:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.874447:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143840.876407:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627478528:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.876437:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.876454:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136e00, rc 0) 00000100:00100000:2.0:1746143840.876492:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2764:x1830963625010816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2304us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143840.876500:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16579 00000100:00100000:0.0:1746143840.877101:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.877223:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625010944 00000100:00100000:2.0:1746143840.877229:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625010944 00002000:00100000:2.0:1746143840.877264:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3956735) req@ffff880136ac8a80 x1830963625010944/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.877307:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8a80 with x1830963625010944 ext(3145728->3956735) 00010000:00010000:2.0:1746143840.877315:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 14 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143840.877326:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 14 pid: 3135 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143840.877333:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136ac8a80 00000100:00100000:2.0:1746143840.877369:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2669 00000100:00100000:2.0:1746143840.877377:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625010944:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143840.887078:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746143840.887098:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627478656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143840.887160:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143840.887205:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627478656 00000100:00100000:3.0:1746143840.887212:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627478656 00000100:00100000:3.0:1746143840.887253:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1746143840.887260:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627478656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746143840.887282:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1171528896 pending 3162112 free 3910172672 avail 3678650368 00000100:00100000:3.0:1746143840.887318:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627478656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.887325:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1746143840.887381:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627478656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143840.887649:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143840.887666:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627478784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143840.887713:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143840.887830:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627478784 00000100:00100000:0.0:1746143840.887837:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627478784 00000100:00100000:0.0:1746143840.887877:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1746143840.887883:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627478784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746143840.887902:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 901120 granted 1158713408 pending 3706880 free 3906236416 avail 3674714112 00000100:00100000:0.0:1746143840.887951:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627478784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.887956:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1746143840.888072:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627478784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143840.892328:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.892579:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625011200 00000100:00100000:2.0:1746143840.892587:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625011200 00000100:00100000:2.0:1746143840.892653:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13989 00000100:00100000:2.0:1746143840.892661:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2769:x1830963625011200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.892680:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.892694:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b52f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b69 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.892855:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892868:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892878:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892889:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892894:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892899:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892988:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.892997:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893002:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143840.893009:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.893061:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893066:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893070:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893075:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893080:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.893083:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893088:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893096:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143840.893099:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.893102:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893106:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b52f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893132:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893135:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893139:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893143:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143840.893145:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893149:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893154:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88007f167e00) 00010000:00010000:2.0:1746143840.893156:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143840.893158:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893162:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b5300 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.893192:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b52f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 23 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.893202:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 22 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.893207:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.893209:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143840.893211:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136200, rc 0) 00000100:00100000:2.0:1746143840.893291:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2769:x1830963625011200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 630us (968us total) trans 8589945052 rc 0/0 00000100:00100000:2.0:1746143840.893296:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13989 00000100:00100000:2.0:1746143840.894059:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625010944:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 16682us (16959us total) trans 17179873966 rc 0/0 00000100:00100000:2.0:1746143840.894067:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2669 00002000:00100000:2.0:1746143840.896809:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3956735) req@ffff880136ac8a80 x1830963625010944/t17179873966(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.896821:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8a80 with x1830963625010944 ext(3145728->3956735) 00010000:00010000:2.0:1746143840.896830:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 16 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143840.896842:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 16 pid: 3135 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143840.896849:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136ac8a80 00000100:00100000:0.0:1746143840.898236:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.899201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.899220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.899525:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.899552:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625011328 00000100:00100000:1.0:1746143840.899559:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625011328 00000100:00100000:1.0:1746143840.899592:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625011456 00000100:00100000:1.0:1746143840.899595:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625011456 00000100:00100000:1.0:1746143840.899609:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625011584 00000100:00100000:1.0:1746143840.899611:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625011584 00000100:00100000:1.0:1746143840.899626:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16580 00000100:00100000:1.0:1746143840.899633:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625011328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.899647:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.899659:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b5315 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b70 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143840.899712:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627478912:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143840.899767:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.899786:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16581 00000100:00100000:1.0:1746143840.899791:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625011456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.899797:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.899803:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97a00/0x87925e4cb73b531c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b77 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.899818:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97a00/0x87925e4cb73b531c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b77 expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.899827:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97a00/0x87925e4cb73b531c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b77 expref: 19 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143840.900017:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16582 00000100:00100000:3.0:1746143840.900025:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625011584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.900032:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.900040:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b7e expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.900050:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.900052:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.900059:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 16 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.900071:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 16 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.900079:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3000, rc 0) 00000100:00100000:3.0:1746143840.900100:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625011584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 76us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.900106:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16582 00000100:00100000:3.0:1746143840.900557:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625011712 00000100:00100000:3.0:1746143840.900561:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625011712 00010000:00010000:3.0:1746143840.900577:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 19 pid: 3135 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143840.900627:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8081 00000100:00100000:3.0:1746143840.900633:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625011712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.900641:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143840.900653:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143840 -> 1746143841 00002000:00010000:3.0:1746143840.900656:0:7229:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143840 -> 1746143841 00010000:00010000:3.0:1746143840.900661:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 19 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.900670:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 19 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.900681:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049400/0x87925e4cb73b52cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4849663] (req 3145728->3956735) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b46 expref: 19 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.900693:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.900694:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.900699:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.900705:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.900723:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.900731:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627479040:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143840.900856:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97a00, rc 0) 00000100:00100000:3.0:1746143840.901514:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.901681:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625011456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1888us (2479us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143840.901687:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16581 00000100:00100000:1.0:1746143840.903066:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746143840.903080:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e30b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627479168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746143840.903122:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143840.903748:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627479168 00000100:00100000:0.0:1746143840.903755:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627479168 00000100:00100000:0.0:1746143840.903787:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1746143840.903792:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963627479168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746143840.903820:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445224448 avail 1315762176 00000100:00100000:0.0:1746143840.903858:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3772:x1830963627479168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143840.903863:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1746143840.904103:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627479168:0@lo:41:osp-pre-0-1.0 00002000:00010000:1.0:1746143840.906031:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143840 -> 1746143841 00002000:00010000:1.0:1746143840.906035:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143833 -> 1746143841 00002000:00010000:1.0:1746143840.906037:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143840 -> 1746143841 00000100:00100000:1.0:1746143840.906055:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627478912:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143840.906080:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b5315 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b70 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.906092:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b5315 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b70 expref: 17 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.906101:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97600, rc 0) 00000100:00100000:1.0:1746143840.906243:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625011328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6609us (8009us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143840.906250:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16580 00000100:00100000:3.0:1746143840.906793:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627479040:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143840.906804:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.907252:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625011712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6618us (7726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.907259:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8081 00000100:00100000:0.0:1746143840.916284:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.916446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.916513:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012096 00000100:00100000:2.0:1746143840.916522:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012096 00002000:00100000:2.0:1746143840.916560:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880090e79880 x1830963625012096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.916569:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79880 with x1830963625012096 ext(3145728->4194303) 00002000:00010000:2.0:1746143840.916574:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e79880 00000100:00100000:2.0:1746143840.916588:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012224 00000100:00100000:2.0:1746143840.916590:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012224 00002000:00100000:2.0:1746143840.916600:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880090e79f80 x1830963625012224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.916605:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79f80 with x1830963625012224 ext(3145728->4194303) 00002000:00010000:2.0:1746143840.916608:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e79f80 00000100:00100000:2.0:1746143840.916987:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7218 00000100:00100000:2.0:1746143840.916994:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625012096:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143840.917554:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7219 00000100:00100000:3.0:1746143840.917563:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625012224:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143840.923175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.924609:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012352 00000100:00100000:1.0:1746143840.924617:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012352 00000100:00100000:1.0:1746143840.924669:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16583 00000100:00100000:1.0:1746143840.924677:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2769:x1830963625012352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.924691:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.924705:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b85 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.924728:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.924739:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143840.924740:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143840.924743:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.924767:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.924778:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 34 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143840.924787:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627479296:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.924867:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143840.926254:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625012096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9257us (9974us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143840.926263:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7218 00002000:00100000:2.0:1746143840.926271:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880090e79880 x1830963625012096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143840.926279:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79880 with x1830963625012096 ext(3145728->4194303) 00002000:00010000:2.0:1746143840.926283:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e79880 00000100:00100000:3.0:1746143840.934019:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625012224:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16451us (17566us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143840.934030:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7219 00002000:00100000:3.0:1746143840.934039:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880090e79f80 x1830963625012224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.934052:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79f80 with x1830963625012224 ext(3145728->4194303) 00002000:00010000:3.0:1746143840.934056:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e79f80 00000100:00100000:1.0:1746143840.935980:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627479296:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143840.936004:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.936019:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:1.0:1746143840.936057:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2769:x1830963625012352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11381us (12889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.936064:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16583 00000100:00100000:0.0:1746143840.938311:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.938412:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012480 00000100:00100000:3.0:1746143840.938419:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012480 00002000:00100000:3.0:1746143840.938452:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1581056->2097151) req@ffff880090e7b100 x1830963625012480/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.938461:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b100 with x1830963625012480 ext(1581056->2097151) 00010000:00010000:3.0:1746143840.938468:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 33 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.938479:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 33 pid: 13436 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143840.938484:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e7b100 00000100:00100000:3.0:1746143840.938514:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2670 00000100:00100000:3.0:1746143840.938521:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625012480:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143840.947133:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.947624:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.948138:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012736 00000100:00100000:3.0:1746143840.948148:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012736 00000100:00100000:3.0:1746143840.948177:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012608 00000100:00100000:3.0:1746143840.948180:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012608 00000100:00100000:3.0:1746143840.948195:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16584 00000100:00100000:3.0:1746143840.948201:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625012736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.948215:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.948229:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b5331 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b93 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.948255:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b5331 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b93 expref: 39 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.948264:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b5331 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b93 expref: 39 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.948278:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31600, rc 0) 00000100:00100000:3.0:1746143840.948319:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625012736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (1198us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143840.948324:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16584 00000100:00100000:3.0:1746143840.948345:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16585 00000100:00100000:3.0:1746143840.948351:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625012608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143840.948357:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143840.948363:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73b5338 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b8c expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.948393:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627479424:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143840.948442:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.953873:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625012480:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15346us (15561us total) trans 17179873967 rc 0/0 00000100:00100000:3.0:1746143840.953883:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2670 00002000:00100000:3.0:1746143840.953892:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1581056->2097151) req@ffff880090e7b100 x1830963625012480/t17179873967(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/448 e 0 to 0 dl 1746143851 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.953900:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b100 with x1830963625012480 ext(1581056->2097151) 00010000:00010000:3.0:1746143840.953908:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 37 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.953944:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 37 pid: 13436 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143840.953950:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e7b100 00000100:00100000:3.0:1746143840.954384:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627479424:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143840.954409:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73b5338 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b8c expref: 36 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.954420:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30400/0x87925e4cb73b5338 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b8c expref: 36 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143840.954432:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30400, rc 0) 00000100:00100000:3.0:1746143840.954464:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625012608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6113us (6841us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143840.954470:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16585 00000100:00100000:0.0:1746143840.957026:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.957129:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625012864 00000100:00100000:3.0:1746143840.957137:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625012864 00010000:00010000:3.0:1746143840.957166:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 35 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143840.957198:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8082 00000100:00100000:3.0:1746143840.957204:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625012864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.957216:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.957231:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 35 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.957241:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 35 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.957259:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30800/0x87925e4cb73b527b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1581056->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b15 expref: 35 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.957272:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.957274:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143840.957279:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.957287:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143840.957311:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143840.957321:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627479552:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143840.957576:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143840.958169:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143840.958225:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625013120 00000100:00100000:3.0:1746143840.958228:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625013120 00002000:00100000:3.0:1746143840.958246:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880090e7b480 x1830963625013120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.958252:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b480 with x1830963625013120 ext(4194304->4853759) 00002000:00010000:3.0:1746143840.958256:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e7b480 00000100:00100000:3.0:1746143840.958277:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7220 00000100:00100000:3.0:1746143840.958283:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625013120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143840.962183:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627479552:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143840.962204:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.962251:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625012864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5046us (5229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.962259:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8082 00000100:00100000:3.0:1746143840.965066:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625013120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6776us (6889us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143840.965075:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7220 00002000:00100000:3.0:1746143840.965084:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880090e7b480 x1830963625013120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.965092:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b480 with x1830963625013120 ext(4194304->4853759) 00002000:00010000:3.0:1746143840.965097:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e7b480 00000100:00100000:1.0:1746143840.971353:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.971943:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.971973:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143840.972108:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746143840.972209:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625013632 00000100:00100000:0.0:1746143840.972210:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625013504 00000100:00100000:2.0:1746143840.972217:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625013632 00000100:00100000:0.0:1746143840.972218:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625013504 00000100:00100000:2.0:1746143840.972257:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16586 00000100:00100000:2.0:1746143840.972263:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625013632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.972278:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.972291:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73b533f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ba1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.972318:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73b533f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ba1 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.972327:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136c00/0x87925e4cb73b533f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ba1 expref: 36 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.972355:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136c00, rc 0) 00000100:00100000:2.0:1746143840.972394:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625013632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (420us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143840.972401:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16586 00000100:00100000:3.0:1746143840.972591:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625013376 00000100:00100000:3.0:1746143840.972596:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625013376 00002000:00100000:3.0:1746143840.972619:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880091d4c000 x1830963625013376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/0 e 0 to 0 dl 1746143851 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.972627:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c000 with x1830963625013376 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.972632:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4c000 00000100:00100000:3.0:1746143840.972652:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7221 00000100:00100000:3.0:1746143840.972656:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625013376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143840.972680:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16587 00000100:00100000:1.0:1746143840.972685:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625013504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.972692:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.972698:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411b9a expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.972709:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.972711:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143840.972717:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 35 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.972729:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 35 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143840.972737:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97e00, rc 0) 00000100:00100000:1.0:1746143840.972757:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625013504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 71us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.972762:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16587 00000100:00100000:0.0:1746143840.981494:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.981741:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625013760 00000100:00100000:2.0:1746143840.981749:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625013760 00000100:00100000:2.0:1746143840.981797:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16588 00000100:00100000:2.0:1746143840.981804:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625013760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143840.981819:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.981832:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b534d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ba8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.981858:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b534d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ba8 expref: 36 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.981868:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137400/0x87925e4cb73b534d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ba8 expref: 36 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143840.981879:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137400, rc 0) 00000100:00100000:2.0:1746143840.981937:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625013760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 133us (449us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143840.981943:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16588 00000100:00100000:3.0:1746143840.984051:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625013376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11382us (12700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143840.984065:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7221 00002000:00100000:3.0:1746143840.984077:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880091d4c000 x1830963625013376/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:236/0 lens 488/440 e 0 to 0 dl 1746143851 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143840.984088:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4c000 with x1830963625013376 ext(1048576->2097151) 00002000:00010000:3.0:1746143840.984094:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4c000 00000100:00100000:0.0:1746143840.984335:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.984472:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014016 00000100:00100000:2.0:1746143840.984483:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014016 00000100:00100000:2.0:1746143840.984529:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13990 00000100:00100000:2.0:1746143840.984536:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+272:2772:x1830963625014016:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143840.984557:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143840.984570:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b5354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411baf expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.984649:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.984662:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.984669:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.984675:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 21 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.984686:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.984714:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 21 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.984723:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 21 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143840.985153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.985202:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627479680:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.985289:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.985297:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 273 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143840.985305:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627479808:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143840.985327:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.985335:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 8 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143840.985353:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627479936:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.985367:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143840.985895:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014272 00000100:00100000:3.0:1746143840.985903:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014272 00000100:00100000:3.0:1746143840.985958:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5420 00000100:00100000:3.0:1746143840.985964:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:2764:x1830963625014272:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143840.987044:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:2764:x1830963625014272:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1077us (1890us total) trans 8589945053 rc 0/0 00000100:00100000:3.0:1746143840.987053:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5420 00000100:00100000:0.0:1746143840.988351:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143840.988353:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627479680:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.988400:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627479808:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143840.988408:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627479936:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143840.988468:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014400 00000100:00100000:3.0:1746143840.988475:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014400 00010000:00010000:2.0:1746143840.988476:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.988502:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 22 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143840.988535:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8083 00000100:00100000:3.0:1746143840.988542:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625014400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.988589:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.988596:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 22 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.988605:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 22 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.988625:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136200/0x87925e4cb73b5307 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b69 expref: 22 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.988639:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143840.988643:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.988652:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.988657:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.988699:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625014400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.988705:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8083 00000100:00100000:0.0:1746143840.990939:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143840.990980:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.991021:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014528 00000100:00100000:1.0:1746143840.991030:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014528 00000100:00100000:3.0:1746143840.991034:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014656 00000100:00100000:3.0:1746143840.991037:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014656 00010000:00010000:3.0:1746143840.991064:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 9 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143840.991101:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8084 00000100:00100000:3.0:1746143840.991109:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625014656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143840.991121:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.991127:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 9 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.991135:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 9 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143840.991140:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 275 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143840.991154:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8085 00010000:00010000:3.0:1746143840.991155:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4e0de00/0x87925e4cb73b5274 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b0e expref: 9 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143840.991159:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+275:2009:x1830963625014528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143840.991165:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143840.991166:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143840.991168:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 275 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143840.991170:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.991178:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143840.991183:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143840.991187:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 275 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143840.991197:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b52b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b31 expref: 275 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143840.991773:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143840.991778:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.991786:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.991793:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143840.991812:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143840.991933:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625014656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 824us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143840.991940:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8084 00000100:00100000:1.0:1746143840.992178:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+274:2009:x1830963625014528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1017us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.992185:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8085 00010000:00010000:2.0:1746143840.992328:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143840.992335:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143840.992365:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143840.992502:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b5354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 275 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.992532:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 274 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143840.992538:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143840.992541:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143840.992543:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136c00, rc 0) 00000100:00100000:2.0:1746143840.992577:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+274:2772:x1830963625014016:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8041us (8243us total) trans 8589945054 rc 0/0 00000100:00100000:2.0:1746143840.992582:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13990 00000100:00100000:0.0:1746143840.994573:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143840.994647:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014784 00000100:00100000:1.0:1746143840.994655:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014784 00000100:00100000:1.0:1746143840.994703:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16589 00000100:00100000:1.0:1746143840.994714:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2769:x1830963625014784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143840.994872:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143840.994890:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bb6 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.994956:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.994963:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143840.994965:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143840.994968:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.995008:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 34 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.995021:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 34 pid: 1947 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143840.995034:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627480064:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143840.995161:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143840.999441:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627480064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143840.999496:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143840.999525:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a9c00, rc 0) 00000100:00100000:1.0:1746143840.999605:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2769:x1830963625014784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4886us (5031us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143840.999614:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16589 00000100:00100000:0.0:1746143841.000225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.000771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.000796:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625014912 00000100:00100000:3.0:1746143841.000805:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625014912 00002000:00100000:3.0:1746143841.000856:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2433023) req@ffff880090e7aa00 x1830963625014912/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.000866:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7aa00 with x1830963625014912 ext(2097152->2433023) 00010000:00010000:3.0:1746143841.000873:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 35 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.000886:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 35 pid: 1947 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.000897:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e7aa00 00000100:00100000:3.0:1746143841.000946:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2671 00000100:00100000:3.0:1746143841.000955:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625014912:12345-192.168.202.3@tcp:4:cat.0 00000100:00080000:2.0:1746143841.001076:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143841.001091:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625015040 00000100:00100000:2.0:1746143841.001094:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625015040 00000100:00100000:2.0:1746143841.001135:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13991 00000100:00100000:2.0:1746143841.001143:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2773:x1830963625015040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143841.001159:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.001176:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47c200/0x87925e4cb73b5370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bbd expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746143841.001212:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143841.001236:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001249:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001260:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001272:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001277:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001281:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001358:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001368:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.001374:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.001406:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 273 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.001419:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 273 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.001431:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627480192:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.001507:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.008013:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d842300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627480192:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.008057:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143841.008677:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.008823:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625015168 00000100:00100000:0.0:1746143841.008832:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625015168 00010000:00010000:0.0:1746143841.008935:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 274 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.009017:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8086 00000100:00100000:0.0:1746143841.009026:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+274:2008:x1830963625015168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1746143841.009030:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746143841.009101:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.009109:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 274 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.009120:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 274 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.009143:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b535b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411baf expref: 274 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.009171:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.009176:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.009186:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.009193:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.009281:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.009323:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+273:2008:x1830963625015168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 298us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.009330:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8086 00010000:00010000:2.0:1746143841.010330:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010350:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143841.010432:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143841.010437:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143841.010453:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010463:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010473:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010478:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010483:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010487:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010491:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.010495:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010501:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010511:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143841.010513:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.010517:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010521:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b5377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010549:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010555:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010559:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010563:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.010565:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010569:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010575:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e015500) 00010000:00010000:2.0:1746143841.010577:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.010579:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010588:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b537e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.010879:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c47c200/0x87925e4cb73b5370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.010894:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.010900:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.010902:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143841.010904:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76c00, rc 0) 00000100:00100000:2.0:1746143841.011459:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2773:x1830963625015040:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 10315us (10686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.011467:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13991 00000100:00100000:3.0:1746143841.012563:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963625014912:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11601us (12329us total) trans 17179873968 rc 0/0 00000100:00100000:3.0:1746143841.012573:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2671 00002000:00100000:3.0:1746143841.012583:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2433023) req@ffff880090e7aa00 x1830963625014912/t17179873968(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.012590:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7aa00 with x1830963625014912 ext(2097152->2433023) 00010000:00010000:3.0:1746143841.012599:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 37 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.012612:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 37 pid: 1947 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.012617:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090e7aa00 00000100:00100000:0.0:1746143841.016225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.016260:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.016279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.016322:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.016353:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625015680 00000100:00100000:0.0:1746143841.016360:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625015680 00010000:00010000:0.0:1746143841.016388:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 37 pid: 1947 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.016411:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8087 00000100:00100000:0.0:1746143841.016417:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625015680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.016427:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746143841.016442:0:16784:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143840 -> 1746143841 00010000:00010000:0.0:1746143841.016447:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 37 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.016457:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 37 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.016474:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b5297 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2433023) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b2a expref: 37 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.016488:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.016490:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.016495:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.016503:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.016526:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.016535:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627480320:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143841.016590:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.016804:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625015296 00000100:00100000:1.0:1746143841.016814:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625015296 00000100:00100000:1.0:1746143841.016853:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625015424 00000100:00100000:1.0:1746143841.016856:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625015424 00000100:00100000:1.0:1746143841.016868:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625015552 00000100:00100000:1.0:1746143841.016870:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625015552 00000100:00100000:1.0:1746143841.016903:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16590 00000100:00100000:1.0:1746143841.016937:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625015296:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143841.016955:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.016971:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bc4 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.016993:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.016995:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.017002:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.017017:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.017028:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380e00, rc 0) 00000100:00100000:3.0:1746143841.017054:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16591 00000100:00100000:3.0:1746143841.017064:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625015424:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143841.017075:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.017085:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bcb expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.017085:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625015296:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 174us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.017091:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16590 00010000:00010000:3.0:1746143841.017099:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.017100:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.017104:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143841.017108:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16592 00000100:00100000:1.0:1746143841.017113:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625015552:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143841.017115:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.017120:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.017122:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00010000:00010000:1.0:1746143841.017131:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bd2 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.017143:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143841.017145:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625015424:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 84us (884us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143841.017145:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143841.017150:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16591 00010000:00010000:1.0:1746143841.017150:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.017159:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.017166:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381600, rc 0) 00000100:00100000:1.0:1746143841.017185:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625015552:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 72us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.017190:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16592 00000100:00100000:2.0:1746143841.022506:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627480320:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.022527:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.022577:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625015680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6159us (6253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.022586:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8087 00000100:00100000:0.0:1746143841.028768:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.029243:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625016448 00000100:00100000:2.0:1746143841.029252:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625016448 00000100:00100000:2.0:1746143841.029301:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13992 00000100:00100000:2.0:1746143841.029307:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2773:x1830963625016448:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143841.029324:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.029348:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bd9 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.029602:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.029614:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.029621:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.029648:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.029658:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 10 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.029668:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627480448:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.030211:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.030929:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.031173:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625016064 00000100:00100000:3.0:1746143841.031179:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625016064 00002000:00100000:3.0:1746143841.031207:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096e55f80 x1830963625016064/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.031215:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55f80 with x1830963625016064 ext(2097152->4194303) 00002000:00010000:3.0:1746143841.031219:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e55f80 00000100:00100000:3.0:1746143841.031233:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7222 00000100:00100000:3.0:1746143841.031238:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625016064:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143841.036353:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.036464:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625016192 00000100:00100000:2.0:1746143841.036473:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625016192 00002000:00100000:2.0:1746143841.036516:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880135b0b100 x1830963625016192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.036525:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0b100 with x1830963625016192 ext(2097152->4194303) 00002000:00010000:2.0:1746143841.036529:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0b100 00000100:00100000:2.0:1746143841.036546:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7223 00000100:00100000:2.0:1746143841.036552:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625016192:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143841.042954:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627480448:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.042976:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143841.047010:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.047161:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625016576 00000100:00100000:2.0:1746143841.047172:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625016576 00010000:00010000:2.0:1746143841.047206:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 11 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.047248:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8088 00000100:00100000:2.0:1746143841.047255:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625016576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.047268:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.047273:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 11 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.047282:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 11 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.047301:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b5385 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bbd expref: 11 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.047328:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.047332:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.047348:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.047353:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.047370:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.047406:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625016576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 151us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.047411:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8088 00010000:00010000:2.0:1746143841.047475:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.047481:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143841.047496:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143841.047595:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd9 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.047607:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd9 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.047613:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.047615:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143841.047617:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77200, rc 0) 00000100:00100000:2.0:1746143841.047639:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2773:x1830963625016448:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 18332us (18878us total) trans 8589945055 rc 0/0 00000100:00100000:2.0:1746143841.047645:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13992 00000100:00100000:0.0:1746143841.054373:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.054451:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625016832 00000100:00100000:2.0:1746143841.054459:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625016832 00000100:00100000:2.0:1746143841.054508:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13993 00000100:00100000:2.0:1746143841.054515:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2776:x1830963625016832:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143841.054533:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.054547:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73b53b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411be0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.054601:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054616:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054624:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054635:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054640:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054645:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054712:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b53cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054720:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b53cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054725:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b53cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143841.054732:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143841.054779:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054785:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054790:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054794:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054799:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.054801:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054806:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054814:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143841.054816:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.054819:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054824:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76e00/0x87925e4cb73b53bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054836:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054840:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054843:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054846:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.054847:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054851:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054856:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009705fc00) 00010000:00010000:2.0:1746143841.054858:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.054859:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054863:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b53c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.054890:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77400/0x87925e4cb73b53b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411be0 expref: 24 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.054900:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b53cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411be0 expref: 23 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.054905:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.054907:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143841.054908:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76600, rc 0) 00000100:00100000:2.0:1746143841.054979:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2776:x1830963625016832:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 463us (612us total) trans 8589945056 rc 0/0 00000100:00100000:2.0:1746143841.054985:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13993 00000100:00080000:1.0:1746143841.055072:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143841.078968:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625016064:12345-192.168.202.3@tcp:3:cat.0 Request processed in 47718us (48747us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143841.078981:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7222 00002000:00100000:3.0:1746143841.078993:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096e55f80 x1830963625016064/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.079003:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55f80 with x1830963625016064 ext(2097152->4194303) 00002000:00010000:3.0:1746143841.079008:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e55f80 00000100:00100000:2.0:1746143841.081952:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625016192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 45387us (45604us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143841.081964:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7223 00002000:00100000:2.0:1746143841.081976:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880135b0b100 x1830963625016192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.081984:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0b100 with x1830963625016192 ext(2097152->4194303) 00002000:00010000:2.0:1746143841.081991:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0b100 00000100:00100000:0.0:1746143841.089766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.089802:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625017088 00000100:00100000:0.0:1746143841.089810:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625017088 00000100:00100000:0.0:1746143841.089858:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13994 00000100:00100000:0.0:1746143841.089865:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2773:x1830963625017088:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143841.089890:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.089894:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746143841.089940:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77200/0x87925e4cb73b53a8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd9 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.089961:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.089966:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143841.089976:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b53d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411be7 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.090071:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090083:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090092:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090102:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090107:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090113:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090117:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143841.090121:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090127:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090133:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.090135:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143841.090137:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090141:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97a00/0x87925e4cb73b53e0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143841.090158:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b53d9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411be7 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.090164:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b53d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411be7 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.090170:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:0.0:1746143841.090214:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2773:x1830963625017088:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 349us (459us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.090220:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13994 00000100:00100000:0.0:1746143841.090263:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.090378:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625017216 00000100:00100000:0.0:1746143841.090381:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625017216 00000100:00100000:0.0:1746143841.090406:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 997 00000100:00100000:0.0:1746143841.090411:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625017216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.090419:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.090428:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b53cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411be0 expref: 23 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.090436:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.090438:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.090455:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625017216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.090461:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 997 00000100:00100000:0.0:1746143841.107756:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.107895:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625017472 00000100:00100000:2.0:1746143841.107906:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625017472 00000100:00100000:2.0:1746143841.107968:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5421 00000100:00100000:2.0:1746143841.107976:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2773:x1830963625017472:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143841.108175:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2773:x1830963625017472:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 200us (429us total) trans 8589945057 rc 0/0 00000100:00100000:2.0:1746143841.108181:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5421 00000100:00100000:1.0:1746143841.110552:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.111007:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625017728 00000100:00100000:2.0:1746143841.111016:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625017728 00002000:00100000:2.0:1746143841.111061:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880092145500 x1830963625017728/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.111070:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145500 with x1830963625017728 ext(4194304->4849663) 00002000:00010000:2.0:1746143841.111075:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145500 00000100:00100000:2.0:1746143841.111099:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7224 00000100:00100000:2.0:1746143841.111106:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625017728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143841.124550:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625017728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13434us (13992us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746143841.124563:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7224 00002000:00100000:2.0:1746143841.124575:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880092145500 x1830963625017728/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.124585:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145500 with x1830963625017728 ext(4194304->4849663) 00002000:00010000:2.0:1746143841.124591:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145500 00000100:00100000:0.0:1746143841.135075:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.135111:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625017984 00000100:00100000:0.0:1746143841.135120:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625017984 00000100:00100000:0.0:1746143841.135179:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5422 00000100:00100000:0.0:1746143841.135187:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2769:x1830963625017984:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143841.135420:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2769:x1830963625017984:12345-192.168.202.3@tcp:35:cat.0 Request processed in 233us (351us total) trans 8589945058 rc 0/0 00000100:00100000:0.0:1746143841.135426:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5422 00000100:00100000:0.0:1746143841.168183:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.168402:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625018112 00000100:00100000:2.0:1746143841.168411:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625018112 00000100:00100000:2.0:1746143841.168465:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16593 00000100:00100000:2.0:1746143841.168472:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2772:x1830963625018112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143841.168490:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.168508:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bee expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.168538:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.168547:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.168552:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.168559:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.168560:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.168564:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.168595:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.168606:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.168619:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627480576:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.168719:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.168727:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 10 pid: 1945 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.168735:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627480704:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.168760:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.168767:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 16 pid: 3134 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.168774:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627480832:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.168789:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.178071:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627480576:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.178084:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627480704:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.178092:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627480832:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.178126:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.178145:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76200, rc 0) 00000100:00100000:3.0:1746143841.178287:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2772:x1830963625018112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9726us (10029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.178297:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16593 00000100:00100000:0.0:1746143841.183031:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.183102:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.183128:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625018240 00000100:00100000:0.0:1746143841.183136:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625018240 00010000:00010000:0.0:1746143841.183170:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.183193:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625018368 00000100:00100000:0.0:1746143841.183195:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625018368 00010000:00010000:0.0:1746143841.183203:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 11 pid: 1945 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.183220:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8089 00000100:00100000:0.0:1746143841.183228:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963625018240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.183239:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.183258:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.183268:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.183292:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136e00/0x87925e4cb73b52eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b62 expref: 37 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.183306:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.183356:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625018240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 129us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.183362:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8089 00000100:00100000:0.0:1746143841.183376:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8090 00000100:00100000:0.0:1746143841.183380:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625018368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.183388:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.183394:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 11 pid: 1945 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143841.183402:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 11 pid: 1945 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143841.183417:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b5393 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bcb expref: 11 pid: 1945 timeout: 1000 lvb_type: 1 00010000:00010000:0.0:1746143841.183427:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.183441:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625018368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.183445:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8090 00000100:00100000:1.0:1746143841.194850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.194908:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625018496 00000100:00100000:0.0:1746143841.194934:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625018496 00010000:00010000:0.0:1746143841.194969:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 17 pid: 3134 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.194995:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8091 00000100:00100000:0.0:1746143841.195002:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625018496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.195018:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.195039:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 17 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.195051:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 17 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.195072:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b5369 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bb6 expref: 17 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.195088:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.195090:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.195096:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.195105:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.195134:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.195145:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627480960:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143841.195225:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.199559:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627480960:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.199584:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.199642:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625018496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4638us (4802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.199653:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8091 00000100:00100000:0.0:1746143841.200774:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.201200:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625018752 00000100:00100000:2.0:1746143841.201208:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625018752 00002000:00100000:2.0:1746143841.201252:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3710976->3715071) req@ffff88012457ca80 x1830963625018752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.201261:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ca80 with x1830963625018752 ext(3710976->3715071) 00002000:00010000:2.0:1746143841.201266:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457ca80 00000100:00100000:2.0:1746143841.201293:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7225 00000100:00100000:2.0:1746143841.201299:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625018752:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143841.201450:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625018752:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 150us (679us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143841.201457:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7225 00002000:00100000:2.0:1746143841.201462:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3710976->3715071) req@ffff88012457ca80 x1830963625018752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.201468:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ca80 with x1830963625018752 ext(3710976->3715071) 00002000:00010000:2.0:1746143841.201471:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457ca80 00000100:00100000:0.0:1746143841.217366:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.217456:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625018880 00000100:00100000:3.0:1746143841.217470:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625018880 00000100:00080000:1.0:1746143841.217545:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746143841.217659:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16594 00000100:00100000:3.0:1746143841.217670:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2772:x1830963625018880:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143841.217688:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.217707:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bf5 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.217739:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.217748:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.217755:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 15 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.217761:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.217763:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.217766:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->3461119] (req 3145728->3461119) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.217797:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 15 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.217808:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 15 pid: 1947 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.217822:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627481088:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.217964:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.217973:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 10 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.217982:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627481216:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.218016:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.218023:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.218030:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e30b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627481344:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.218046:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.226826:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.226901:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625019136 00000100:00100000:1.0:1746143841.226947:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625019136 00000100:00100000:1.0:1746143841.227002:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13995 00000100:00100000:1.0:1746143841.227011:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+273:2781:x1830963625019136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.227040:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.227061:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b53f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411bfc expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.227075:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627481088:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.227085:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627481216:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.227092:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627481344:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.227119:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3145728->3461119] (req 3145728->3461119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.227137:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.227139:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1200, rc 0) 00010000:00010000:1.0:1746143841.227149:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227159:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227170:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227174:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227179:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143841.227195:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2772:x1830963625018880:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9525us (9833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.227203:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16594 00010000:00010000:1.0:1746143841.227272:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227280:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227285:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143841.227292:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143841.227379:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227386:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227391:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227396:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227403:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee76e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143841.227407:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227413:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227423:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143841.227426:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143841.227430:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227434:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b53fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227456:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227461:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227466:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227470:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee76400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143841.227472:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227476:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227482:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b40f3d00) 00010000:00010000:1.0:1746143841.227484:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143841.227487:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227490:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b5403 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.227526:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b53f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 276 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.227535:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 275 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.227541:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143841.227543:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143841.227544:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25000, rc 0) 00000100:00100000:1.0:1746143841.227577:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+275:2781:x1830963625019136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 567us (757us total) trans 8589945059 rc 0/0 00000100:00100000:1.0:1746143841.227583:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13995 00000100:00100000:0.0:1746143841.234655:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.237218:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625019264 00000100:00100000:2.0:1746143841.237231:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625019264 00010000:00010000:2.0:1746143841.237268:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 16 pid: 1947 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.239081:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8092 00000100:00100000:2.0:1746143841.239094:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625019264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.239108:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.239127:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 16 pid: 1947 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.239139:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 16 pid: 1947 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.239157:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3000/0x87925e4cb73b5323 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b7e expref: 16 pid: 1947 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.239187:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.239228:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625019264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 134us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.239297:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.239346:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625019392 00000100:00100000:1.0:1746143841.239352:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625019392 00010000:00010000:1.0:1746143841.239370:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 11 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143841.239388:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8093 00000100:00100000:1.0:1746143841.239393:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625019392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.239400:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.239408:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 11 pid: 3134 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143841.239420:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 11 pid: 3134 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143841.239431:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091381600/0x87925e4cb73b539a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bd2 expref: 11 pid: 3134 timeout: 1000 lvb_type: 1 00010000:00010000:1.0:1746143841.239440:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.239456:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625019392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 63us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.239461:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8093 00000100:00100000:2.0:1746143841.239895:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8092 00000100:00100000:1.0:1746143841.240883:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.240908:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.240956:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.241002:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625019648 00000100:00100000:3.0:1746143841.241006:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625019648 00000100:00100000:3.0:1746143841.241025:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625019520 00000100:00100000:3.0:1746143841.241027:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625019520 00000100:00100000:3.0:1746143841.241038:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16595 00000100:00100000:3.0:1746143841.241043:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625019648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.241055:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.241064:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73b5418 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c0a expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.241078:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.241084:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73b5418 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c0a expref: 31 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.241092:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c0800/0x87925e4cb73b5418 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c0a expref: 31 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.241100:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0800, rc 0) 00000100:00100000:3.0:1746143841.241121:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fed7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625019648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 78us (240us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.241126:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16595 00000100:00100000:3.0:1746143841.241233:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16596 00000100:00100000:3.0:1746143841.241237:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625019520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.241243:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.241250:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c0400/0x87925e4cb73b541f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c03 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.241262:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0400/0x87925e4cb73b541f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c03 expref: 37 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.241268:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0400/0x87925e4cb73b541f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c03 expref: 37 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.241275:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0400, rc 0) 00000100:00100000:3.0:1746143841.241287:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625019520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 51us (379us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.241291:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16596 00000100:00100000:0.0:1746143841.241414:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625019776 00000100:00100000:0.0:1746143841.241418:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625019776 00010000:00010000:0.0:1746143841.241435:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.241462:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8094 00000100:00100000:0.0:1746143841.241468:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625019776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.241475:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.241486:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.241499:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.241510:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136000/0x87925e4cb73b52e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b5b expref: 30 pid: 3135 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.241522:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.241523:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.241529:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 29 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.241536:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 29 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.241560:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 29 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.241698:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627481472:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143841.242519:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.246852:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627481472:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.246872:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.246962:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625019776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5493us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.246971:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8094 00000100:00100000:0.0:1746143841.249949:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.250050:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625020032 00000100:00100000:3.0:1746143841.250061:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625020032 00002000:00100000:3.0:1746143841.250111:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3457024->3461119) req@ffff88012457c380 x1830963625020032/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.250121:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c380 with x1830963625020032 ext(3457024->3461119) 00002000:00010000:3.0:1746143841.250126:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c380 00000100:00100000:3.0:1746143841.250164:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7226 00000100:00100000:3.0:1746143841.250173:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625020032:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143841.250321:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625020032:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 149us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143841.250328:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7226 00002000:00100000:3.0:1746143841.250334:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3457024->3461119) req@ffff88012457c380 x1830963625020032/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.250355:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c380 with x1830963625020032 ext(3457024->3461119) 00002000:00010000:3.0:1746143841.250358:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457c380 00000100:00100000:0.0:1746143841.252775:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.252869:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625020288 00000100:00100000:1.0:1746143841.252878:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625020288 00000100:00100000:1.0:1746143841.252964:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5423 00000100:00100000:1.0:1746143841.252971:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2772:x1830963625020288:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143841.253180:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:2772:x1830963625020288:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 208us (415us total) trans 8589945060 rc 0/0 00000100:00100000:1.0:1746143841.253186:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5423 00000100:00100000:0.0:1746143841.261871:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.262003:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625020544 00000100:00100000:2.0:1746143841.262013:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625020544 00002000:00100000:2.0:1746143841.262061:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012457d500 x1830963625020544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.262072:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d500 with x1830963625020544 ext(1048576->2097151) 00002000:00010000:2.0:1746143841.262077:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d500 00000100:00100000:2.0:1746143841.262112:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7227 00000100:00100000:2.0:1746143841.262120:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625020544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143841.263297:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.265160:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625020672 00000100:00100000:1.0:1746143841.265173:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625020672 00000100:00100000:1.0:1746143841.265239:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13996 00000100:00100000:1.0:1746143841.265247:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2784:x1830963625020672:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143841.265272:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.265293:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b5426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c11 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.265370:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265383:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265394:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265410:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265415:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265420:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265493:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265504:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265510:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143841.265551:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:1.0:1746143841.265556:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143841.265573:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265582:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265590:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265595:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265600:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265605:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265610:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee76600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143841.265613:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265619:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265628:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143841.265631:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143841.265635:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.265640:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b542d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268770:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268784:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268789:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268796:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012408ee00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143841.268800:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268806:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268823:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b40f3000) 00010000:00010000:1.0:1746143841.268826:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143841.268829:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268833:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ee00/0x87925e4cb73b5434 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.268896:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b5426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.268923:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.268930:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143841.268932:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143841.268934:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093973c00, rc 0) 00000100:00100000:1.0:1746143841.269007:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2784:x1830963625020672:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3759us (5712us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.269016:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13996 00000100:00100000:1.0:1746143841.270074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.270097:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625020928 00000100:00100000:1.0:1746143841.270105:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625020928 00000100:00100000:3.0:1746143841.271567:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13997 00000100:00100000:3.0:1746143841.271583:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2788:x1830963625020928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.271608:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.271642:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b5442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c18 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.271723:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271736:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271746:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271758:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271764:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271769:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271874:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271884:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.271889:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143841.271898:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143841.272012:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272018:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272024:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272030:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272035:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c0a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.272039:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272044:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272054:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143841.272057:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143841.272060:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272065:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0a00/0x87925e4cb73b5449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272117:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272122:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272127:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272130:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.272133:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272141:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272148:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14d00) 00010000:00010000:3.0:1746143841.272150:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143841.272152:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272156:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5450 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.272190:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b5442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 26 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.272200:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 25 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.272205:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.272207:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143841.272209:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:3.0:1746143841.272350:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2788:x1830963625020928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 772us (2279us total) trans 8589945061 rc 0/0 00000100:00100000:3.0:1746143841.272357:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13997 00000100:00100000:0.0:1746143841.273349:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625020544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11228us (11486us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143841.273359:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7227 00002000:00100000:0.0:1746143841.273369:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012457d500 x1830963625020544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143841.273378:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d500 with x1830963625020544 ext(1048576->2097151) 00002000:00010000:0.0:1746143841.273382:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d500 00000100:00100000:0.0:1746143841.274498:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.275556:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.275650:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625021056 00000100:00100000:1.0:1746143841.275661:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625021056 00000100:00100000:1.0:1746143841.275704:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625021184 00000100:00100000:1.0:1746143841.275706:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625021184 00000100:00100000:1.0:1746143841.275723:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16597 00000100:00100000:1.0:1746143841.275730:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625021056:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143841.275747:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.275766:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097338000/0x87925e4cb73b5465 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c1f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.275799:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097338000/0x87925e4cb73b5465 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c1f expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.275810:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097338000/0x87925e4cb73b5465 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c1f expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143841.275818:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16598 00010000:00010000:1.0:1746143841.275824:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097338000, rc 0) 00000100:00100000:2.0:1746143841.275828:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625021184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.275836:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.275847:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77a00/0x87925e4cb73b546c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c26 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.275876:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625021056:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 146us (1380us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143841.275881:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16597 00000100:00100000:2.0:1746143841.275891:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627481600:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143841.277189:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.277710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.277756:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.278293:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625021440 00000100:00100000:1.0:1746143841.278300:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625021440 00000100:00100000:1.0:1746143841.278344:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625021312 00000100:00100000:1.0:1746143841.278346:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625021312 00000100:00100000:1.0:1746143841.278413:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16599 00000100:00100000:1.0:1746143841.278420:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625021440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.278435:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.278453:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73b5473 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c34 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.278498:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627481728:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143841.278566:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.278665:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16600 00000100:00100000:2.0:1746143841.278674:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625021312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.278685:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.278696:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b547a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c2d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.278715:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b547a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c2d expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.278724:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b547a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c2d expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.278740:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:2.0:1746143841.278765:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625021312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 93us (1008us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.278771:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16600 00000100:00100000:3.0:1746143841.282234:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.282665:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625021568 00000100:00100000:0.0:1746143841.282676:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625021568 00000100:00100000:0.0:1746143841.282730:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16601 00000100:00100000:0.0:1746143841.282739:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2781:x1830963625021568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143841.282760:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.282777:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c3b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.282804:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.282806:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.282814:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.282828:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.282838:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381600, rc 0) 00000100:00100000:0.0:1746143841.282897:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2781:x1830963625021568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 159us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.282907:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16601 00000100:00100000:2.0:1746143841.283123:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627481600:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.283153:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77a00/0x87925e4cb73b546c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c26 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.283163:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77a00/0x87925e4cb73b546c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c26 expref: 11 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.283173:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77a00, rc 0) 00000100:00100000:2.0:1746143841.283191:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625021184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7366us (7638us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.283196:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16598 00000100:00100000:0.0:1746143841.283768:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092145880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627481728:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143841.283789:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73b5473 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c34 expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.283797:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012224fc00/0x87925e4cb73b5473 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c34 expref: 16 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.283810:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224fc00, rc 0) 00000100:00100000:0.0:1746143841.284957:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625021440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6532us (7243us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.284964:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16599 00000100:00100000:0.0:1746143841.286253:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.286444:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625021824 00000100:00100000:3.0:1746143841.286452:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625021824 00000100:00100000:3.0:1746143841.286499:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13998 00000100:00100000:3.0:1746143841.286507:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2784:x1830963625021824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143841.286530:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.286549:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b5488 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c42 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286649:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.286663:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 275 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286669:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286676:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 24 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286681:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.286710:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 24 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286719:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 24 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.286729:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e30b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627481856:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.286813:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286825:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 12 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.286833:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627481984:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.286858:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 275 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.286865:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 275 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.286872:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627482112:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.288281:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.295744:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.295788:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.295841:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.295860:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.295894:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.296093:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625022080 00000100:00100000:3.0:1746143841.296104:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625022080 00002000:00100000:3.0:1746143841.296154:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012457e300 x1830963625022080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.296164:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e300 with x1830963625022080 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.296169:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457e300 00000100:00100000:3.0:1746143841.296188:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625022336 00000100:00100000:3.0:1746143841.296191:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625022336 00002000:00100000:3.0:1746143841.296204:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012457f800 x1830963625022336/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.296210:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f800 with x1830963625022336 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.296213:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f800 00000100:00100000:3.0:1746143841.296224:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7228 00000100:00100000:3.0:1746143841.296231:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625022080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143841.296315:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625022592 00000100:00100000:1.0:1746143841.296319:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625022592 00010000:00010000:1.0:1746143841.296350:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 13 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.296377:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625022464 00000100:00100000:1.0:1746143841.296379:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625022464 00010000:00010000:1.0:1746143841.296388:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 25 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.296399:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625022720 00000100:00100000:1.0:1746143841.296401:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625022720 00010000:00010000:1.0:1746143841.296408:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 276 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.296419:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8095 00000100:00100000:1.0:1746143841.296423:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625022592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.296432:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.296437:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 13 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.296447:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 13 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.296473:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143841.296478:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296487:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296493:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.296540:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625022592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.296547:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8095 00000100:00100000:1.0:1746143841.296563:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8096 00000100:00100000:1.0:1746143841.296567:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625022464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.296572:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.296576:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 25 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.296583:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 25 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.296593:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143841.296596:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296601:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296604:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.296617:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625022464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.296622:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8096 00000100:00100000:1.0:1746143841.296631:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8097 00000100:00100000:1.0:1746143841.296635:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963625022720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.296641:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.296644:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 276 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.296653:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 276 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.296662:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143841.296665:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296672:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296679:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143841.296697:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.296709:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963625022720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.296713:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8097 00000100:00100000:2.0:1746143841.296906:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7229 00000100:00100000:2.0:1746143841.296934:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625022336:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143841.297767:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1a00/0x87925e4cb73b5457 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c18 expref: 24 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.297798:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e30b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627481856:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.297812:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093973c00/0x87925e4cb73b543b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c11 expref: 12 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.297821:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627481984:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.297830:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25000/0x87925e4cb73b540a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bfc expref: 275 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.297841:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627482112:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.297862:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.297870:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.297875:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143841.297894:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000100:00100000:3.0:1746143841.297972:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143841.298043:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b5488 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.298057:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.298068:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.298071:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143841.298073:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0400, rc 0) 00000100:00100000:2.0:1746143841.298095:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2784:x1830963625021824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 11590us (11846us total) trans 8589945062 rc 0/0 00000100:00100000:2.0:1746143841.298102:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13998 00000100:00100000:1.0:1746143841.298868:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625022848 00000100:00100000:1.0:1746143841.298876:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625022848 00000100:00100000:1.0:1746143841.298955:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16602 00000100:00100000:1.0:1746143841.298962:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2788:x1830963625022848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.298978:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.298993:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c49 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.299016:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.299018:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.299027:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.299040:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.299049:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012224e200, rc 0) 00000100:00100000:1.0:1746143841.299085:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2788:x1830963625022848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 124us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.299091:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16602 00000100:00100000:3.0:1746143841.305405:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625022080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9160us (9657us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.305418:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7228 00002000:00100000:3.0:1746143841.305429:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012457e300 x1830963625022080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.305439:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e300 with x1830963625022080 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.305445:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457e300 00000100:00100000:0.0:1746143841.309241:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.309848:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023104 00000100:00100000:3.0:1746143841.309858:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023104 00002000:00100000:3.0:1746143841.309901:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880092b46300 x1830963625023104/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.309935:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b46300 with x1830963625023104 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.309941:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b46300 00000100:00100000:3.0:1746143841.309959:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7230 00000100:00100000:3.0:1746143841.309965:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625023104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143841.318743:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.319160:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625022336:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22225us (23368us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.319172:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7229 00002000:00100000:2.0:1746143841.319184:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012457f800 x1830963625022336/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.319194:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457f800 with x1830963625022336 ext(2097152->3145727) 00002000:00010000:2.0:1746143841.319200:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012457f800 00000100:00100000:3.0:1746143841.319441:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023232 00000100:00100000:3.0:1746143841.319450:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023232 00000100:00100000:3.0:1746143841.319503:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13999 00000100:00100000:3.0:1746143841.319511:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2784:x1830963625023232:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143841.319533:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.319552:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b54a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c50 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.319644:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.319660:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.319666:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.319697:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.319708:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 13 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.319720:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627482240:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.319967:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.320785:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625023104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10817us (11551us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.320794:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7230 00002000:00100000:3.0:1746143841.320801:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880092b46300 x1830963625023104/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.320809:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b46300 with x1830963625023104 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.320813:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b46300 00000100:00100000:3.0:1746143841.323971:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627482240:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.323999:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143841.324242:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.327391:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023360 00000100:00100000:2.0:1746143841.327406:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023360 00010000:00010000:2.0:1746143841.327459:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 14 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.327516:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8098 00000100:00100000:2.0:1746143841.327525:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625023360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.327541:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.327547:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 14 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.327558:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 14 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.327582:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b548f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c42 expref: 14 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.327612:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.327617:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.327629:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.327636:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.327670:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143841.327708:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.327718:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143841.327728:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625023360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 204us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.327735:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8098 00000004:00200000:3.0:1746143841.327773:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143841.327778:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143841.327796:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.327826:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84f200/0x87925e4cb73b54a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.327843:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.327849:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.327852:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143841.327854:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:3.0:1746143841.327882:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2784:x1830963625023232:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8373us (9149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.327888:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13999 00000100:00100000:2.0:1746143841.329713:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.329737:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023488 00000100:00100000:0.0:1746143841.329745:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023488 00000100:00100000:2.0:1746143841.329746:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.329780:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023616 00000100:00100000:0.0:1746143841.329783:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023616 00000100:00100000:0.0:1746143841.329798:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16603 00000100:00100000:0.0:1746143841.329806:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2781:x1830963625023488:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143841.329807:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16604 00000100:00100000:2.0:1746143841.329812:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2788:x1830963625023616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.329822:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.329822:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.329836:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c5e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.329836:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c57 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.329860:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 28 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.329860:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.329867:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143841.329870:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.329871:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.329872:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143841.329873:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.329874:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.329897:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 28 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.329897:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.329907:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 28 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.329907:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 38 pid: 1947 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.329933:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627482496:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.329933:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627482368:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.330004:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.330009:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.332441:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627482368:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.332475:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 38 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.332491:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381000, rc 0) 00000100:00100000:2.0:1746143841.332532:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2781:x1830963625023488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2727us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.332541:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16603 00000100:00100000:0.0:1746143841.332692:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.332739:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023872 00000100:00100000:2.0:1746143841.332745:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023872 00000100:00100000:2.0:1746143841.332785:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16605 00000100:00100000:2.0:1746143841.332791:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2776:x1830963625023872:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143841.332805:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.332819:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c65 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.332839:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.332847:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.332853:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.332858:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.332859:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.332862:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1802240->2097151] (req 1802240->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.332884:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.332893:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 28 pid: 9585 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.332902:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627482624:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.332968:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627482496:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.332983:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.332983:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.332992:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76600, rc 0) 00010000:00010000:2.0:1746143841.332996:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.333005:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627482752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.333012:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2788:x1830963625023616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3200us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.333017:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16604 00010000:00010000:2.0:1746143841.333030:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.333039:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 9 pid: 9586 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.333046:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627482880:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.333329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.333480:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024000 00000100:00100000:3.0:1746143841.333484:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024000 00002000:00100000:3.0:1746143841.333514:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3461119) req@ffff880092b47b80 x1830963625024000/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.333522:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b47b80 with x1830963625024000 ext(3145728->3461119) 00010000:00010000:3.0:1746143841.333528:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 29 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.333538:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 29 pid: 1947 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.333544:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b47b80 00000100:00100000:3.0:1746143841.333558:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2672 00000100:00100000:3.0:1746143841.333563:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625024000:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143841.333723:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.333810:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.333853:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.334096:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625023744 00000100:00100000:3.0:1746143841.334100:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625023744 00002000:00100000:3.0:1746143841.334116:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3710976->4194303) req@ffff88012d842300 x1830963625023744/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.334122:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842300 with x1830963625023744 ext(3710976->4194303) 00010000:00010000:3.0:1746143841.334127:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 38 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.334135:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 38 pid: 1947 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.334141:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d842300 00000100:00100000:3.0:1746143841.334153:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2673 00000100:00100000:3.0:1746143841.334158:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625023744:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143841.334208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.334372:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024128 00000100:00100000:3.0:1746143841.334375:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024128 00000100:00100000:3.0:1746143841.334401:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024256 00000100:00100000:3.0:1746143841.334403:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024256 00000100:00100000:3.0:1746143841.334417:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16606 00000100:00100000:3.0:1746143841.334422:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625024128:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143841.334430:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.334440:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73b54c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c6c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.334459:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73b54c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c6c expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.334467:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fa00/0x87925e4cb73b54c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c6c expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.334477:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fa00, rc 0) 00000100:00100000:0.0:1746143841.334529:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16607 00000100:00100000:0.0:1746143841.334536:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625024256:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143841.334543:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.334550:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091380400/0x87925e4cb73b54ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c73 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.334584:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483008:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.334712:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625024128:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 288us (857us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.334718:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16606 00000100:00100000:0.0:1746143841.334779:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.338987:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627482752:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.339030:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627482624:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.339053:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.339075:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024384 00000100:00100000:2.0:1746143841.339080:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024384 00010000:00010000:2.0:1746143841.339114:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.339150:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8099 00000100:00100000:2.0:1746143841.339158:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625024384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.339171:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.339191:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.339200:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143841.339202:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.339224:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31200/0x87925e4cb73b502f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119be expref: 18 pid: 13436 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.339233:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627482880:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.339246:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143841.339261:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1802240->2097151] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 17 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.339272:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76a00, rc 0) 00000100:00100000:2.0:1746143841.339283:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625024384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.339290:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8099 00000100:00100000:0.0:1746143841.339292:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2776:x1830963625023872:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6502us (6602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.339299:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16605 00000100:00100000:2.0:1746143841.339304:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024512 00000100:00100000:2.0:1746143841.339307:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024512 00010000:00010000:2.0:1746143841.339317:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 31 pid: 9585 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.339332:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8100 00000100:00100000:2.0:1746143841.339347:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625024512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.339353:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.339359:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 31 pid: 9585 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.339372:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 31 pid: 9585 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.339375:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483008:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.339382:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d428e00/0x87925e4cb73b4fc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411978 expref: 31 pid: 9585 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.339389:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143841.339394:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091380400/0x87925e4cb73b54ce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c73 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.339403:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091380400/0x87925e4cb73b54ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c73 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143841.339405:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625024512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.339410:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8100 00010000:00010000:0.0:1746143841.339414:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380400, rc 0) 00000100:00100000:0.0:1746143841.339430:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625024256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4895us (5223us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.339436:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16607 00000100:00100000:2.0:1746143841.339460:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.339472:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024640 00000100:00100000:2.0:1746143841.339475:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024640 00010000:00010000:2.0:1746143841.339486:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 10 pid: 9586 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.339498:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8101 00000100:00100000:2.0:1746143841.339502:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625024640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.339508:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.339514:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 10 pid: 9586 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.341477:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 10 pid: 9586 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.341492:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625024000:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7926us (8161us total) trans 21474841237 rc 0/0 00000100:00100000:3.0:1746143841.341506:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2672 00010000:00010000:2.0:1746143841.341506:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53800/0x87925e4cb73b4f25 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411940 expref: 10 pid: 9586 timeout: 1000 lvb_type: 1 00002000:00100000:3.0:1746143841.341516:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3461119) req@ffff880092b47b80 x1830963625024000/t21474841237(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143841.341519:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.341521:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746143841.341525:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b47b80 with x1830963625024000 ext(3145728->3461119) 00010000:00010000:2.0:1746143841.341529:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.341533:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.341537:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.341544:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.341550:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b47b80 00010000:00010000:2.0:1746143841.341572:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.341585:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627483136:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143841.342303:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.345397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.345454:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.345826:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627483136:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.345847:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.345896:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625024640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6392us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.345907:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8101 00000100:00100000:2.0:1746143841.345966:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625024896 00000100:00100000:2.0:1746143841.345972:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625024896 00000100:00100000:2.0:1746143841.346003:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14000 00000100:00100000:2.0:1746143841.346009:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2784:x1830963625024896:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.346032:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.346051:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b54d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c7a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.346148:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346162:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346172:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346182:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346187:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346192:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346196:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.346199:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346204:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346212:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.346214:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143841.346217:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346225:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77a00/0x87925e4cb73b54dc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.346247:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b54d5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c7a expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.346253:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b54d5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c7a expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.346259:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:2.0:1746143841.346275:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2784:x1830963625024896:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 267us (886us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.346280:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14000 00000100:00100000:3.0:1746143841.346653:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625025152 00000100:00100000:3.0:1746143841.346662:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625025152 00002000:00100000:3.0:1746143841.346694:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1802240->1806335) req@ffff8800972e9880 x1830963625025152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.346703:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9880 with x1830963625025152 ext(1802240->1806335) 00002000:00010000:3.0:1746143841.346708:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9880 00000100:00100000:3.0:1746143841.346734:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7231 00000100:00100000:3.0:1746143841.346739:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625025152:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143841.347779:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625025152:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1034us (2319us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143841.347788:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7231 00002000:00100000:3.0:1746143841.347794:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1802240->1806335) req@ffff8800972e9880 x1830963625025152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.347808:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9880 with x1830963625025152 ext(1802240->1806335) 00002000:00010000:3.0:1746143841.347811:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9880 00000100:00100000:3.0:1746143841.347900:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625023744:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13740us (14089us total) trans 17179873969 rc 0/0 00000100:00100000:3.0:1746143841.347906:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2673 00002000:00100000:3.0:1746143841.347925:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3710976->4194303) req@ffff88012d842300 x1830963625023744/t17179873969(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.347933:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842300 with x1830963625023744 ext(3710976->4194303) 00010000:00010000:3.0:1746143841.347940:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 40 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.347952:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 40 pid: 1947 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.347958:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d842300 00000100:00100000:0.0:1746143841.348974:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.349725:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625025280 00000100:00100000:2.0:1746143841.349734:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625025280 00010000:00010000:2.0:1746143841.349765:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.349801:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8102 00000100:00100000:2.0:1746143841.349808:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625025280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.349819:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.349835:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.349845:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.349869:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1200/0x87925e4cb73b53ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3461119) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bf5 expref: 30 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.349881:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.349883:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.349889:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.349897:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.350756:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.350801:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625025536 00000100:00100000:3.0:1746143841.350806:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625025536 00000100:00100000:3.0:1746143841.350830:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5424 00000100:00100000:3.0:1746143841.350835:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2784:x1830963625025536:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143841.351004:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2784:x1830963625025536:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 167us (248us total) trans 8589945063 rc 0/0 00000100:00100000:3.0:1746143841.351010:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5424 00010000:00010000:2.0:1746143841.352162:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.352177:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627483264:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143841.352486:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.353205:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.353256:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625025664 00000100:00100000:3.0:1746143841.353260:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625025664 00010000:00010000:3.0:1746143841.353280:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 40 pid: 1947 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.353332:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8103 00000100:00100000:3.0:1746143841.353347:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625025664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.353356:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.353371:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 40 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.353380:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 40 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.353397:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b53e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3710976->4849663] (req 3710976->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bee expref: 40 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.353406:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143841.353625:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627483264:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.353638:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.353658:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625025280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3852us (4686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.353664:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8102 00010000:00010000:3.0:1746143841.353699:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.353705:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.353712:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.353732:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.353739:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627483392:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143841.353765:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.357060:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627483392:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143841.357076:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.357092:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.357115:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625025664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3768us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.357123:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8103 00000100:00100000:0.0:1746143841.357534:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625025920 00000100:00100000:0.0:1746143841.357540:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625025920 00000100:00100000:0.0:1746143841.357568:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16608 00000100:00100000:0.0:1746143841.357574:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2776:x1830963625025920:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143841.357585:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.357598:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c81 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.357621:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.357629:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 8 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.357635:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.357640:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.357641:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.357645:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1048576->1753087] (req 1048576->1753087) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.357666:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.357675:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 28 pid: 13430 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.357686:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483520:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143841.357751:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 8 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.357758:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 8 pid: 13430 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.357765:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483648:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143841.357787:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.357794:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 17 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.357801:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483776:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.357819:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.363755:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.363789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.363845:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.363869:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.363951:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625026560 00000100:00100000:3.0:1746143841.363959:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625026560 00010000:00010000:3.0:1746143841.363989:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 9 pid: 13430 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.364012:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625026432 00000100:00100000:3.0:1746143841.364014:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625026432 00010000:00010000:3.0:1746143841.364021:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 29 pid: 13430 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.364036:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8104 00000100:00100000:3.0:1746143841.364048:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625026560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.364059:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.364076:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 9 pid: 13430 timeout: 1000 lvb_type: 1 00000100:00100000:2.0:1746143841.364089:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8105 00000100:00100000:2.0:1746143841.364097:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625026432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.364106:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.364114:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 29 pid: 13430 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.364123:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 29 pid: 13430 timeout: 1000 lvb_type: 1 00010000:00010000:2.0:1746143841.364141:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.364170:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625026432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.364175:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8105 00000100:00100000:2.0:1746143841.364197:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625026176 00000100:00100000:2.0:1746143841.364200:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625026176 00010000:00010000:1.0:1746143841.364203:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2600/0x87925e4cb73b5235 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ae4 expref: 28 pid: 13430 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143841.364218:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483520:192.168.202.3@tcp:104: 00002000:00100000:2.0:1746143841.364222:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800972ead80 x1830963625026176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143841.364226:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483648:192.168.202.3@tcp:104: 00002000:00100000:2.0:1746143841.364230:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ead80 with x1830963625026176 ext(3145728->4194303) 00002000:00010000:2.0:1746143841.364234:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972ead80 00000100:00100000:2.0:1746143841.364252:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625026304 00000100:00100000:2.0:1746143841.364254:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625026304 00002000:00100000:2.0:1746143841.364265:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff8800972e8e00 x1830963625026304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.364271:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8e00 with x1830963625026304 ext(2097152->3145727) 00002000:00010000:2.0:1746143841.364273:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8e00 00000100:00100000:2.0:1746143841.364288:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7232 00000100:00100000:2.0:1746143841.364293:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625026176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143841.364664:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7233 00000100:00100000:1.0:1746143841.364672:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625026304:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:3.0:1746143841.365355:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 9 pid: 13430 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.365369:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2c00/0x87925e4cb73b524a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411aeb expref: 9 pid: 13430 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.365392:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.365415:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625026560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1368us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.365422:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8104 00000100:00100000:1.0:1746143841.372137:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627483776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.372173:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->1753087] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 19 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.372189:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380000, rc 0) 00000100:00100000:1.0:1746143841.372238:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2776:x1830963625025920:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14663us (15145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.372246:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16608 00000100:00100000:0.0:1746143841.373146:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.373877:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625026688 00000100:00100000:3.0:1746143841.373884:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625026688 00010000:00010000:3.0:1746143841.373909:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 19 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.374355:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625026176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10060us (10606us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.374363:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7232 00002000:00100000:2.0:1746143841.374371:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800972ead80 x1830963625026176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.374379:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ead80 with x1830963625026176 ext(3145728->4194303) 00002000:00010000:2.0:1746143841.374383:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972ead80 00000100:00100000:3.0:1746143841.374648:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8106 00000100:00100000:3.0:1746143841.374656:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625026688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.374668:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.374682:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 19 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.374693:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 19 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.374710:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b51b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ab3 expref: 19 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.374723:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.374724:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.374730:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.374741:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.374768:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.374777:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627483904:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143841.374820:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.375133:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625026304:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10461us (11341us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143841.375139:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7233 00002000:00100000:1.0:1746143841.375145:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff8800972e8e00 x1830963625026304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.375151:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8e00 with x1830963625026304 ext(2097152->3145727) 00002000:00010000:1.0:1746143841.375154:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8e00 00000100:00100000:3.0:1746143841.378210:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627483904:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143841.378228:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.380509:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625026688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5844us (7355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.380524:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8106 00000100:00100000:0.0:1746143841.384376:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.384523:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.384543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.384577:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.384656:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625026944 00000100:00100000:1.0:1746143841.384665:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625026944 00002000:00100000:1.0:1746143841.384703:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1748992->1753087) req@ffff8800972ea680 x1830963625026944/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.384712:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ea680 with x1830963625026944 ext(1748992->1753087) 00002000:00010000:1.0:1746143841.384716:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972ea680 00000100:00100000:1.0:1746143841.384734:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7234 00000100:00100000:1.0:1746143841.384740:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625026944:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143841.384846:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625026944:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 105us (300us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143841.384854:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7234 00002000:00100000:1.0:1746143841.384859:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1748992->1753087) req@ffff8800972ea680 x1830963625026944/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.384866:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ea680 with x1830963625026944 ext(1748992->1753087) 00002000:00010000:1.0:1746143841.384869:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972ea680 00000100:00100000:1.0:1746143841.384887:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625027456 00000100:00100000:1.0:1746143841.384890:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625027456 00000100:00100000:1.0:1746143841.384937:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14001 00000100:00100000:1.0:1746143841.384942:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+275:2791:x1830963625027456:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143841.384955:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.384968:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b54ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c96 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385022:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385032:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385040:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385050:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385056:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385061:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385138:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385148:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385153:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143841.385160:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143841.385212:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385217:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385222:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385227:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385232:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143841.385235:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385241:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385250:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143841.385252:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143841.385256:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385263:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b54f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385277:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385281:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385286:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385290:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143841.385292:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385296:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385301:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b40f3800) 00010000:00010000:1.0:1746143841.385303:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143841.385305:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385309:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b54f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.385348:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b54ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 278 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385358:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 277 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385368:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143841.385370:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143841.385372:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513400, rc 0) 00000100:00100000:1.0:1746143841.385389:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+277:2791:x1830963625027456:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 447us (867us total) trans 8589945064 rc 0/0 00000100:00100000:1.0:1746143841.385395:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14001 00000100:00100000:1.0:1746143841.385412:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625027072 00000100:00100000:1.0:1746143841.385415:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625027072 00000100:00100000:1.0:1746143841.385430:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625027200 00000100:00100000:1.0:1746143841.385431:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625027200 00000100:00100000:1.0:1746143841.385444:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16609 00000100:00100000:1.0:1746143841.385449:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2788:x1830963625027072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.385456:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.385463:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c88 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385475:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.385477:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.385483:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385493:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 18 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385500:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c4abc00, rc 0) 00000100:00100000:1.0:1746143841.385515:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2788:x1830963625027072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.385521:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16609 00000100:00100000:1.0:1746143841.385530:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16610 00000100:00100000:1.0:1746143841.385534:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2781:x1830963625027200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.385539:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.385546:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c8f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385557:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.385558:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.385561:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385570:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 29 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.385577:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513200, rc 0) 00000100:00100000:1.0:1746143841.385590:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2781:x1830963625027200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 55us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.385595:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16610 00000100:00100000:0.0:1746143841.389978:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.390098:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625027712 00000100:00100000:1.0:1746143841.390106:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625027712 00000100:00100000:1.0:1746143841.390159:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5425 00000100:00100000:1.0:1746143841.390166:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2776:x1830963625027712:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143841.390325:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2776:x1830963625027712:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 159us (353us total) trans 8589945065 rc 0/0 00000100:00100000:1.0:1746143841.390332:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5425 00000100:00100000:0.0:1746143841.390588:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.390861:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625027968 00000100:00100000:3.0:1746143841.390865:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625027968 00002000:00100000:3.0:1746143841.390887:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800972eb800 x1830963625027968/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.390897:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb800 with x1830963625027968 ext(3145728->4194303) 00002000:00010000:3.0:1746143841.390901:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb800 00000100:00100000:3.0:1746143841.390944:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7235 00000100:00100000:3.0:1746143841.390949:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625027968:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143841.394427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.394458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.394564:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625028224 00000100:00100000:3.0:1746143841.394573:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625028224 00002000:00100000:3.0:1746143841.394609:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092147b80 x1830963625028224/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.394619:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147b80 with x1830963625028224 ext(3145728->4194303) 00002000:00010000:3.0:1746143841.394624:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092147b80 00000100:00100000:3.0:1746143841.394638:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625028480 00000100:00100000:3.0:1746143841.394641:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625028480 00002000:00100000:3.0:1746143841.394652:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880092145180 x1830963625028480/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.394659:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145180 with x1830963625028480 ext(3145728->4194303) 00002000:00010000:3.0:1746143841.394662:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092145180 00000100:00100000:3.0:1746143841.394682:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7236 00000100:00100000:3.0:1746143841.394689:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625028224:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143841.395259:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7237 00000100:00100000:3.0:1746143841.395265:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625028480:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143841.409308:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625028224:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 14609us (14877us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.409319:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7236 00002000:00100000:2.0:1746143841.409329:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092147b80 x1830963625028224/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.409348:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147b80 with x1830963625028224 ext(3145728->4194303) 00002000:00010000:2.0:1746143841.409353:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092147b80 00000100:00100000:3.0:1746143841.409542:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625027968:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 18592us (18953us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.409548:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7235 00002000:00100000:3.0:1746143841.409553:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800972eb800 x1830963625027968/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.409560:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb800 with x1830963625027968 ext(3145728->4194303) 00002000:00010000:3.0:1746143841.409563:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb800 00000100:00100000:3.0:1746143841.412810:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625028480:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 17534us (18340us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.412821:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7237 00002000:00100000:3.0:1746143841.412830:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880092145180 x1830963625028480/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.412839:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145180 with x1830963625028480 ext(3145728->4194303) 00002000:00010000:3.0:1746143841.412845:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092145180 00000100:00100000:1.0:1746143841.418748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.419003:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.419080:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.419218:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625028608 00000100:00100000:3.0:1746143841.419226:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625028608 00000100:00100000:3.0:1746143841.419266:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625028736 00000100:00100000:3.0:1746143841.419267:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625028736 00000100:00100000:3.0:1746143841.419282:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16611 00000100:00100000:3.0:1746143841.419288:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625028608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.419301:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.419314:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73b551b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411c9d expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.419364:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627484032:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.419423:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.419476:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16612 00000100:00100000:0.0:1746143841.419482:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625028736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143841.419488:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.419494:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5522 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ca4 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.419514:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627484160:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143841.419531:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.419648:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.419693:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625029120 00000100:00100000:2.0:1746143841.419696:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625029120 00000100:00100000:2.0:1746143841.419712:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16613 00000100:00100000:2.0:1746143841.419717:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2791:x1830963625029120:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143841.419722:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.419727:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cab expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.419740:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.419752:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.419757:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.419759:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.419761:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3497984->3633151] (req 3497984->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.419776:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 34 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.419784:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 34 pid: 3134 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.419790:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627484288:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.419826:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.419833:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 15 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.419840:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627484416:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.419852:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.420675:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625028992 00000100:00100000:3.0:1746143841.420680:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625028992 00002000:00100000:3.0:1746143841.420705:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880092ef1500 x1830963625028992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.420713:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1500 with x1830963625028992 ext(4194304->4849663) 00002000:00010000:3.0:1746143841.420717:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1500 00000100:00100000:3.0:1746143841.420730:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7238 00000100:00100000:3.0:1746143841.420734:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625028992:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143841.424375:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627484288:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.424425:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627484416:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.424451:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3497984->3633151] (req 3497984->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.424467:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:2.0:1746143841.424500:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2791:x1830963625029120:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4781us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.424508:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16613 00002000:00010000:0.0:1746143841.424629:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143840 -> 1746143841 00002000:00010000:0.0:1746143841.424633:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143840 -> 1746143841 00002000:00010000:0.0:1746143841.424635:0:1947:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143840 -> 1746143841 00000100:00100000:0.0:1746143841.424650:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627484160:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143841.424671:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5522 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ca4 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.424681:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1600/0x87925e4cb73b5522 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ca4 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.424694:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1600, rc 0) 00000100:00100000:0.0:1746143841.424719:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625028736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5237us (5716us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.424725:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16612 00000100:00100000:0.0:1746143841.425559:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:3.0:1746143841.425646:0:9586:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143838 -> 1746143841 00002000:00010000:3.0:1746143841.425649:0:9586:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143838 -> 1746143841 00002000:00010000:3.0:1746143841.425651:0:9586:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143838 -> 1746143841 00000100:00100000:3.0:1746143841.425659:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627484032:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143841.425675:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73b551b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c9d expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.425684:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73b551b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c9d expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.425703:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:3.0:1746143841.425729:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625028608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6441us (6988us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.425734:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16611 00000100:00100000:3.0:1746143841.425757:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625029248 00000100:00100000:3.0:1746143841.425760:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625029248 00010000:00010000:3.0:1746143841.425777:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 30 pid: 3134 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.425793:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8107 00000100:00100000:3.0:1746143841.425797:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625029248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.425806:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.425813:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 30 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.425821:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 30 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.425838:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b5514 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c8f expref: 30 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.425846:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.425856:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625029248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.425861:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8107 00000100:00100000:2.0:1746143841.428984:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.429052:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625029376 00000100:00100000:1.0:1746143841.429061:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625029376 00010000:00010000:1.0:1746143841.429090:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.429231:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8108 00000100:00100000:1.0:1746143841.429240:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625029376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.429252:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.429268:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.429486:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.429505:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76600/0x87925e4cb73b54b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c5e expref: 16 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.430311:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.430313:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.430321:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.430344:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.430374:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.430386:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627484544:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143841.431126:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.431648:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625028992:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10910us (12565us total) trans 0 rc 655360/655360 00000100:00100000:0.0:1746143841.431658:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7238 00002000:00100000:0.0:1746143841.431666:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880092ef1500 x1830963625028992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 655360/655360 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143841.431675:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1500 with x1830963625028992 ext(4194304->4849663) 00002000:00010000:0.0:1746143841.431679:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1500 00000100:00100000:1.0:1746143841.435966:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627484544:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143841.435985:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.437223:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625029376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7980us (8239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.437234:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8108 00000100:00100000:0.0:1746143841.437676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.438346:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.438367:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625029760 00000100:00100000:2.0:1746143841.438374:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625029760 00000100:00100000:3.0:1746143841.438407:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625029888 00000100:00100000:3.0:1746143841.438411:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625029888 00002000:00100000:3.0:1746143841.438440:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012d843800 x1830963625029888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.438449:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843800 with x1830963625029888 ext(4194304->4853759) 00002000:00010000:3.0:1746143841.438454:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843800 00000100:00100000:3.0:1746143841.438469:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7239 00000100:00100000:3.0:1746143841.438475:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625029888:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143841.438501:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3629056->3633151) req@ffff8800972e8000 x1830963625029760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.438508:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8000 with x1830963625029760 ext(3629056->3633151) 00002000:00010000:2.0:1746143841.438510:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8000 00000100:00100000:2.0:1746143841.438526:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7240 00000100:00100000:2.0:1746143841.438531:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625029760:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143841.438624:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625029760:12345-192.168.202.3@tcp:3:cat.0 Request processed in 92us (949us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143841.438630:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7240 00002000:00100000:2.0:1746143841.438634:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3629056->3633151) req@ffff8800972e8000 x1830963625029760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.438640:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8000 with x1830963625029760 ext(3629056->3633151) 00002000:00010000:2.0:1746143841.438643:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8000 00000100:00100000:2.0:1746143841.442506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.442572:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030016 00000100:00100000:3.0:1746143841.442579:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030016 00000100:00100000:3.0:1746143841.443704:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16614 00000100:00100000:3.0:1746143841.443713:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625030016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.443728:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.443741:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b5530 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cb2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.443781:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627484672:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.443835:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.446508:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625029888:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8025us (8167us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143841.446518:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7239 00002000:00100000:3.0:1746143841.446529:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012d843800 x1830963625029888/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.446538:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843800 with x1830963625029888 ext(4194304->4853759) 00002000:00010000:3.0:1746143841.446543:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d843800 00000100:00100000:0.0:1746143841.446942:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.447061:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627484672:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.447087:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b5530 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cb2 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.447099:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b5530 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cb2 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.447112:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82600, rc 0) 00000100:00100000:2.0:1746143841.447144:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625030016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3432us (4646us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.447149:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16614 00000100:00100000:3.0:1746143841.447261:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030272 00000100:00100000:3.0:1746143841.447266:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030272 00000100:00100000:3.0:1746143841.447597:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5426 00000100:00100000:3.0:1746143841.447604:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+277:2791:x1830963625030272:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143841.448017:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:2791:x1830963625030272:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 413us (1288us total) trans 8589945066 rc 0/0 00000100:00100000:3.0:1746143841.448023:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5426 00000100:00100000:0.0:1746143841.450006:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.450057:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.450354:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030400 00000100:00100000:3.0:1746143841.450361:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030400 00000100:00100000:3.0:1746143841.450400:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030528 00000100:00100000:3.0:1746143841.450402:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030528 00000100:00100000:3.0:1746143841.450426:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16615 00000100:00100000:3.0:1746143841.450433:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625030400:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.450445:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.450459:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73b5537 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cb9 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.450460:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16616 00000100:00100000:2.0:1746143841.450469:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625030528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.450482:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.450489:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73b553e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cc0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.450500:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627484800:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143841.450516:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627484928:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.450559:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.450563:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.452169:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.452223:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030656 00000100:00100000:1.0:1746143841.452229:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030656 00000100:00100000:1.0:1746143841.452263:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16617 00000100:00100000:1.0:1746143841.452269:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625030656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.452277:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.452285:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73b5545 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cc7 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.452316:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627485056:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143841.452386:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.453454:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627484928:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.453482:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73b553e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cc0 expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.453494:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75400/0x87925e4cb73b553e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cc0 expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.453510:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75400, rc 0) 00000100:00100000:2.0:1746143841.453551:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625030528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3083us (3493us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.453558:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16616 00000100:00100000:1.0:1746143841.453879:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627485056:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143841.453895:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73b5545 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cc7 expref: 30 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.453905:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d550600/0x87925e4cb73b5545 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cc7 expref: 30 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.453976:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d550600, rc 0) 00000100:00100000:1.0:1746143841.453996:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625030656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1728us (1831us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143841.454002:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16617 00000100:00100000:3.0:1746143841.456506:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627484800:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143841.456532:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73b5537 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cb9 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.456544:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de82400/0x87925e4cb73b5537 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cb9 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.456554:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82400, rc 0) 00000100:00100000:3.0:1746143841.458659:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625030400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8219us (8651us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.458669:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16615 00000100:00100000:1.0:1746143841.458927:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.458997:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.459157:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030784 00000100:00100000:0.0:1746143841.459164:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030784 00000100:00100000:0.0:1746143841.459197:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625030912 00000100:00100000:0.0:1746143841.459199:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625030912 00000100:00100000:0.0:1746143841.459212:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16618 00000100:00100000:0.0:1746143841.459218:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625030784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143841.459232:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.459243:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b554c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cce expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.459284:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627485184:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143841.459344:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.459428:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16619 00000100:00100000:3.0:1746143841.459435:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625030912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.459441:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.459447:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5553 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cd5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.459469:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627485312:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.459489:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.462220:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627485184:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.462247:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b554c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cce expref: 32 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.462259:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b554c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cce expref: 32 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.462268:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1e00, rc 0) 00000100:00100000:3.0:1746143841.462287:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627485312:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143841.462300:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5553 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cd5 expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143841.462300:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625030784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3082us (3388us total) trans 0 rc 301/301 00010000:00010000:3.0:1746143841.462308:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5553 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cd5 expref: 31 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143841.462308:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16618 00010000:00010000:3.0:1746143841.462315:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa16000, rc 0) 00000100:00100000:3.0:1746143841.462328:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625030912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2895us (3332us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.462343:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16619 00000100:00100000:0.0:1746143841.463317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.463404:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625031168 00000100:00100000:2.0:1746143841.463410:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625031168 00000100:00100000:2.0:1746143841.463528:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5427 00000100:00100000:2.0:1746143841.463534:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2788:x1830963625031168:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143841.463665:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2788:x1830963625031168:12345-192.168.202.3@tcp:35:cat.0 Request processed in 131us (350us total) trans 8589945067 rc 0/0 00000100:00100000:2.0:1746143841.463671:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5427 00000100:00100000:0.0:1746143841.470170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.470411:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625031424 00000100:00100000:1.0:1746143841.470419:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625031424 00000100:00100000:1.0:1746143841.470471:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5428 00000100:00100000:1.0:1746143841.470478:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:2781:x1830963625031424:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143841.470654:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:2781:x1830963625031424:12345-192.168.202.3@tcp:35:cat.0 Request processed in 175us (490us total) trans 8589945068 rc 0/0 00000100:00100000:1.0:1746143841.470660:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5428 00000100:00100000:0.0:1746143841.518232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.519051:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625031680 00000100:00100000:3.0:1746143841.519060:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625031680 00000100:00100000:3.0:1746143841.519119:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14002 00000100:00100000:3.0:1746143841.519128:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2797:x1830963625031680:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143841.519183:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.519200:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b555a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cdc expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.519261:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519271:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519427:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519443:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519449:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519455:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519539:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519549:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143841.519554:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143841.519562:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143841.520269:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520280:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520285:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520290:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520294:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa16000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.520297:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520302:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520312:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143841.520315:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.520317:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520321:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b5561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520361:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520366:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520371:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520374:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9d200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.520377:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520381:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520387:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14000) 00010000:00010000:2.0:1746143841.520389:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.520391:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520395:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b5568 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.520430:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b555a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 29 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.520441:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 28 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.520447:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.520449:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143841.520451:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:2.0:1746143841.521225:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2797:x1830963625031680:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2096us (2997us total) trans 8589945069 rc 0/0 00000100:00100000:2.0:1746143841.521233:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14002 00000100:00100000:0.0:1746143841.587250:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.589138:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625031936 00000100:00100000:2.0:1746143841.589147:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625031936 00000100:00100000:2.0:1746143841.589196:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14003 00000100:00100000:2.0:1746143841.589203:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2802:x1830963625031936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.589224:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.589238:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b557d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ce3 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.589317:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.589329:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143841.589351:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143841.589359:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143841.589434:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b557d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 31 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.589451:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 30 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.589457:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.589459:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143841.589461:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:2.0:1746143841.589504:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2802:x1830963625031936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 302us (2258us total) trans 8589945070 rc 0/0 00000100:00100000:2.0:1746143841.589509:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14003 00000100:00100000:0.0:1746143841.599795:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.600203:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.600952:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625032320 00000100:00100000:3.0:1746143841.600961:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625032320 00000100:00100000:3.0:1746143841.600999:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16620 00000100:00100000:3.0:1746143841.601007:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625032320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.601022:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.601036:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512c00/0x87925e4cb73b5592 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cf1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.601080:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627485440:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.601138:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.601580:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625032192 00000100:00100000:1.0:1746143841.601584:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625032192 00000100:00100000:1.0:1746143841.601821:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14004 00000100:00100000:1.0:1746143841.601827:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+279:2799:x1830963625032192:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143841.601839:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.601850:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73b5599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cea expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.601940:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.601953:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.601959:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.601965:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 29 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.601970:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143841.601988:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 29 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.601996:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 29 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.602003:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627485568:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.602287:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.602295:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 280 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.602306:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627485696:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.602324:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 12 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.602330:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 12 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.602348:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627485824:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143841.602360:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.606730:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627485440:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143841.606760:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512c00/0x87925e4cb73b5592 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf1 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.606772:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512c00/0x87925e4cb73b5592 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf1 expref: 16 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.607476:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512c00, rc 0) 00000100:00100000:3.0:1746143841.607519:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625032320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6512us (7315us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.607526:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16620 00000100:00100000:1.0:1746143841.607905:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627485568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.607993:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.608005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.608222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.608272:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627485696:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143841.608279:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627485824:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.608295:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143841.608458:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625032448 00000100:00100000:0.0:1746143841.608464:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625032448 00010000:00010000:0.0:1746143841.608487:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 30 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.608512:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625032576 00000100:00100000:0.0:1746143841.608514:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625032576 00010000:00010000:0.0:1746143841.608523:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 281 pid: 6587 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.608534:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625032704 00000100:00100000:0.0:1746143841.608536:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625032704 00010000:00010000:0.0:1746143841.608542:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 13 pid: 14991 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.608554:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8109 00000100:00100000:0.0:1746143841.608559:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2011:x1830963625032448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.608568:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.608572:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 30 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608580:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 30 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608595:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512400/0x87925e4cb73b556f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cdc expref: 30 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608612:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.608616:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608623:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608627:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.608649:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2011:x1830963625032448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.608654:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8109 00000100:00100000:0.0:1746143841.608664:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8110 00000100:00100000:0.0:1746143841.608669:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+281:2008:x1830963625032576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.608674:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.608678:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 281 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608684:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 281 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608695:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b54ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c96 expref: 281 pid: 6587 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608702:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.608705:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608709:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608713:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.608725:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+280:2008:x1830963625032576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.608730:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8110 00000100:00100000:0.0:1746143841.608738:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8111 00000100:00100000:0.0:1746143841.608742:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625032704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.608747:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.608750:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 13 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608757:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 13 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608765:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fc00/0x87925e4cb73b54ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c50 expref: 13 pid: 14991 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.608772:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.608775:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608780:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608786:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143841.608804:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143841.609044:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.609050:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143841.609066:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143841.609163:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d550000/0x87925e4cb73b5599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 281 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.609191:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.609196:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.609198:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143841.609200:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:2.0:1746143841.609222:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+280:2799:x1830963625032192:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7395us (9434us total) trans 8589945071 rc 0/0 00000100:00100000:2.0:1746143841.609227:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14004 00000100:00100000:0.0:1746143841.610166:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625032704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1419us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.610174:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8111 00000100:00100000:0.0:1746143841.624974:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.625013:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.625151:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625032960 00000100:00100000:3.0:1746143841.625159:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625032960 00002000:00100000:3.0:1746143841.625192:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1802239) req@ffff88009391f100 x1830963625032960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.625201:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f100 with x1830963625032960 ext(1048576->1802239) 00002000:00010000:3.0:1746143841.625205:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f100 00000100:00100000:3.0:1746143841.625792:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033088 00000100:00100000:3.0:1746143841.625795:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033088 00000100:00100000:1.0:1746143841.625799:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7241 00002000:00100000:3.0:1746143841.625807:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1753088->2097151) req@ffff88009391c000 x1830963625033088/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143841.625809:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625032960:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143841.625814:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963625033088 ext(1753088->2097151) 00002000:00010000:3.0:1746143841.625817:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391c000 00000100:00100000:3.0:1746143841.626544:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7242 00000100:00100000:3.0:1746143841.626563:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625033088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143841.642221:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625032960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16406us (17245us total) trans 0 rc 753664/753664 00000100:00100000:1.0:1746143841.642231:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7241 00002000:00100000:1.0:1746143841.642241:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1802239) req@ffff88009391f100 x1830963625032960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 753664/753664 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.642250:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f100 with x1830963625032960 ext(1048576->1802239) 00002000:00010000:1.0:1746143841.642256:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f100 00000100:00100000:3.0:1746143841.642606:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625033088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16052us (17590us total) trans 0 rc 344064/344064 00000100:00100000:3.0:1746143841.642613:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7242 00002000:00100000:3.0:1746143841.642618:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1753088->2097151) req@ffff88009391c000 x1830963625033088/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 344064/344064 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.642625:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963625033088 ext(1753088->2097151) 00002000:00010000:3.0:1746143841.642628:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391c000 00000100:00100000:3.0:1746143841.649477:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.649506:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033344 00000100:00100000:3.0:1746143841.649514:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033344 00000100:00100000:3.0:1746143841.649553:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16621 00000100:00100000:3.0:1746143841.649561:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2797:x1830963625033344:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143841.649577:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.649593:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cf8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.649620:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.649628:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.649634:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 38 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.649639:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.649641:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.649644:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1138688->1949695] (req 1138688->1949695) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.649674:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 38 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.649687:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 38 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.649697:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627485952:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.652385:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.652536:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 9 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.652548:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627486080:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.652677:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 19 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.652685:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 19 pid: 9586 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.652691:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627486208:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.652706:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.652778:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.653017:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033472 00000100:00100000:2.0:1746143841.653023:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033472 00000100:00100000:2.0:1746143841.653065:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16622 00000100:00100000:2.0:1746143841.653072:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2802:x1830963625033472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.653083:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.653094:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411cff expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.653112:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.653118:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.653119:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.653122:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.653137:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.653144:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 28 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:2.0:1746143841.653151:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627486336:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.653191:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.654694:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627485952:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.654704:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627486080:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.655943:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.655967:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.656000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.656026:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033600 00000100:00100000:0.0:1746143841.656031:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033600 00010000:00010000:0.0:1746143841.656054:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 10 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.656079:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033728 00000100:00100000:0.0:1746143841.656081:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033728 00010000:00010000:0.0:1746143841.656091:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 39 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.656096:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627486208:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.656103:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033856 00000100:00100000:0.0:1746143841.656104:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033856 00010000:00010000:0.0:1746143841.656113:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 20 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.656118:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [1138688->1949695] (req 1138688->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.656124:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8112 00000100:00100000:0.0:1746143841.656129:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625033600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.656130:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84e00, rc 0) 00010000:00010000:0.0:1746143841.656137:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.656153:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 10 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.656162:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2797:x1830963625033344:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6602us (6694us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143841.656166:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 10 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.656168:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16621 00010000:00010000:0.0:1746143841.656182:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380e00/0x87925e4cb73b538c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411bc4 expref: 10 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:3.0:1746143841.656193:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8113 00010000:00010000:0.0:1746143841.656194:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.656198:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625033728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.656206:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143841.656210:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625033600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143841.656214:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 39 pid: 3134 timeout: 1000 lvb_type: 1 00000100:00100000:0.0:1746143841.656215:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8112 00010000:00010000:3.0:1746143841.656222:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 39 pid: 3134 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.656232:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97e00/0x87925e4cb73b5346 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b9a expref: 39 pid: 3134 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.656244:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.656248:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8114 00000100:00100000:0.0:1746143841.656253:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625033856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143841.656258:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625033728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (290us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143841.656259:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143841.656263:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8113 00010000:00010000:0.0:1746143841.656266:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 19 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.656274:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 19 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.656284:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96800/0x87925e4cb73b532a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411b85 expref: 19 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:0.0:1746143841.656292:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.656293:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.656298:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.656306:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.656328:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.656349:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627486464:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143841.656397:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.657438:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.657459:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627486336:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.657475:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.657484:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74600, rc 0) 00000100:00100000:2.0:1746143841.657503:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2802:x1830963625033472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4432us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.657509:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16622 00000100:00100000:1.0:1746143841.657579:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627486464:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143841.657589:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.657604:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625033984 00000100:00100000:3.0:1746143841.657607:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625033984 00000100:00100000:1.0:1746143841.657617:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625033856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1364us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.657623:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8114 00002000:00100000:3.0:1746143841.657626:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3497984->3633151) req@ffff88009391dc00 x1830963625033984/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.657632:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963625033984 ext(3497984->3633151) 00010000:00010000:3.0:1746143841.657636:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 29 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.657642:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 29 pid: 13436 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.657646:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391dc00 00000100:00100000:3.0:1746143841.657655:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2674 00000100:00100000:3.0:1746143841.657658:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625033984:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143841.658284:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.658806:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625034240 00000100:00100000:1.0:1746143841.658810:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625034240 00002000:00100000:1.0:1746143841.658832:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1142783) req@ffff88009391ed80 x1830963625034240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.658838:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ed80 with x1830963625034240 ext(1138688->1142783) 00002000:00010000:1.0:1746143841.658842:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391ed80 00000100:00100000:1.0:1746143841.658870:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7243 00000100:00100000:1.0:1746143841.658876:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625034240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143841.658986:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625034240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 110us (701us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143841.658992:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7243 00002000:00100000:1.0:1746143841.658997:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1142783) req@ffff88009391ed80 x1830963625034240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.659005:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ed80 with x1830963625034240 ext(1138688->1142783) 00002000:00010000:1.0:1746143841.659007:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391ed80 00000100:00100000:3.0:1746143841.660292:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625033984:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2629us (2853us total) trans 21474841238 rc 0/0 00000100:00100000:3.0:1746143841.660300:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2674 00002000:00100000:3.0:1746143841.660306:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3497984->3633151) req@ffff88009391dc00 x1830963625033984/t21474841238(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.660313:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963625033984 ext(3497984->3633151) 00010000:00010000:3.0:1746143841.660320:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 31 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.660343:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 31 pid: 13436 timeout: 1000 lvb_type: 0 00002000:00010000:3.0:1746143841.660354:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391dc00 00000100:00100000:0.0:1746143841.664822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.664934:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625034368 00000100:00100000:1.0:1746143841.664941:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625034368 00010000:00010000:1.0:1746143841.664971:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 31 pid: 13436 timeout: 1000 lvb_type: 0 00000100:00100000:0.0:1746143841.666094:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.666130:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625034624 00000100:00100000:3.0:1746143841.666135:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625034624 00002000:00100000:3.0:1746143841.666162:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1945600->1949695) req@ffff8800972e9f80 x1830963625034624/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.666170:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9f80 with x1830963625034624 ext(1945600->1949695) 00002000:00010000:3.0:1746143841.666174:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9f80 00000100:00100000:3.0:1746143841.666202:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7244 00000100:00100000:3.0:1746143841.666209:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625034624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143841.666317:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625034624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 108us (223us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143841.666323:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7244 00002000:00100000:3.0:1746143841.666327:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1945600->1949695) req@ffff8800972e9f80 x1830963625034624/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.666346:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9f80 with x1830963625034624 ext(1945600->1949695) 00002000:00010000:3.0:1746143841.666349:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9f80 00000100:00100000:1.0:1746143841.666364:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8115 00000100:00100000:1.0:1746143841.666371:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625034368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.666383:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.666397:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 31 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.666407:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 31 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.666423:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b5529 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->3633151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cab expref: 31 pid: 13436 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.666438:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.666440:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.666445:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.666452:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.666478:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.666486:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627486592:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143841.666523:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.668113:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627486592:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143841.668127:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.668152:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625034368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1781us (3335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.668159:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8115 00000100:00100000:0.0:1746143841.670080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.670152:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625034880 00000100:00100000:2.0:1746143841.670159:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625034880 00000100:00100000:2.0:1746143841.670200:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5429 00000100:00100000:2.0:1746143841.670206:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2797:x1830963625034880:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143841.670397:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2797:x1830963625034880:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 190us (321us total) trans 8589945072 rc 0/0 00000100:00100000:2.0:1746143841.670402:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5429 00000100:00100000:0.0:1746143841.672766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.673661:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625035136 00000100:00100000:2.0:1746143841.673670:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625035136 00002000:00100000:2.0:1746143841.673703:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88011e309500 x1830963625035136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.673712:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309500 with x1830963625035136 ext(2097152->4194303) 00002000:00010000:2.0:1746143841.673716:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e309500 00000100:00100000:2.0:1746143841.673747:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7245 00000100:00100000:2.0:1746143841.673754:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625035136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143841.688245:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625035136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14483us (15473us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143841.688255:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7245 00002000:00100000:2.0:1746143841.688626:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88011e309500 x1830963625035136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.688635:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309500 with x1830963625035136 ext(2097152->4194303) 00002000:00010000:2.0:1746143841.688639:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e309500 00000100:00100000:0.0:1746143841.698741:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.699054:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625035392 00000100:00100000:2.0:1746143841.699063:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625035392 00000100:00100000:2.0:1746143841.699117:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14005 00000100:00100000:2.0:1746143841.699124:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+280:2806:x1830963625035392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.699146:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.699160:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b55bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d06 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.699211:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699219:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699227:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699236:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699238:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699241:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699304:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b55d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699310:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b55d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699313:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b55d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143841.699318:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143841.699387:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699392:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699396:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699400:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699405:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.699409:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699414:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699423:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143841.699425:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.699428:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699432:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74400/0x87925e4cb73b55c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699456:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699461:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699465:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699469:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143841.699471:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699474:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699479:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f083d00) 00010000:00010000:2.0:1746143841.699481:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143841.699483:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699490:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b55ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.699520:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b55bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d06 expref: 283 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.699530:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b55d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d06 expref: 282 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.699536:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.699538:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143841.699539:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:2.0:1746143841.699584:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+282:2806:x1830963625035392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 460us (850us total) trans 8589945073 rc 0/0 00000100:00100000:2.0:1746143841.699590:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14005 00000100:00100000:0.0:1746143841.701621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.701848:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.701879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.701948:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.701978:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625035904 00000100:00100000:0.0:1746143841.701984:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625035904 00000100:00100000:3.0:1746143841.702000:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625035520 00000100:00100000:3.0:1746143841.702005:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625035520 00000100:00100000:3.0:1746143841.702255:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625035648 00000100:00100000:3.0:1746143841.702258:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625035648 00000100:00100000:0.0:1746143841.702302:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 998 00000100:00100000:0.0:1746143841.702309:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:2010:x1830963625035904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.702320:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.702349:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b55d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d06 expref: 282 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.702367:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143841.702371:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143841.702398:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:2010:x1830963625035904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.702404:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 998 00000100:00100000:0.0:1746143841.702444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.703597:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036032 00000100:00100000:3.0:1746143841.703603:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036032 00000100:00100000:3.0:1746143841.703623:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16623 00000100:00100000:3.0:1746143841.703631:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625035520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.703647:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.703659:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521000/0x87925e4cb73b55df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d0d expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.703696:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627486720:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.703743:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.703762:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16624 00000100:00100000:3.0:1746143841.703767:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625035648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.703788:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.703794:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b55e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d14 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.703813:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627486848:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.703830:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.703854:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625035776 00000100:00100000:1.0:1746143841.703859:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625035776 00000100:00100000:3.0:1746143841.703867:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16625 00000100:00100000:3.0:1746143841.703872:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625036032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.703877:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143841.703877:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16626 00010000:00010000:3.0:1746143841.703883:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d22 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.703884:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625035776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.703892:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.703893:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.703894:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.703901:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.703902:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b55f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d1b expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.703931:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.703943:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85e00, rc 0) 00000100:00100000:0.0:1746143841.703947:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627486976:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143841.703960:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625036032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 88us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.703965:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16625 00000100:00100000:0.0:1746143841.703976:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00002000:00010000:1.0:1746143841.708770:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143841 -> 1746143842 00002000:00010000:1.0:1746143841.708776:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143841 -> 1746143842 00002000:00010000:1.0:1746143841.708778:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143841 -> 1746143842 00000100:00100000:1.0:1746143841.708795:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094194e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627486976:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143841.708822:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b55f4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d1b expref: 39 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.708834:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b55f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d1b expref: 39 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.708856:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634800, rc 0) 00000100:00100000:1.0:1746143841.708889:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625035776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5006us (7010us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143841.708897:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16626 00002000:00010000:2.0:1746143841.708988:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143841 -> 1746143842 00002000:00010000:2.0:1746143841.708991:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143841 -> 1746143842 00002000:00010000:2.0:1746143841.708992:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143841 -> 1746143842 00000100:00100000:2.0:1746143841.709001:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627486720:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.709016:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521000/0x87925e4cb73b55df lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d0d expref: 34 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.709025:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521000/0x87925e4cb73b55df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d0d expref: 34 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.709032:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521000, rc 0) 00000100:00100000:2.0:1746143841.709048:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625035520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5420us (7434us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.709054:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16623 00002000:00010000:3.0:1746143841.709352:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143841 -> 1746143842 00002000:00010000:3.0:1746143841.709356:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143841 -> 1746143842 00002000:00010000:3.0:1746143841.709358:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143841 -> 1746143842 00000100:00100000:3.0:1746143841.709366:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627486848:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143841.709379:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b55e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d14 expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.709388:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521c00/0x87925e4cb73b55e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d14 expref: 32 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.709410:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521c00, rc 0) 00000100:00100000:3.0:1746143841.709439:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625035648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5672us (7592us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.709445:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16624 00000100:00100000:0.0:1746143841.717992:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.718609:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036160 00000100:00100000:3.0:1746143841.718617:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036160 00000100:00100000:3.0:1746143841.718664:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16627 00000100:00100000:3.0:1746143841.718671:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2806:x1830963625036160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.718686:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.718699:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d29 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.718723:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.718729:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143841.718731:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143841.718734:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.718759:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 15 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.718769:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 15 pid: 9586 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.718779:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627487104:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.719742:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.724544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.724646:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627487104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.724670:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.724685:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84800, rc 0) 00000100:00100000:3.0:1746143841.724732:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2806:x1830963625036160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6061us (6746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.724739:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16627 00000100:00100000:2.0:1746143841.724997:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036288 00000100:00100000:2.0:1746143841.725003:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036288 00002000:00100000:2.0:1746143841.725038:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1802240->2097151) req@ffff880094194700 x1830963625036288/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.725046:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194700 with x1830963625036288 ext(1802240->2097151) 00010000:00010000:2.0:1746143841.725052:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 16 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.725062:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 16 pid: 9586 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143841.725069:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094194700 00000100:00100000:2.0:1746143841.725096:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2675 00000100:00100000:2.0:1746143841.725102:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625036288:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143841.731990:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625036288:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6879us (7443us total) trans 21474841239 rc 0/0 00000100:00100000:2.0:1746143841.732003:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2675 00002000:00100000:2.0:1746143841.732014:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1802240->2097151) req@ffff880094194700 x1830963625036288/t21474841239(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.732023:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194700 with x1830963625036288 ext(1802240->2097151) 00010000:00010000:2.0:1746143841.732032:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.732052:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143841.732059:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094194700 00000100:00100000:0.0:1746143841.738687:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.739008:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036416 00000100:00100000:3.0:1746143841.739016:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036416 00010000:00010000:3.0:1746143841.739049:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.739086:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8116 00000100:00100000:3.0:1746143841.739093:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625036416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.739104:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.739122:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.739133:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.739153:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b54c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1802240->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c65 expref: 18 pid: 9586 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.739182:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.739184:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143841.739189:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.739195:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.739222:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.739233:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627487232:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143841.739304:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.744509:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627487232:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143841.744529:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.744583:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625036416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5490us (5902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.744594:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8116 00000100:00100000:0.0:1746143841.746589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.746675:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036672 00000100:00100000:2.0:1746143841.746682:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036672 00002000:00100000:2.0:1746143841.746719:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094195880 x1830963625036672/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.746729:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963625036672 ext(1048576->2097151) 00002000:00010000:2.0:1746143841.746734:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094195880 00000100:00100000:2.0:1746143841.748485:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7246 00000100:00100000:2.0:1746143841.748498:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625036672:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143841.759278:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625036672:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10776us (12686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.759289:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7246 00002000:00100000:2.0:1746143841.759299:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094195880 x1830963625036672/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.759308:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195880 with x1830963625036672 ext(1048576->2097151) 00002000:00010000:2.0:1746143841.759313:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094195880 00000100:00100000:0.0:1746143841.765038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.767358:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036800 00000100:00100000:3.0:1746143841.767371:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036800 00000100:00100000:3.0:1746143841.767432:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16628 00000100:00100000:3.0:1746143841.767440:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2806:x1830963625036800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143841.767458:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.767478:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d30 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.767512:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.767519:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143841.767520:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143841.767523:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.767554:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 16 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.767566:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 16 pid: 3134 timeout: 1000 lvb_type: 0 00000100:00100000:3.0:1746143841.767583:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627487360:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.767674:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.767801:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.767819:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625036928 00000100:00100000:1.0:1746143841.767822:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625036928 00000100:00100000:1.0:1746143841.767844:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16629 00000100:00100000:1.0:1746143841.767848:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2799:x1830963625036928:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143841.767855:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.767861:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d37 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.767876:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.767885:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.767890:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.767894:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.767897:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3420160->4194303] (req 3420160->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.767928:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.767935:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 35 pid: 9586 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143841.767942:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627487488:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.767981:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.767988:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 16 pid: 1947 timeout: 1000 lvb_type: 0 00000100:00100000:1.0:1746143841.768000:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627487616:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143841.768016:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.769963:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627487360:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.769987:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.770005:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:3.0:1746143841.770043:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2806:x1830963625036800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2603us (5017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.770050:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16628 00000100:00100000:1.0:1746143841.770125:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627487488:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143841.770133:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627487616:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.770149:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3420160->4194303] (req 3420160->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 34 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.770157:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087c00, rc 0) 00000100:00100000:1.0:1746143841.770174:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2799:x1830963625036928:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2325us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.770179:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16629 00000100:00100000:0.0:1746143841.772405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.772444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.772487:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.772496:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625037184 00000100:00100000:2.0:1746143841.772506:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625037184 00002000:00100000:2.0:1746143841.772549:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1753087) req@ffff880094197800 x1830963625037184/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.772563:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963625037184 ext(1048576->1753087) 00010000:00010000:2.0:1746143841.772571:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 17 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:2.0:1746143841.772583:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 17 pid: 3134 timeout: 1000 lvb_type: 0 00002000:00010000:2.0:1746143841.772589:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094197800 00000100:00100000:2.0:1746143841.772615:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2676 00000100:00100000:2.0:1746143841.772622:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625037184:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143841.772632:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625037056 00000100:00100000:3.0:1746143841.772637:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625037312 00000100:00100000:1.0:1746143841.772639:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625037056 00000100:00100000:3.0:1746143841.772642:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625037312 00010000:00010000:3.0:1746143841.772668:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 18 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.772668:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 34 pid: 9586 timeout: 1000 lvb_type: 1 00000100:00100000:1.0:1746143841.772690:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8117 00000100:00100000:1.0:1746143841.772697:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625037056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143841.772706:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8118 00010000:00010000:1.0:1746143841.772708:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143841.772712:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625037312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.772719:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.772726:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 34 pid: 9586 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.772728:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 19 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.772737:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 34 pid: 9586 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.772751:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 19 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.772780:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b55ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d22 expref: 34 pid: 9586 timeout: 1000 lvb_type: 1 00010000:00010000:3.0:1746143841.772785:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74600/0x87925e4cb73b55b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cff expref: 19 pid: 1947 timeout: 1000 lvb_type: 0 00010000:00010000:1.0:1746143841.772800:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.772802:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.772810:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.772817:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.772825:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143841.772850:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143841.772854:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625037312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 141us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.772860:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8118 00000100:00100000:1.0:1746143841.772861:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627487744:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143841.772956:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.781561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.781712:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627487744:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143841.781719:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625037568 00000100:00100000:3.0:1746143841.781727:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625037568 00010000:00010000:1.0:1746143841.781732:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746143841.781770:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3420160->3424255) req@ffff880136ac9f80 x1830963625037568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746143841.781778:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625037056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9080us (9332us total) trans 0 rc 0/0 00002000:00100000:3.0:1746143841.781779:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9f80 with x1830963625037568 ext(3420160->3424255) 00002000:00010000:3.0:1746143841.781783:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9f80 00000100:00100000:1.0:1746143841.781789:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8117 00000100:00100000:3.0:1746143841.781802:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7247 00000100:00100000:3.0:1746143841.781808:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625037568:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143841.782643:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625037568:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 833us (1091us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143841.782650:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7247 00002000:00100000:3.0:1746143841.782656:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3420160->3424255) req@ffff880136ac9f80 x1830963625037568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.782662:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9f80 with x1830963625037568 ext(3420160->3424255) 00002000:00010000:3.0:1746143841.782664:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9f80 00000100:00100000:3.0:1746143841.786548:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625037184:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13916us (14141us total) trans 21474841240 rc 0/0 00000100:00100000:3.0:1746143841.786561:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2676 00002000:00100000:3.0:1746143841.786571:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1753087) req@ffff880094197800 x1830963625037184/t21474841240(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.786580:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963625037184 ext(1048576->1753087) 00010000:00010000:3.0:1746143841.786589:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 1000 lvb_type: 0 00010000:00010000:3.0:1746143841.786603:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143841.786610:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094197800 00000100:00100000:0.0:1746143841.792718:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.792851:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625037696 00000100:00100000:1.0:1746143841.792858:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625037696 00010000:00010000:1.0:1746143841.792888:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143841.792941:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8119 00000100:00100000:1.0:1746143841.792948:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625037696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143841.792961:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143841.792976:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143841.792988:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143841.793009:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091380000/0x87925e4cb73b54e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1753087) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c81 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143841.793044:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.793046:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.793052:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.793059:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.793088:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.793099:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627487872:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143841.793170:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143841.797730:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627487872:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143841.797748:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143841.797795:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625037696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4846us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.797804:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8119 00000100:00100000:0.0:1746143841.802457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.802589:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625037952 00000100:00100000:3.0:1746143841.802600:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625037952 00002000:00100000:3.0:1746143841.802645:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094196300 x1830963625037952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.802654:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963625037952 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.802659:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196300 00000100:00100000:3.0:1746143841.803899:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7248 00000100:00100000:3.0:1746143841.803923:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625037952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143841.804173:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.805414:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038080 00000100:00100000:1.0:1746143841.805426:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038080 00000100:00100000:1.0:1746143841.805556:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16630 00000100:00100000:1.0:1746143841.805565:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+38:2799:x1830963625038080:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143841.805582:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.805599:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d3e expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.805627:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.805634:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.805641:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.805643:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.805645:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4390911] (req 4194304->4390911) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 39 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.805675:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 17 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.805686:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 17 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143841.805700:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627488000:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.806267:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 39 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.806276:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 39 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143841.806284:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627488128:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143841.806446:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.813676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.813752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.813778:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038208 00000100:00100000:0.0:1746143841.813786:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038208 00010000:00010000:0.0:1746143841.813821:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143841.813857:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038336 00000100:00100000:0.0:1746143841.813859:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038336 00010000:00010000:0.0:1746143841.813868:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 40 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143841.813882:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8120 00000100:00100000:0.0:1746143841.813888:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625038208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.813901:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143841.813947:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143841.813957:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.813969:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8121 00000100:00100000:2.0:1746143841.813980:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963625038336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143841.813983:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143841.813987:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.813997:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 40 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.814006:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 40 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.814018:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.814020:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143841.814025:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625038208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 136us (360us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143841.814027:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.814032:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8120 00010000:00010000:2.0:1746143841.814040:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.814072:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.814083:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627488256:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143841.814143:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143841.814226:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c4abc00/0x87925e4cb73b550d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c88 expref: 18 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143841.814242:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627488000:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.814251:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091381000/0x87925e4cb73b54b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c57 expref: 40 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143841.814260:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627488128:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.814289:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 39 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.814297:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106600, rc 0) 00000100:00100000:1.0:1746143841.814323:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2799:x1830963625038080:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8760us (10154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.814340:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16630 00000100:00100000:3.0:1746143841.814489:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625037952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10582us (12044us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.814498:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7248 00002000:00100000:3.0:1746143841.814506:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094196300 x1830963625037952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.814521:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963625037952 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.814525:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196300 00000100:00100000:2.0:1746143841.815737:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627488256:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.815750:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.815786:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625038336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1809us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.815793:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8121 00000100:00100000:0.0:1746143841.818622:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.819119:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.819222:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038464 00000100:00100000:1.0:1746143841.819232:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038464 00000100:00100000:1.0:1746143841.819284:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16631 00000100:00100000:1.0:1746143841.819291:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+38:2806:x1830963625038464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.819309:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.819325:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d45 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.819372:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.819380:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143841.819381:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143841.819384:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 39 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.819412:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 16 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.819422:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 16 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143841.819432:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627488384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143841.819501:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.820287:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038720 00000100:00100000:3.0:1746143841.820293:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038720 00002000:00100000:3.0:1746143841.820323:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4386816->4390911) req@ffff880095c6a300 x1830963625038720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.820342:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963625038720 ext(4386816->4390911) 00002000:00010000:3.0:1746143841.820346:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6a300 00000100:00100000:3.0:1746143841.820367:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7249 00000100:00100000:3.0:1746143841.820373:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625038720:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143841.820492:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625038720:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 118us (1373us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143841.820499:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7249 00002000:00100000:3.0:1746143841.820505:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4386816->4390911) req@ffff880095c6a300 x1830963625038720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/4536 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.820511:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963625038720 ext(4386816->4390911) 00002000:00010000:3.0:1746143841.820514:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c6a300 00000100:00100000:1.0:1746143841.820951:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627488384:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143841.820975:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 39 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.820989:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107600, rc 0) 00000100:00100000:1.0:1746143841.821010:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2806:x1830963625038464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1720us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.821016:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16631 00000100:00100000:0.0:1746143841.824864:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.825034:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038848 00000100:00100000:2.0:1746143841.825044:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038848 00002000:00100000:2.0:1746143841.825092:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1949695) req@ffff880095c68a80 x1830963625038848/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.825102:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68a80 with x1830963625038848 ext(1138688->1949695) 00010000:00010000:2.0:1746143841.825111:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 17 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.825127:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 17 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143841.825133:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c68a80 00000100:00100000:2.0:1746143841.825170:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2677 00000100:00100000:2.0:1746143841.825181:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625038848:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143841.840253:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625038848:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15063us (15387us total) trans 17179873970 rc 0/0 00000100:00100000:2.0:1746143841.840267:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2677 00002000:00100000:2.0:1746143841.840282:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1949695) req@ffff880095c68a80 x1830963625038848/t17179873970(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.840291:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68a80 with x1830963625038848 ext(1138688->1949695) 00010000:00010000:2.0:1746143841.840302:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.840319:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143841.840326:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c68a80 00000100:00100000:0.0:1746143841.846599:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.846789:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625038976 00000100:00100000:2.0:1746143841.846796:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625038976 00010000:00010000:2.0:1746143841.846829:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.847421:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8122 00000100:00100000:2.0:1746143841.847428:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625038976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.847441:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.847459:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.847476:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.847495:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b55ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1949695) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cf8 expref: 19 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.847839:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.847841:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.847847:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 38 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.847856:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 38 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.847886:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 38 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.847895:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627488512:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143841.847980:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.852688:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627488512:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143841.852707:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.852753:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625038976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5325us (6161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.852764:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8122 00000100:00100000:0.0:1746143841.853715:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.853794:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625039232 00000100:00100000:2.0:1746143841.853800:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625039232 00002000:00100000:2.0:1746143841.853829:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c69c00 x1830963625039232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.853837:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963625039232 ext(1048576->2097151) 00002000:00010000:2.0:1746143841.853841:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69c00 00000100:00100000:2.0:1746143841.853870:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7250 00000100:00100000:2.0:1746143841.853877:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625039232:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143841.863149:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625039232:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9265us (9428us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.863158:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7250 00002000:00100000:2.0:1746143841.863167:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c69c00 x1830963625039232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.863175:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963625039232 ext(1048576->2097151) 00002000:00010000:2.0:1746143841.863180:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69c00 00000100:00100000:0.0:1746143841.877736:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.877828:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.877961:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625039360 00000100:00100000:2.0:1746143841.877968:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625039360 00000100:00100000:3.0:1746143841.878744:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625039616 00000100:00100000:3.0:1746143841.878749:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625039616 00002000:00100000:3.0:1746143841.878779:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880095c69500 x1830963625039616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.878788:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69500 with x1830963625039616 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.878794:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69500 00000100:00100000:3.0:1746143841.878811:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7251 00000100:00100000:3.0:1746143841.878818:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625039616:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143841.879777:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14006 00000100:00100000:2.0:1746143841.879786:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2809:x1830963625039360:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.879800:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.879814:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b561e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d4c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.879855:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879865:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879876:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879887:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879893:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879898:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879965:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.879975:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.879981:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.880005:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 280 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.880014:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 280 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.880024:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627488640:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.880110:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.883889:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.883989:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625039872 00000100:00100000:1.0:1746143841.883997:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625039872 00000100:00100000:1.0:1746143841.884045:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5430 00000100:00100000:1.0:1746143841.884051:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:16365:x1830963625039872:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143841.884219:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:16365:x1830963625039872:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 167us (336us total) trans 8589945074 rc 0/0 00000100:00100000:1.0:1746143841.884226:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5430 00000100:00100000:2.0:1746143841.884456:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627488640:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.884477:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143841.886486:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625039616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7401us (8390us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.886495:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7251 00002000:00100000:3.0:1746143841.886504:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880095c69500 x1830963625039616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.886512:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69500 with x1830963625039616 ext(2097152->3145727) 00002000:00010000:3.0:1746143841.886517:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69500 00000100:00100000:0.0:1746143841.886713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.886838:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040000 00000100:00100000:2.0:1746143841.886843:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040000 00010000:00010000:2.0:1746143841.886866:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 282 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.886898:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8123 00000100:00100000:2.0:1746143841.886904:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:2010:x1830963625040000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.889019:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.889037:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 282 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.889050:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 282 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.889071:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551800/0x87925e4cb73b55a0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411cea expref: 282 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.889101:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.889105:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.889113:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.889118:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.889377:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.889421:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:2010:x1830963625040000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2516us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.889431:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8123 00010000:00010000:3.0:1746143841.889832:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889839:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143841.889883:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143841.889887:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143841.889901:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889909:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889951:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889956:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889962:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889968:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889973:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.889976:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889981:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889989:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143841.889992:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143841.889994:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.889998:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890018:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890023:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890027:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890032:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.890034:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890037:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890047:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008219ea00) 00010000:00010000:3.0:1746143841.890049:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143841.890051:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890055:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b562c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.890082:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b561e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.890091:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.890097:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.890099:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143841.890101:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:3.0:1746143841.890137:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2809:x1830963625039360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 10353us (12407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.890143:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14006 00000100:00100000:0.0:1746143841.897445:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.897530:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040128 00000100:00100000:1.0:1746143841.897538:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040128 00000100:00100000:1.0:1746143841.897588:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16632 00000100:00100000:1.0:1746143841.897595:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+39:2806:x1830963625040128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.897611:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.897623:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d53 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.897650:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.897652:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.897659:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.898043:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.898052:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189cc00, rc 0) 00000100:00100000:1.0:1746143841.898097:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2806:x1830963625040128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 502us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.898103:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16632 00000100:00100000:0.0:1746143841.900646:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.900690:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.900714:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.901481:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.901516:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040256 00000100:00100000:1.0:1746143841.901524:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040256 00000100:00100000:2.0:1746143841.901537:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040384 00000100:00100000:2.0:1746143841.901540:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040384 00000100:00100000:2.0:1746143841.901572:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040512 00000100:00100000:2.0:1746143841.901574:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040512 00000100:00100000:2.0:1746143841.901584:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040640 00000100:00100000:2.0:1746143841.901585:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040640 00000100:00100000:2.0:1746143841.901603:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16633 00000100:00100000:2.0:1746143841.901609:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625040384:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1746143841.901611:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16634 00000100:00100000:1.0:1746143841.901615:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625040512:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.901622:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.901622:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.901635:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d61 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.901635:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d68 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.901652:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.901652:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.901653:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.901653:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143841.901659:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16635 00010000:00010000:2.0:1746143841.901659:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.901659:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143841.901666:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625040640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.901672:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.901672:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.901673:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.901680:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b564f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d6f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.901680:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d800, rc 0) 00010000:00010000:1.0:1746143841.901680:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00010000:00010000:3.0:1746143841.901697:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b564f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d6f expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143841.901709:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b564f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d6f expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143841.901716:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625040384:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 107us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.901721:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16633 00010000:00010000:3.0:1746143841.901722:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85000, rc 0) 00000100:00100000:0.0:1746143841.901937:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.902052:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625040768 00000100:00100000:2.0:1746143841.902054:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625040768 00000100:00100000:2.0:1746143841.902068:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16636 00000100:00100000:2.0:1746143841.902073:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625040256:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.902079:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.902084:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d5a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.902093:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.902094:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.902098:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.902105:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.902111:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:1.0:1746143841.902780:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625040512:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1162us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.902787:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16634 00000100:00100000:1.0:1746143841.902801:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16637 00000100:00100000:1.0:1746143841.902806:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625040768:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143841.902807:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625040256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 733us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.902811:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16636 00010000:00010000:1.0:1746143841.902813:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.902820:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b565d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d76 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.902852:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627488768:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143841.902894:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.903170:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625040640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1503us (1688us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.903175:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16635 00000100:00100000:0.0:1746143841.904370:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.904402:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.904416:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625041024 00000100:00100000:3.0:1746143841.904421:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625041024 00000100:00100000:0.0:1746143841.904423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143841.904462:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625041280 00000100:00100000:1.0:1746143841.904469:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625041280 00002000:00100000:1.0:1746143841.904494:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012e358a80 x1830963625041280/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.904502:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963625041280 ext(3145728->4194303) 00002000:00010000:1.0:1746143841.904506:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358a80 00000100:00100000:1.0:1746143841.904519:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625041536 00000100:00100000:1.0:1746143841.904521:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625041536 00002000:00100000:1.0:1746143841.904640:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3420159) req@ffff88012e35b480 x1830963625041536/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143841.904646:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b480 with x1830963625041536 ext(3145728->3420159) 00002000:00010000:1.0:1746143841.904649:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35b480 00000100:00100000:1.0:1746143841.904666:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7252 00000100:00100000:1.0:1746143841.904672:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625041280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143841.904818:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14007 00000100:00100000:3.0:1746143841.904824:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2811:x1830963625041024:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143841.904836:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.904846:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d7d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.904935:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.904946:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.904952:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.904975:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.904988:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 12 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143841.904998:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627488896:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.905049:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143841.905066:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7253 00000100:00100000:3.0:1746143841.905071:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625041536:12345-192.168.202.3@tcp:3:cat.0 00002000:00010000:1.0:1746143841.908515:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143841 -> 1746143842 00002000:00010000:1.0:1746143841.908521:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143841 -> 1746143842 00002000:00010000:1.0:1746143841.908522:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143841 -> 1746143842 00000100:00100000:1.0:1746143841.908538:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627488768:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143841.908565:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b565d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d76 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.908578:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b565d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d76 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.908600:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ce00, rc 0) 00000100:00100000:1.0:1746143841.908643:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625040768:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5836us (7070us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143841.908651:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16637 00000100:00100000:3.0:1746143841.912494:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627488896:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.912513:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143841.913018:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.913073:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625041664 00000100:00100000:2.0:1746143841.913079:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625041664 00010000:00010000:2.0:1746143841.913107:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 13 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.913130:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8124 00000100:00100000:2.0:1746143841.913136:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625041664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.913149:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143841.913154:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 13 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.913166:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 13 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.913184:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5633 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d4c expref: 13 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.913198:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.913202:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.913209:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.913214:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143841.913242:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143841.913275:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625041664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 139us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.913281:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8124 00000100:00100000:2.0:1746143841.913597:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625041280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8925us (9193us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.913604:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7252 00002000:00100000:2.0:1746143841.913611:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012e358a80 x1830963625041280/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.913619:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963625041280 ext(3145728->4194303) 00002000:00010000:2.0:1746143841.913622:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358a80 00000100:00100000:2.0:1746143841.913737:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.913757:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625041792 00000100:00100000:2.0:1746143841.913760:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625041792 00000100:00100000:2.0:1746143841.913779:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14008 00000100:00100000:2.0:1746143841.913784:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2809:x1830963625041792:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143841.913795:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.913804:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b5672 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d84 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.913839:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b5672 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d84 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.913986:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b5672 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d84 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.914001:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143841.914004:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143841.914006:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:2.0:1746143841.914036:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2809:x1830963625041792:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 250us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.914042:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14008 00000100:00100000:2.0:1746143841.914092:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625041536:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9021us (9669us total) trans 0 rc 274432/274432 00000100:00100000:2.0:1746143841.914098:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7253 00002000:00100000:2.0:1746143841.914103:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3420159) req@ffff88012e35b480 x1830963625041536/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 274432/274432 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.914109:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b480 with x1830963625041536 ext(3145728->3420159) 00002000:00010000:2.0:1746143841.914113:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35b480 00010000:00010000:3.0:1746143841.914285:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.914292:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143841.914306:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143841.914401:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.914433:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.914438:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.914440:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143841.914442:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00000100:00100000:3.0:1746143841.914460:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2811:x1830963625041024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9637us (10092us total) trans 8589945075 rc 0/0 00000100:00100000:3.0:1746143841.914464:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14007 00000100:00100000:0.0:1746143841.926829:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.926891:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042048 00000100:00100000:3.0:1746143841.926898:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042048 00000100:00100000:3.0:1746143841.926972:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14009 00000100:00100000:3.0:1746143841.926979:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2809:x1830963625042048:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143841.926996:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.927011:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124512c00/0x87925e4cb73b5680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d8b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.927070:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927080:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927088:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927099:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927103:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927107:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927183:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b5695 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927195:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b5695 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927200:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b5695 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143841.927208:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143841.927267:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927273:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927277:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927282:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927286:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd85e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.927289:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927294:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927303:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143841.927305:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143841.927308:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927312:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927361:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927366:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927370:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927374:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd84e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.927376:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927380:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927386:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14d00) 00010000:00010000:3.0:1746143841.927388:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143841.927390:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927394:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b568e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.927424:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512c00/0x87925e4cb73b5680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d8b expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.927434:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b5695 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d8b expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.927439:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.927442:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143841.927444:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85000, rc 0) 00000100:00100000:3.0:1746143841.927491:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2809:x1830963625042048:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 512us (669us total) trans 8589945076 rc 0/0 00000100:00100000:3.0:1746143841.927496:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14009 00000100:00100000:0.0:1746143841.935562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.935612:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.935696:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042304 00000100:00100000:3.0:1746143841.935703:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042304 00000100:00100000:3.0:1746143841.935743:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042176 00000100:00100000:3.0:1746143841.935745:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042176 00000100:00100000:0.0:1746143841.937050:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16638 00000100:00100000:0.0:1746143841.937061:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625042304:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143841.937078:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.937093:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d99 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.937139:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627489024:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143841.937199:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.937751:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.937954:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042432 00000100:00100000:0.0:1746143841.937959:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042432 00000100:00100000:0.0:1746143841.937988:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16639 00000100:00100000:0.0:1746143841.937993:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625042176:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143841.938001:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.938010:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512c00/0x87925e4cb73b56aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411d92 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.938030:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512c00/0x87925e4cb73b56aa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d92 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.938039:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512c00/0x87925e4cb73b56aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d92 expref: 11 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.938052:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512c00, rc 0) 00000100:00100000:0.0:1746143841.938074:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625042176:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 80us (2461us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.938079:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16639 00000100:00100000:0.0:1746143841.938093:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16640 00000100:00100000:0.0:1746143841.938097:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625042432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143841.938103:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.938109:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b56b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411da0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.938122:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b56b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da0 expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.938134:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84e00/0x87925e4cb73b56b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da0 expref: 41 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.938140:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84e00, rc 0) 00000100:00100000:0.0:1746143841.938154:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625042432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 56us (403us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.938158:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16640 00000100:00100000:2.0:1746143841.939955:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627489024:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143841.939978:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56a3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d99 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.939987:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d99 expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.940048:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521a00, rc 0) 00000100:00100000:2.0:1746143841.940558:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625042304:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3498us (5001us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.940565:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16638 00000100:00100000:0.0:1746143841.944946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.945020:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042560 00000100:00100000:2.0:1746143841.945028:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042560 00000100:00100000:2.0:1746143841.945067:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16641 00000100:00100000:2.0:1746143841.945074:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2806:x1830963625042560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.945089:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.945101:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411da7 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.945123:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.945130:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.945131:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143841.945134:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4390912->4853759] (req 4390912->4853759) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.945163:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.945173:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.945184:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627489152:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.945460:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.945578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.945643:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042816 00000100:00100000:3.0:1746143841.945647:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042816 00000100:00100000:3.0:1746143841.945679:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14010 00000100:00100000:3.0:1746143841.945684:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2809:x1830963625042816:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143841.945696:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143841.945706:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b56bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dae expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.945779:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.945790:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.945796:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.945811:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.945818:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 31 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143841.945827:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627489280:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143841.945862:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.947614:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627489152:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.947637:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4390912->4853759] (req 4390912->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.947649:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:2.0:1746143841.947678:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+41:2806:x1830963625042560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2604us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.947684:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16641 00000100:00100000:0.0:1746143841.949640:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.949671:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.949698:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.949889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.949928:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625042944 00000100:00100000:0.0:1746143841.949933:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625042944 00000100:00100000:0.0:1746143841.949961:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043072 00000100:00100000:0.0:1746143841.949963:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043072 00000100:00100000:0.0:1746143841.949972:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043328 00000100:00100000:0.0:1746143841.949973:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043328 00000100:00100000:0.0:1746143841.949982:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043200 00000100:00100000:0.0:1746143841.949983:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043200 00000100:00100000:0.0:1746143841.949994:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16642 00000100:00100000:0.0:1746143841.950000:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625042944:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143841.950013:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.950025:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411db5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.950051:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.950053:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143841.950060:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.950073:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.950082:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e521a00, rc 0) 00000100:00100000:0.0:1746143841.950157:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625042944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 155us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143841.950162:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16642 00000100:00100000:1.0:1746143841.950285:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16643 00000100:00100000:1.0:1746143841.950292:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625043072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.950298:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.950305:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dbc expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.950314:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.950316:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.950320:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.950338:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.950350:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085a00, rc 0) 00000100:00100000:1.0:1746143841.950367:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625043072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 76us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.950372:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16643 00000100:00100000:1.0:1746143841.950383:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16644 00000100:00100000:1.0:1746143841.950387:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625043328:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.950393:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.950400:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73b56db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dca expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.950414:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73b56db lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dca expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.950422:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084800/0x87925e4cb73b56db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dca expref: 20 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.950434:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084800, rc 0) 00000100:00100000:1.0:1746143841.950445:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625043328:12345-192.168.202.3@tcp:101:cat.0 Request processed in 58us (747us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143841.950450:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16644 00000100:00100000:1.0:1746143841.950458:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16645 00000100:00100000:1.0:1746143841.950462:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625043200:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.950467:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.950471:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dc3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143841.950479:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.950480:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143841.950484:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.950492:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 19 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143841.950499:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00000100:00100000:1.0:1746143841.950510:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625043200:12345-192.168.202.3@tcp:101:cat.0 Request processed in 47us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143841.950515:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16645 00000100:00100000:3.0:1746143841.950616:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627489280:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143841.950634:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143841.950690:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.950706:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043584 00000100:00100000:3.0:1746143841.950708:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043584 00010000:00010000:3.0:1746143841.950723:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 32 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143841.950739:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8125 00000100:00100000:3.0:1746143841.950744:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2010:x1830963625043584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.950752:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.950757:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 32 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.950765:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 32 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.950778:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124512a00/0x87925e4cb73b566b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d7d expref: 32 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.950790:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.950794:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.950802:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.950807:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.950818:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.950831:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2010:x1830963625043584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.950836:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8125 00000100:00100000:3.0:1746143841.950897:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.951493:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043456 00000100:00100000:2.0:1746143841.951498:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043456 00002000:00100000:2.0:1746143841.951522:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4390911) req@ffff880096940700 x1830963625043456/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.951530:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096940700 with x1830963625043456 ext(4194304->4390911) 00010000:00010000:2.0:1746143841.951534:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.951547:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143841.951552:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096940700 00000100:00100000:2.0:1746143841.951566:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2678 00000100:00100000:2.0:1746143841.951570:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625043456:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143841.952511:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143841.952805:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952813:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952828:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952834:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952840:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952845:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880124578200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143841.952848:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952855:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952867:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143841.952869:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143841.952872:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952876:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b56c6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143841.952909:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b56bf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dae expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.952931:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097384e00/0x87925e4cb73b56bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dae expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143841.952939:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097384e00, rc 0) 00000100:00100000:3.0:1746143841.952960:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2809:x1830963625042816:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7275us (7382us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143841.952967:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14010 00000100:00100000:1.0:1746143841.953053:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043712 00000100:00100000:1.0:1746143841.953058:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043712 00000100:00100000:1.0:1746143841.953090:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16646 00000100:00100000:1.0:1746143841.953095:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625043712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143841.953105:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143841.953115:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b56e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dd1 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143841.953151:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627489408:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143841.953196:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143841.959964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.960155:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627489408:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143841.960183:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b56e9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd1 expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.960195:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b56e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd1 expref: 20 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143841.960219:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:0.0:1746143841.960256:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625043712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7160us (7746us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143841.960262:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16646 00000100:00100000:1.0:1746143841.961156:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625043968 00000100:00100000:1.0:1746143841.961166:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625043968 00000100:00100000:1.0:1746143841.961195:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5431 00000100:00100000:1.0:1746143841.961201:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a82d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2809:x1830963625043968:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143841.961359:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a82d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2809:x1830963625043968:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 157us (1402us total) trans 8589945077 rc 0/0 00000100:00100000:1.0:1746143841.961365:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5431 00000100:00100000:2.0:1746143841.963774:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625043456:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12196us (12870us total) trans 17179873971 rc 0/0 00000100:00100000:2.0:1746143841.963784:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2678 00002000:00100000:2.0:1746143841.963794:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4390911) req@ffff880096940700 x1830963625043456/t17179873971(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/448 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.963802:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096940700 with x1830963625043456 ext(4194304->4390911) 00010000:00010000:2.0:1746143841.963811:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.963823:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143841.963830:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096940700 00000100:00100000:0.0:1746143841.967178:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.967261:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625044096 00000100:00100000:2.0:1746143841.967270:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625044096 00010000:00010000:2.0:1746143841.967305:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.967354:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8126 00000100:00100000:2.0:1746143841.967361:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625044096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143841.967372:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143841.967386:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143841 -> 1746143842 00010000:00010000:2.0:1746143841.967393:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.967403:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.967428:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106600/0x87925e4cb73b5610 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4194304->4849663] (req 4194304->4390911) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d3e expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.967452:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.967454:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.967459:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.967468:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.967530:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.967541:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627489536:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143841.967942:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2540 going to sleep for 11 seconds 00010000:00010000:3.0:1746143841.973052:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143841.975627:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.975648:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625044224 00000100:00100000:0.0:1746143841.975655:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625044224 00000100:00100000:2.0:1746143841.975688:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627489536:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143841.975690:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16647 00000100:00100000:0.0:1746143841.975696:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2811:x1830963625044224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143841.975704:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143841.975711:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143841.975723:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dd8 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.975742:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625044096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8381us (8569us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143841.975745:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.975750:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8126 00010000:00010000:0.0:1746143841.975751:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 42 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.975757:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 20 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.975762:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143841.975763:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746143841.975766:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.975788:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 20 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.975798:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 20 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.975799:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.975811:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627489664:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.975817:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625044480 00000100:00100000:2.0:1746143841.975819:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625044480 00002000:00100000:2.0:1746143841.975841:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4390912->4853759) req@ffff880136ac9880 x1830963625044480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.975850:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9880 with x1830963625044480 ext(4390912->4853759) 00010000:00010000:0.0:1746143841.975853:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 42 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.975856:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x40000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143841.975861:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 42 pid: 13436 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143841.975864:0:9592:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x40000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143841.975868:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627489792:192.168.202.3@tcp:104: 00002000:00010000:2.0:1746143841.975870:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136ac9880 00000100:00100000:2.0:1746143841.975883:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2679 00010000:00010000:0.0:1746143841.975885:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143841.975889:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625044480:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:0.0:1746143841.975892:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143841.975898:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627489920:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143841.975928:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143841.979363:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.979398:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.979427:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625044736 00000100:00100000:3.0:1746143841.979435:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625044736 00002000:00100000:3.0:1746143841.979468:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009719d880 x1830963625044736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.979477:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d880 with x1830963625044736 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.979481:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719d880 00000100:00100000:3.0:1746143841.979495:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625044992 00000100:00100000:3.0:1746143841.979497:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625044992 00000100:00100000:0.0:1746143841.979502:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143841.979506:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009719e680 x1830963625044992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.979512:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719e680 with x1830963625044992 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.979515:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719e680 00000100:00100000:3.0:1746143841.979530:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625045248 00000100:00100000:3.0:1746143841.979532:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625045248 00002000:00100000:3.0:1746143841.979542:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719c380 x1830963625045248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/0 e 0 to 0 dl 1746143852 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.979548:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c380 with x1830963625045248 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.979551:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719c380 00000100:00100000:3.0:1746143841.979559:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7254 00000100:00100000:3.0:1746143841.979564:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625044736:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143841.980148:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7255 00000100:00100000:3.0:1746143841.980154:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625044992:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143841.980521:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7256 00000100:00100000:2.0:1746143841.980530:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625045248:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143841.985494:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143841.985534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143841.985585:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625045376 00000100:00100000:3.0:1746143841.985593:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625045376 00010000:00010000:3.0:1746143841.985624:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 44 pid: 13436 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143841.985664:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625045504 00000100:00100000:3.0:1746143841.985666:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625045504 00010000:00010000:3.0:1746143841.985677:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 23 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143841.985690:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8127 00000100:00100000:3.0:1746143841.985696:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625045376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.985709:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.985725:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 44 pid: 13436 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.985734:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 44 pid: 13436 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.985756:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.985791:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625045376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.985797:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8127 00000100:00100000:3.0:1746143841.985811:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8128 00000100:00100000:3.0:1746143841.985815:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625045504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143841.985821:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143841.985826:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 23 pid: 3134 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.985833:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 23 pid: 3134 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.985843:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143841.985855:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625045504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143841.985859:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8128 00000100:00100000:3.0:1746143841.985937:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625044480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10048us (10137us total) trans 0 rc 462848/462848 00000100:00100000:3.0:1746143841.985947:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2679 00002000:00100000:3.0:1746143841.985954:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4390912->4853759) req@ffff880136ac9880 x1830963625044480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:H/200/0 rc 462848/462848 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.985962:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9880 with x1830963625044480 ext(4390912->4853759) 00010000:00010000:3.0:1746143841.985966:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143841.985976:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 42 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143841.985982:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136ac9880 00010000:00010000:2.0:1746143841.986994:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012224e200/0x87925e4cb73b549d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c49 expref: 22 pid: 3134 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.987015:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627489664:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.987026:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091381600/0x87925e4cb73b5481 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411c3b expref: 41 pid: 13436 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143841.987035:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627489792:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143841.987042:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627489920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143841.987067:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.987078:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e520c00, rc 0) 00000100:00100000:2.0:1746143841.987099:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2811:x1830963625044224:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11404us (11478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143841.987105:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16647 00000100:00100000:3.0:1746143841.988483:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625044736:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8915us (9124us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.988491:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7254 00002000:00100000:3.0:1746143841.988499:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009719d880 x1830963625044736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.988510:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719d880 with x1830963625044736 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.988513:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719d880 00000100:00100000:3.0:1746143841.995531:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625044992:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 15368us (16123us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143841.995541:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7255 00002000:00100000:3.0:1746143841.995551:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009719e680 x1830963625044992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143841.995565:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719e680 with x1830963625044992 ext(1048576->2097151) 00002000:00010000:3.0:1746143841.995569:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719e680 00000100:00100000:2.0:1746143841.995765:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625045248:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 15235us (16260us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143841.995772:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7256 00002000:00100000:2.0:1746143841.995778:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719c380 x1830963625045248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:237/0 lens 488/440 e 0 to 0 dl 1746143852 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143841.995785:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c380 with x1830963625045248 ext(1048576->2097151) 00002000:00010000:2.0:1746143841.995789:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719c380 00000100:00100000:0.0:1746143841.998868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143841.999407:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625045632 00000100:00100000:2.0:1746143841.999415:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625045632 00000100:00100000:2.0:1746143841.999464:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16648 00000100:00100000:2.0:1746143841.999471:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625045632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143841.999484:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143841.999496:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73b56f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ddf expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143841.999515:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143841.999523:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73b56f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ddf expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.999532:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7400/0x87925e4cb73b56f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ddf expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143841.999557:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7400, rc 0) 00000100:00100000:2.0:1746143841.999595:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625045632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 125us (734us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143841.999601:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16648 00000100:00100000:0.0:1746143842.004193:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.004478:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625045760 00000100:00100000:1.0:1746143842.004489:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625045760 00010000:00010000:1.0:1746143842.004529:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.004573:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8129 00000100:00100000:1.0:1746143842.004581:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625045760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.004597:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.004619:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.004631:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.004656:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b56b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4390912->4853759) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411da7 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.004685:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.004687:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.004695:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.004702:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.004743:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 18 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.004757:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627490048:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.004878:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.005148:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.005180:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625045888 00000100:00100000:0.0:1746143842.005189:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625045888 00000100:00100000:0.0:1746143842.005214:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16649 00000100:00100000:0.0:1746143842.005219:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2806:x1830963625045888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143842.005234:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.005244:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411de6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.005260:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.005261:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.005265:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.005276:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.005284:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087800, rc 0) 00000100:00100000:0.0:1746143842.005324:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2806:x1830963625045888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 104us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.005340:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16649 00000100:00100000:1.0:1746143842.007582:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627490048:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.007606:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.007671:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625045760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3089us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.007682:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8129 00000100:00100000:0.0:1746143842.007693:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.007943:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.008022:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625046144 00000100:00100000:3.0:1746143842.008031:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625046144 00000100:00080000:1.0:1746143842.008179:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143842.008188:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16650 00000100:00100000:3.0:1746143842.008195:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2814:x1830963625046144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.008213:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.008229:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411df4 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.008254:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.008260:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.008262:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.008265:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.008290:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.008299:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 20 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.008310:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627490176:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.008383:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.008636:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.008687:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625046016 00000100:00100000:1.0:1746143842.008691:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625046016 00000100:00100000:3.0:1746143842.008758:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16651 00000100:00100000:3.0:1746143842.008765:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625046016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.008774:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.008781:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b570c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ded expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.008783:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625046400 00000100:00100000:2.0:1746143842.008787:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625046400 00010000:00010000:3.0:1746143842.008800:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b570c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ded expref: 42 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.008808:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b570c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ded expref: 42 pid: 3134 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746143842.008819:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2793472->2797567) req@ffff880092b44e00 x1830963625046400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.008828:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44e00 with x1830963625046400 ext(2793472->2797567) 00010000:00010000:3.0:1746143842.008832:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00010000:00010000:2.0:1746143842.008834:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.008845:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.008856:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b44e00 00000100:00100000:3.0:1746143842.008861:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625046016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 96us (225us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143842.008866:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16651 00000100:00100000:2.0:1746143842.008873:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2680 00000100:00100000:2.0:1746143842.008878:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625046400:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.009344:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625046400:12345-192.168.202.3@tcp:3:cat.0 Request processed in 464us (1429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.009350:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2680 00002000:00100000:2.0:1746143842.009356:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2793472->2797567) req@ffff880092b44e00 x1830963625046400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.009363:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44e00 with x1830963625046400 ext(2793472->2797567) 00010000:00010000:2.0:1746143842.009367:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.009376:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.009382:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b44e00 00000100:00100000:3.0:1746143842.010622:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627490176:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.010648:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.010661:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00000100:00100000:3.0:1746143842.010703:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2814:x1830963625046144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2508us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.010709:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16650 00000100:00100000:0.0:1746143842.012427:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.012546:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625046656 00000100:00100000:2.0:1746143842.012555:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625046656 00002000:00100000:2.0:1746143842.012595:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880092145880 x1830963625046656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.012604:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145880 with x1830963625046656 ext(4849664->4853759) 00002000:00010000:2.0:1746143842.012609:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145880 00000100:00100000:2.0:1746143842.012643:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7257 00000100:00100000:2.0:1746143842.012652:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625046656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.013116:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625046656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 138us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.013124:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7257 00002000:00100000:2.0:1746143842.013131:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880092145880 x1830963625046656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.013139:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145880 with x1830963625046656 ext(4849664->4853759) 00002000:00010000:2.0:1746143842.013142:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092145880 00000100:00100000:0.0:1746143842.016793:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.017554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.017707:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625047040 00000100:00100000:2.0:1746143842.017719:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625047040 00002000:00100000:2.0:1746143842.017768:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2793472->3145727) req@ffff8801368e8000 x1830963625047040/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.017778:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8000 with x1830963625047040 ext(2793472->3145727) 00010000:00010000:2.0:1746143842.017789:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 20 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.017804:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 20 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.017812:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368e8000 00000100:00100000:2.0:1746143842.017836:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2681 00000100:00100000:2.0:1746143842.017844:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625047040:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143842.018097:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625046912 00000100:00100000:3.0:1746143842.018101:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625046912 00000100:00100000:3.0:1746143842.018144:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16652 00000100:00100000:3.0:1746143842.018150:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2811:x1830963625046912:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143842.018161:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.018177:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411dfb expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.018201:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.018208:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.018210:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.018213:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->2281471] (req 2097152->2281471) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.018242:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.018252:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 32 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.018263:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627490304:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.018320:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00080000:1.0:1746143842.018381:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143842.018946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.019070:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625047296 00000100:00100000:3.0:1746143842.019074:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625047296 00000100:00100000:3.0:1746143842.019476:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5432 00000100:00100000:3.0:1746143842.019483:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:2806:x1830963625047296:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143842.019667:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+282:2806:x1830963625047296:12345-192.168.202.3@tcp:35:cat.0 Request processed in 184us (720us total) trans 8589945078 rc 0/0 00000100:00100000:3.0:1746143842.019676:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5432 00000100:00100000:0.0:1746143842.022391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.022452:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625047040:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4603us (4898us total) trans 17179873972 rc 0/0 00000100:00100000:3.0:1746143842.022463:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2681 00002000:00100000:3.0:1746143842.022474:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2793472->3145727) req@ffff8801368e8000 x1830963625047040/t17179873972(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.022482:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8000 with x1830963625047040 ext(2793472->3145727) 00010000:00010000:3.0:1746143842.022492:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.022504:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143842.022510:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368e8000 00000100:00100000:2.0:1746143842.022587:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627490304:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.022619:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->2281471] (req 2097152->2281471) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.022844:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:2.0:1746143842.022874:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2811:x1830963625046912:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4725us (6092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.022880:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16652 00000100:00100000:1.0:1746143842.023039:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625047424 00000100:00100000:1.0:1746143842.023047:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625047424 00002000:00100000:1.0:1746143842.023079:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3420160->4194303) req@ffff8801368eb800 x1830963625047424/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.023086:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb800 with x1830963625047424 ext(3420160->4194303) 00010000:00010000:1.0:1746143842.023091:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 33 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.023099:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 33 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143842.023109:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368eb800 00000100:00100000:1.0:1746143842.023133:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2682 00000100:00100000:1.0:1746143842.023140:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625047424:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143842.027444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.028214:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625047552 00000100:00100000:1.0:1746143842.028225:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625047552 00010000:00010000:1.0:1746143842.028265:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.028312:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8130 00000100:00100000:1.0:1746143842.028321:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625047552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.028345:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143842.028364:0:7230:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143841 -> 1746143842 00010000:00010000:1.0:1746143842.028370:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.028382:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.028406:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b56f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [2793472->3145727] (req 2793472->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dd8 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.028432:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.028435:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.028442:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.028456:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.028492:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.028505:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627490432:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.028575:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.032463:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625047424:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9312us (10068us total) trans 21474841241 rc 0/0 00000100:00100000:1.0:1746143842.032479:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2682 00002000:00100000:1.0:1746143842.032490:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3420160->4194303) req@ffff8801368eb800 x1830963625047424/t21474841241(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.032499:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb800 with x1830963625047424 ext(3420160->4194303) 00010000:00010000:1.0:1746143842.032510:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.032526:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:1.0:1746143842.032532:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368eb800 00000100:00100000:1.0:1746143842.033976:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627490432:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.033998:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.034366:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625047552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6044us (6936us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.034376:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8130 00000100:00100000:0.0:1746143842.035175:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.035229:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625047808 00000100:00100000:1.0:1746143842.035237:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625047808 00002000:00100000:1.0:1746143842.035276:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8801368ea300 x1830963625047808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.035285:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963625047808 ext(2097152->3145727) 00002000:00010000:1.0:1746143842.035290:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ea300 00000100:00100000:1.0:1746143842.035320:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7258 00000100:00100000:1.0:1746143842.035327:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625047808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143842.042063:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.042165:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625047936 00000100:00100000:1.0:1746143842.042176:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625047936 00010000:00010000:1.0:1746143842.042215:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143842.042816:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.042876:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8131 00000100:00100000:2.0:1746143842.042879:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625048192 00000100:00100000:2.0:1746143842.042884:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625048192 00000100:00100000:1.0:1746143842.042886:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625047936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.042900:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.042937:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.042940:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14011 00000100:00100000:2.0:1746143842.042947:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+282:2818:x1830963625048192:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.042951:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.042969:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.042978:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5609 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3420160->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d37 expref: 35 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.042987:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b571a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e02 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.042997:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.042999:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.043007:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 19 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.043015:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 19 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.043049:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 19 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.043061:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143842.043061:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627490560:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.043074:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043083:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043095:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043099:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043104:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143842.043129:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00010000:00010000:2.0:1746143842.043199:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043207:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043212:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143842.043219:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143842.043295:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043302:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043307:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043312:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043316:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b7a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143842.043320:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043326:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043349:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143842.043352:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143842.043355:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043363:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043387:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043391:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043394:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043398:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b6000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143842.043623:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043631:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043639:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008219e400) 00010000:00010000:2.0:1746143842.043642:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143842.043644:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043649:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5728 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143842.043680:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b571a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 285 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.043689:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 284 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.043699:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.043701:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143842.043703:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7400, rc 0) 00000100:00100000:2.0:1746143842.044150:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+284:2818:x1830963625048192:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1202us (1333us total) trans 8589945079 rc 0/0 00000100:00100000:2.0:1746143842.044155:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14011 00000100:00100000:1.0:1746143842.044628:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625047808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9299us (9457us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.044637:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7258 00002000:00100000:1.0:1746143842.044647:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8801368ea300 x1830963625047808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.044657:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963625047808 ext(2097152->3145727) 00002000:00010000:1.0:1746143842.044661:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ea300 00000100:00100000:1.0:1746143842.047017:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627490560:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.047037:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.047086:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625047936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4201us (5032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.047102:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8131 00000100:00100000:0.0:1746143842.047544:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.047667:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625048448 00000100:00100000:2.0:1746143842.047674:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625048448 00002000:00100000:2.0:1746143842.047719:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2277376->2281471) req@ffff88012d842d80 x1830963625048448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.047728:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842d80 with x1830963625048448 ext(2277376->2281471) 00002000:00010000:2.0:1746143842.047733:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d842d80 00000100:00100000:2.0:1746143842.048069:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7259 00000100:00100000:2.0:1746143842.048077:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625048448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.048399:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625048448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 322us (856us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.048404:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7259 00002000:00100000:2.0:1746143842.048410:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2277376->2281471) req@ffff88012d842d80 x1830963625048448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.048416:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842d80 with x1830963625048448 ext(2277376->2281471) 00002000:00010000:2.0:1746143842.048418:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d842d80 00000100:00100000:0.0:1746143842.053528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.053632:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.053732:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625048704 00000100:00100000:1.0:1746143842.053742:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625048704 00000100:00100000:1.0:1746143842.053809:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5433 00000100:00100000:1.0:1746143842.053817:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2811:x1830963625048704:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143842.054464:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2811:x1830963625048704:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 647us (947us total) trans 8589945080 rc 0/0 00000100:00100000:1.0:1746143842.054471:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5433 00000100:00100000:2.0:1746143842.054678:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625048960 00000100:00100000:2.0:1746143842.054683:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625048960 00002000:00100000:2.0:1746143842.054715:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2281472->3145727) req@ffff88012d843100 x1830963625048960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.054725:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843100 with x1830963625048960 ext(2281472->3145727) 00002000:00010000:2.0:1746143842.054731:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843100 00000100:00100000:2.0:1746143842.054745:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7260 00000100:00100000:2.0:1746143842.054750:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625048960:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143842.055942:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.056006:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625049216 00000100:00100000:3.0:1746143842.056012:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625049216 00002000:00100000:3.0:1746143842.056036:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb5880 x1830963625049216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.056045:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963625049216 ext(3145728->4194303) 00002000:00010000:3.0:1746143842.056049:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:3.0:1746143842.056070:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7261 00000100:00100000:3.0:1746143842.056076:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625049216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143842.057206:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.057260:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625049344 00000100:00100000:3.0:1746143842.057264:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625049344 00000100:00100000:3.0:1746143842.057290:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16653 00000100:00100000:3.0:1746143842.057294:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+41:2818:x1830963625049344:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143842.057304:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.057321:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e09 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.057357:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.057365:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.057370:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.057372:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.057375:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3870720->4071423] (req 3870720->4071423) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.057402:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.057411:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 42 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.057422:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627490688:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.059029:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.059046:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.059058:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627490816:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.060828:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.061183:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625049600 00000100:00100000:3.0:1746143842.061192:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625049600 00002000:00100000:3.0:1746143842.061234:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880092ef2300 x1830963625049600/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.061243:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2300 with x1830963625049600 ext(3145728->4194303) 00002000:00010000:3.0:1746143842.061249:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2300 00000100:00100000:3.0:1746143842.061276:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7262 00000100:00100000:3.0:1746143842.061283:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625049600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.062064:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.072435:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625048960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17673us (18792us total) trans 0 rc 864256/864256 00000100:00100000:2.0:1746143842.072447:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7260 00002000:00100000:2.0:1746143842.072462:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2281472->3145727) req@ffff88012d843100 x1830963625048960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 864256/864256 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.072472:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843100 with x1830963625048960 ext(2281472->3145727) 00002000:00010000:2.0:1746143842.072478:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843100 00000100:00100000:0.0:1746143842.076810:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.077122:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625049216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21043us (21179us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.077134:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7261 00002000:00100000:3.0:1746143842.077147:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb5880 x1830963625049216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.077157:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963625049216 ext(3145728->4194303) 00010000:00010000:3.0:1746143842.077167:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.077180:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143842.077187:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb5880 00000100:00100000:1.0:1746143842.077268:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625049728 00000100:00100000:1.0:1746143842.077275:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625049728 00010000:00010000:1.0:1746143842.077303:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.077321:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8132 00000100:00100000:1.0:1746143842.077326:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625049728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.077347:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.077362:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.077371:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.077395:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.077409:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625049728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.077417:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8132 00010000:00010000:2.0:1746143842.077691:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b563a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d53 expref: 42 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.077707:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096940e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627490688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.077718:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627490816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.077739:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4071423] (req 3870720->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.077748:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504400, rc 0) 00000100:00100000:2.0:1746143842.077769:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+41:2818:x1830963625049344:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 20475us (20567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.077779:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16653 00000100:00100000:2.0:1746143842.078337:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625049600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17043us (17505us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.078344:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7262 00002000:00100000:2.0:1746143842.078350:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880092ef2300 x1830963625049600/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.078357:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2300 with x1830963625049600 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.078361:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2300 00000100:00100000:0.0:1746143842.081683:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.081754:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625049856 00000100:00100000:3.0:1746143842.081764:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625049856 00010000:00010000:3.0:1746143842.081801:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.081834:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8133 00000100:00100000:3.0:1746143842.081841:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625049856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.081855:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.081879:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.081891:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.081939:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467800/0x87925e4cb73b5705 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411df4 expref: 21 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.081957:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.081959:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.081965:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.081973:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.082009:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.082021:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627490944:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143842.082099:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.083773:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627490944:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143842.083790:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.083832:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625049856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1990us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.083841:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8133 00000100:00100000:0.0:1746143842.084399:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.084457:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625050112 00000100:00100000:3.0:1746143842.084463:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625050112 00002000:00100000:3.0:1746143842.084496:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3870720->3874815) req@ffff880092ef3100 x1830963625050112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.084505:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3100 with x1830963625050112 ext(3870720->3874815) 00002000:00010000:3.0:1746143842.084509:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3100 00000100:00100000:3.0:1746143842.084525:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7263 00000100:00100000:3.0:1746143842.084532:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625050112:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143842.084664:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625050112:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 132us (267us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.084670:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7263 00002000:00100000:3.0:1746143842.084675:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3870720->3874815) req@ffff880092ef3100 x1830963625050112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.084687:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3100 with x1830963625050112 ext(3870720->3874815) 00002000:00010000:3.0:1746143842.084689:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3100 00000100:00100000:0.0:1746143842.087166:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.087242:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625050240 00000100:00100000:2.0:1746143842.087249:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625050240 00000100:00100000:2.0:1746143842.087365:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16654 00000100:00100000:2.0:1746143842.087373:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2814:x1830963625050240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.087388:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.087406:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e10 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.087433:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.087441:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.087442:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.087446:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.087474:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 40 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.087490:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 40 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.087502:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627491072:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.088124:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.093402:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627491072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.093435:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.093452:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049200, rc 0) 00000100:00100000:2.0:1746143842.093501:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2814:x1830963625050240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6127us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.093509:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16654 00000100:00100000:0.0:1746143842.093691:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.094206:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625050496 00000100:00100000:2.0:1746143842.094214:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625050496 00002000:00100000:2.0:1746143842.094248:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4067328->4071423) req@ffff88012457fb80 x1830963625050496/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.094257:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457fb80 with x1830963625050496 ext(4067328->4071423) 00010000:00010000:2.0:1746143842.094264:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.094276:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.094288:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457fb80 00000100:00100000:2.0:1746143842.094318:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2683 00000100:00100000:2.0:1746143842.094326:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625050496:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143842.094465:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625050496:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 140us (774us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.094471:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2683 00002000:00100000:2.0:1746143842.094476:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4067328->4071423) req@ffff88012457fb80 x1830963625050496/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.094483:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457fb80 with x1830963625050496 ext(4067328->4071423) 00010000:00010000:2.0:1746143842.096033:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.096059:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.096067:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457fb80 00000100:00100000:0.0:1746143842.096217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.096506:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625050880 00000100:00100000:1.0:1746143842.096513:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625050880 00000100:00100000:1.0:1746143842.096947:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5434 00000100:00100000:1.0:1746143842.096955:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2818:x1830963625050880:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143842.097158:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2818:x1830963625050880:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 203us (941us total) trans 8589945081 rc 0/0 00000100:00100000:1.0:1746143842.097164:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5434 00000100:00100000:0.0:1746143842.098255:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.098938:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625051008 00000100:00100000:2.0:1746143842.098946:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625051008 00002000:00100000:2.0:1746143842.098990:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3870720->4071423) req@ffff88012457df80 x1830963625051008/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.098999:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457df80 with x1830963625051008 ext(3870720->4071423) 00010000:00010000:2.0:1746143842.099008:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.099026:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 41 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.099033:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457df80 00000100:00100000:2.0:1746143842.099069:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2684 00000100:00100000:2.0:1746143842.099077:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625051008:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143842.109709:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625051008:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10615us (11441us total) trans 17179873973 rc 0/0 00000100:00100000:2.0:1746143842.109725:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2684 00002000:00100000:2.0:1746143842.109740:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3870720->4071423) req@ffff88012457df80 x1830963625051008/t17179873973(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.109750:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457df80 with x1830963625051008 ext(3870720->4071423) 00010000:00010000:2.0:1746143842.109768:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.109788:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.109795:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012457df80 00000100:00100000:0.0:1746143842.111713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.111810:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625051136 00000100:00100000:3.0:1746143842.111820:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625051136 00010000:00010000:3.0:1746143842.111855:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.111963:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8134 00000100:00100000:3.0:1746143842.111972:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625051136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.111990:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.112011:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.112048:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.112074:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504400/0x87925e4cb73b573d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3870720->4849663] (req 3870720->4071423) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e09 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.112103:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.112105:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.112112:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.112122:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.112162:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.112175:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627491200:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143842.112263:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.114740:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627491200:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143842.114760:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.114808:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625051136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2836us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.114817:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8134 00000100:00100000:0.0:1746143842.117629:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.118226:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625051392 00000100:00100000:2.0:1746143842.118238:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625051392 00002000:00100000:2.0:1746143842.118279:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012457ce00 x1830963625051392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.118286:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ce00 with x1830963625051392 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.118290:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457ce00 00000100:00100000:2.0:1746143842.118318:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7264 00000100:00100000:2.0:1746143842.118324:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625051392:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.128040:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625051392:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9701us (10407us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.128054:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7264 00002000:00100000:2.0:1746143842.128066:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012457ce00 x1830963625051392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.128076:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457ce00 with x1830963625051392 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.128082:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457ce00 00000100:00100000:0.0:1746143842.132844:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.133023:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625051648 00000100:00100000:2.0:1746143842.133034:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625051648 00002000:00100000:2.0:1746143842.133084:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88012457c000 x1830963625051648/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.133095:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c000 with x1830963625051648 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.133100:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457c000 00000100:00100000:2.0:1746143842.133140:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7265 00000100:00100000:2.0:1746143842.133149:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625051648:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.140900:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625051648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7174us (7490us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746143842.140930:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7265 00002000:00100000:2.0:1746143842.140944:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88012457c000 x1830963625051648/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.140954:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457c000 with x1830963625051648 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.140961:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457c000 00000100:00100000:0.0:1746143842.148370:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.148522:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625051904 00000100:00100000:2.0:1746143842.148532:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625051904 00000100:00100000:2.0:1746143842.148581:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14012 00000100:00100000:2.0:1746143842.148589:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+285:2823:x1830963625051904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.151067:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.151098:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b574b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e17 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.151216:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.151231:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.151243:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143842.151253:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143842.151368:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b574b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 288 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.151405:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.151413:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.151415:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143842.151418:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049c00, rc 0) 00000100:00100000:2.0:1746143842.151481:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+287:2823:x1830963625051904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2892us (3120us total) trans 8589945082 rc 0/0 00000100:00100000:2.0:1746143842.151491:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14012 00000100:00100000:0.0:1746143842.154193:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.154249:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.154270:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625052032 00000100:00100000:2.0:1746143842.154281:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625052032 00000100:00100000:1.0:1746143842.154308:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625052160 00000100:00100000:1.0:1746143842.154313:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625052160 00000100:00100000:2.0:1746143842.154351:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16655 00000100:00100000:1.0:1746143842.154362:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16656 00000100:00100000:2.0:1746143842.154365:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625052032:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143842.154369:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625052160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.154381:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.154381:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.154398:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e1e expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.154398:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73b5760 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e25 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.154421:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.154423:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.154431:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 43 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.154446:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 43 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143842.154451:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627491328:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143842.154456:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049e00, rc 0) 00000100:00100000:2.0:1746143842.154586:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625052032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 223us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.154593:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16655 00000100:00100000:1.0:1746143842.154608:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.156586:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627491328:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143842.156619:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73b5760 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e25 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.156633:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d400/0x87925e4cb73b5760 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e25 expref: 35 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.157079:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d400, rc 0) 00000100:00100000:1.0:1746143842.157689:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625052160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3316us (3435us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143842.157699:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16656 00000100:00100000:0.0:1746143842.170730:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.170801:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625052416 00000100:00100000:2.0:1746143842.170812:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625052416 00002000:00100000:2.0:1746143842.170865:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88011e30a680 x1830963625052416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.170875:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a680 with x1830963625052416 ext(2097152->3145727) 00002000:00010000:2.0:1746143842.170881:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30a680 00000100:00100000:2.0:1746143842.171753:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7266 00000100:00100000:2.0:1746143842.171764:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625052416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143842.175677:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.176057:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625052672 00000100:00100000:2.0:1746143842.176066:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625052672 00000100:00100000:2.0:1746143842.176108:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14013 00000100:00100000:2.0:1746143842.176114:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2826:x1830963625052672:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143842.176135:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.176152:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049400/0x87925e4cb73b576e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e2c expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.176243:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.176256:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 286 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.176261:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.176287:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 286 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.176295:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 286 pid: 14991 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.176304:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627491456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.176623:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.179035:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627491456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.179059:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143842.179212:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625052416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7449us (8488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.179224:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7266 00002000:00100000:2.0:1746143842.179236:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88011e30a680 x1830963625052416/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.179245:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a680 with x1830963625052416 ext(2097152->3145727) 00002000:00010000:2.0:1746143842.179250:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30a680 00000100:00100000:0.0:1746143842.180311:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.180426:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625052800 00000100:00100000:3.0:1746143842.180433:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625052800 00010000:00010000:3.0:1746143842.180461:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 287 pid: 14991 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.180493:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8135 00000100:00100000:3.0:1746143842.180498:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+287:2009:x1830963625052800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.180509:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.180513:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 287 pid: 14991 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.180525:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 287 pid: 14991 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.180544:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7400/0x87925e4cb73b572f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e02 expref: 287 pid: 14991 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.180635:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.180639:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.180648:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.180654:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.180682:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.180723:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:2009:x1830963625052800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 224us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.180732:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8135 00010000:00010000:0.0:1746143842.180885:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.180892:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143842.181403:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143842.182247:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049400/0x87925e4cb73b576e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 35 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.182274:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 34 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.182283:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.182285:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143842.182287:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00000100:00100000:1.0:1746143842.183138:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2826:x1830963625052672:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7019us (7469us total) trans 8589945083 rc 0/0 00000100:00100000:1.0:1746143842.183149:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14013 00000100:00100000:0.0:1746143842.184607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.184695:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625052928 00000100:00100000:1.0:1746143842.184705:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625052928 00000100:00100000:1.0:1746143842.184759:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16657 00000100:00100000:1.0:1746143842.184766:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2823:x1830963625052928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.184785:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.184803:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e33 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.184834:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 19 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.184842:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.184844:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.184847:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.184877:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 19 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.184889:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 19 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.184901:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627491584:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.185727:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.186519:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.186563:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627491584:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.186585:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.186601:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7d800, rc 0) 00000100:00100000:1.0:1746143842.186638:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2823:x1830963625052928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1874us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.186646:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16657 00000100:00100000:2.0:1746143842.186725:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625053056 00000100:00100000:2.0:1746143842.186732:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625053056 00002000:00100000:2.0:1746143842.186769:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2281471) req@ffff880094194000 x1830963625053056/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.186783:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194000 with x1830963625053056 ext(2097152->2281471) 00010000:00010000:2.0:1746143842.186790:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 20 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.186802:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 20 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.186808:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094194000 00000100:00100000:2.0:1746143842.186993:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2685 00000100:00100000:2.0:1746143842.187001:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625053056:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143842.191237:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625053056:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4223us (4708us total) trans 21474841242 rc 0/0 00000100:00100000:2.0:1746143842.191252:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2685 00002000:00100000:2.0:1746143842.191266:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2281471) req@ffff880094194000 x1830963625053056/t21474841242(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.191277:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194000 with x1830963625053056 ext(2097152->2281471) 00010000:00010000:2.0:1746143842.191288:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.191305:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.191312:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094194000 00000100:00100000:0.0:1746143842.196715:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.196826:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625053184 00000100:00100000:3.0:1746143842.196838:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625053184 00010000:00010000:3.0:1746143842.196874:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.196948:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8136 00000100:00100000:3.0:1746143842.196955:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625053184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.196971:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.196992:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.197005:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.197026:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5713 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dfb expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.197055:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.197058:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.197066:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.197075:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.197111:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.197125:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627491712:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143842.197208:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.198270:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.198402:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625053312 00000100:00100000:1.0:1746143842.198408:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625053312 00000100:00100000:1.0:1746143842.198451:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16658 00000100:00100000:1.0:1746143842.198458:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2826:x1830963625053312:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.198473:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.198487:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e3a expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.198509:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.198516:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.198517:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.198521:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3104768->3145727] (req 3104768->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.198543:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.198554:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 34 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.198563:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627491840:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.198883:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.199870:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627491840:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.199891:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3104768->3145727] (req 3104768->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.199904:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7c000, rc 0) 00000100:00100000:3.0:1746143842.200080:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627491712:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143842.200092:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.200138:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625053184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3182us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.200139:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2826:x1830963625053312:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1680us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.200147:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8136 00000100:00100000:1.0:1746143842.200147:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16658 00000100:00100000:0.0:1746143842.206577:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.206691:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625053568 00000100:00100000:2.0:1746143842.206702:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625053568 00002000:00100000:2.0:1746143842.206753:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880094195c00 x1830963625053568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746143842.207028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.207088:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625053824 00000100:00100000:3.0:1746143842.207093:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625053824 00002000:00100000:2.0:1746143842.207106:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963625053568 ext(2097152->4194303) 00002000:00100000:3.0:1746143842.207112:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880094194e00 x1830963625053824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143842.207117:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00100000:3.0:1746143842.207122:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194e00 with x1830963625053824 ext(3145728->4194303) 00002000:00010000:3.0:1746143842.207126:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194e00 00010000:00010000:2.0:1746143842.207133:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.207139:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195c00 00000100:00100000:3.0:1746143842.207147:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2686 00000100:00100000:3.0:1746143842.207154:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625053568:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.207157:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7267 00000100:00100000:2.0:1746143842.207163:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625053824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.226112:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625053824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18936us (19072us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.226126:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7267 00002000:00100000:2.0:1746143842.226141:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880094194e00 x1830963625053824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.226151:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194e00 with x1830963625053824 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.226157:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194e00 00000100:00100000:1.0:1746143842.231241:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627491968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746143842.231319:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.231376:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627491968 00000100:00100000:2.0:1746143842.231384:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627491968 00000100:00100000:2.0:1746143842.231451:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00080000:1.0:1746143842.231455:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143842.231457:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627491968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746143842.231480:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1161781312 pending 6774784 free 3906236416 avail 3674714112 00000100:00100000:2.0:1746143842.231519:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627491968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.231525:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1746143842.231905:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625053568:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24748us (25338us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143842.231931:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2686 00002000:00100000:3.0:1746143842.231941:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880094195c00 x1830963625053568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.231950:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195c00 with x1830963625053568 ext(2097152->4194303) 00010000:00010000:3.0:1746143842.231959:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.231973:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143842.231980:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094195c00 00000100:00100000:1.0:1746143842.232295:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627491968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746143842.243668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.243709:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625054080 00000100:00100000:2.0:1746143842.243719:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625054080 00002000:00100000:2.0:1746143842.243770:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880093f7b100 x1830963625054080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.243780:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f7b100 with x1830963625054080 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.243785:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f7b100 00000100:00100000:2.0:1746143842.243805:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7268 00000100:00100000:2.0:1746143842.243813:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625054080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.245516:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.246262:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.246517:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625054208 00000100:00100000:0.0:1746143842.246527:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625054208 00010000:00010000:0.0:1746143842.246558:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143842.246591:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8137 00000100:00100000:0.0:1746143842.246598:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625054208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.246610:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.246629:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.246640:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.246661:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7d800/0x87925e4cb73b5783 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e33 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.246692:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.246694:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.246700:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.246711:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.246745:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.246756:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627492096:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143842.246834:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666780 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.248757:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625054336 00000100:00100000:1.0:1746143842.248770:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625054336 00000100:00100000:1.0:1746143842.248838:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16659 00000100:00100000:1.0:1746143842.248847:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2823:x1830963625054336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.248865:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.248883:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e41 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.248931:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.248939:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.248941:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.248944:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.248975:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 21 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.248987:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.249004:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627492224:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.249095:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.251135:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625054080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7311us (7466us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746143842.251146:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7268 00002000:00100000:2.0:1746143842.251158:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff880093f7b100 x1830963625054080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.251168:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f7b100 with x1830963625054080 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.251173:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f7b100 00000100:00100000:1.0:1746143842.251551:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627492224:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.251577:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.251592:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a45c00, rc 0) 00000100:00100000:1.0:1746143842.251625:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2823:x1830963625054336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2780us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.251632:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16659 00000100:00100000:2.0:1746143842.251769:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627492096:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.251782:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.251802:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625054208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5205us (6295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.251810:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8137 00000100:00100000:0.0:1746143842.252886:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.254445:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625054592 00000100:00100000:2.0:1746143842.254457:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625054592 00002000:00100000:2.0:1746143842.254519:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3104768->3108863) req@ffff880095c6b480 x1830963625054592/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.254529:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6b480 with x1830963625054592 ext(3104768->3108863) 00010000:00010000:2.0:1746143842.254539:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.254554:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.254561:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6b480 00000100:00100000:2.0:1746143842.254596:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2687 00000100:00100000:2.0:1746143842.254605:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625054592:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143842.255130:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625054592:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 525us (2246us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.255137:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2687 00002000:00100000:2.0:1746143842.255143:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3104768->3108863) req@ffff880095c6b480 x1830963625054592/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.255150:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6b480 with x1830963625054592 ext(3104768->3108863) 00010000:00010000:2.0:1746143842.255154:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.255163:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.255168:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6b480 00000100:00100000:0.0:1746143842.259582:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.259643:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.260005:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625054848 00000100:00100000:2.0:1746143842.260016:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625054848 00002000:00100000:2.0:1746143842.260071:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3104768->3145727) req@ffff880095c6a680 x1830963625054848/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.260082:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a680 with x1830963625054848 ext(3104768->3145727) 00000100:00100000:1.0:1746143842.260086:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625054976 00000100:00100000:1.0:1746143842.260091:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625054976 00010000:00010000:2.0:1746143842.260094:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.260110:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.260117:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6a680 00000100:00100000:2.0:1746143842.260288:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2688 00000100:00100000:1.0:1746143842.260288:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16660 00000100:00100000:2.0:1746143842.260296:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625054848:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143842.260296:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2826:x1830963625054976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.260309:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.260340:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e48 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.260367:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.260376:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 42 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.260387:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.260389:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.260392:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.260424:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 42 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.260433:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 42 pid: 13430 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.260445:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627492352:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.260519:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.260526:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.260534:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627492480:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.260551:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.263588:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625054848:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3282us (4005us total) trans 21474841243 rc 0/0 00000100:00100000:2.0:1746143842.263603:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2688 00002000:00100000:2.0:1746143842.263616:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3104768->3145727) req@ffff880095c6a680 x1830963625054848/t21474841243(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.263624:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a680 with x1830963625054848 ext(3104768->3145727) 00010000:00010000:2.0:1746143842.263634:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.263647:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.263653:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6a680 00000100:00100000:1.0:1746143842.263736:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627492352:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.263746:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627492480:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.263772:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.263952:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a45800, rc 0) 00000100:00100000:1.0:1746143842.263987:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2826:x1830963625054976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3691us (4342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.263993:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16660 00000100:00100000:0.0:1746143842.264856:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.265240:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625055104 00000100:00100000:2.0:1746143842.265249:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625055104 00010000:00010000:2.0:1746143842.265280:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.265384:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8138 00000100:00100000:2.0:1746143842.265392:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625055104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.265406:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.265431:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.265441:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.265467:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049200/0x87925e4cb73b5744 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e10 expref: 22 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.265574:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.265618:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625055104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 226us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.265624:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8138 00000100:00100000:0.0:1746143842.267750:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.267796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.267951:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625055232 00000100:00100000:2.0:1746143842.267958:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625055232 00010000:00010000:2.0:1746143842.267988:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.268025:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625055360 00000100:00100000:2.0:1746143842.268027:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625055360 00000100:00100000:1.0:1746143842.268034:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8139 00010000:00010000:2.0:1746143842.268038:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 43 pid: 13430 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.268044:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625055232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143842.268053:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8140 00010000:00010000:1.0:1746143842.268056:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143842.268058:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625055360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.268065:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.268073:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.268076:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 43 pid: 13430 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.268083:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.268084:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 43 pid: 13430 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.268100:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049e00/0x87925e4cb73b5767 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e1e expref: 43 pid: 13430 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.268101:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7c000/0x87925e4cb73b578a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e3a expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.268113:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.268114:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.268118:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.268120:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.268120:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.268124:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.268127:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.268131:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.268152:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.268152:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.268161:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627492608:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.268161:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627492736:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.268222:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.268300:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.275498:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627492608:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.275518:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.275685:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625055360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7624us (7886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.275694:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8140 00000100:00100000:1.0:1746143842.275700:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627492736:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.275718:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.275755:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625055232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7713us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.275765:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8139 00000100:00100000:0.0:1746143842.276420:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.276459:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625055744 00000100:00100000:2.0:1746143842.276464:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625055744 00002000:00100000:2.0:1746143842.276494:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880095c68e00 x1830963625055744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.276508:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68e00 with x1830963625055744 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.276512:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68e00 00000100:00100000:2.0:1746143842.276538:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7269 00000100:00100000:2.0:1746143842.276544:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625055744:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143842.280891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.281125:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625055872 00000100:00100000:2.0:1746143842.281133:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625055872 00002000:00100000:2.0:1746143842.281169:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3416064->3420159) req@ffff880095c69180 x1830963625055872/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.281178:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69180 with x1830963625055872 ext(3416064->3420159) 00002000:00010000:2.0:1746143842.281183:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69180 00000100:00100000:2.0:1746143842.281203:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7270 00000100:00100000:2.0:1746143842.281210:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625055872:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143842.281335:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625055872:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 117us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.281341:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7270 00002000:00100000:2.0:1746143842.281347:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3416064->3420159) req@ffff880095c69180 x1830963625055872/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.281353:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69180 with x1830963625055872 ext(3416064->3420159) 00002000:00010000:2.0:1746143842.281356:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69180 00000100:00100000:2.0:1746143842.283055:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625055744:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6502us (6626us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.283066:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7269 00002000:00100000:2.0:1746143842.283077:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880095c68e00 x1830963625055744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.283085:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68e00 with x1830963625055744 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.283091:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68e00 00000100:00100000:0.0:1746143842.286675:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.286747:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625056000 00000100:00100000:1.0:1746143842.286757:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625056000 00000100:00100000:1.0:1746143842.286817:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16661 00000100:00100000:1.0:1746143842.286825:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625056000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.286845:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.286863:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b579f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e4f expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.286898:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b579f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e4f expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.286909:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b579f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e4f expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.287273:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00000100:00100000:1.0:1746143842.287339:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625056000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 515us (674us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143842.287348:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16661 00000100:00100000:0.0:1746143842.292197:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.292348:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625056128 00000100:00100000:1.0:1746143842.292360:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625056128 00000100:00100000:1.0:1746143842.292420:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16662 00000100:00100000:1.0:1746143842.292428:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2823:x1830963625056128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.292449:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.292465:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e56 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.292495:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.292503:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.292505:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.292508:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4194304->4853759] (req 4194304->4853759) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 43 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.292540:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 20 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.292551:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 20 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.292562:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627492864:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.292659:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.295419:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.295489:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625056256 00000100:00100000:2.0:1746143842.295498:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625056256 00000100:00100000:1.0:1746143842.295537:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627492864:192.168.202.3@tcp:104: 00002000:00100000:2.0:1746143842.295544:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3420159) req@ffff88012e359c00 x1830963625056256/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.295553:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963625056256 ext(3145728->3420159) 00010000:00010000:2.0:1746143842.295561:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.295563:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [4194304->4853759] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 43 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.295574:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 21 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.295577:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00002000:00010000:2.0:1746143842.295580:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e359c00 00000100:00100000:1.0:1746143842.295849:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2823:x1830963625056128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3420us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.295852:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2689 00000100:00100000:1.0:1746143842.295856:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16662 00000100:00100000:2.0:1746143842.295859:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625056256:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143842.302145:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625056256:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6272us (6723us total) trans 17179873974 rc 0/0 00000100:00100000:2.0:1746143842.302158:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2689 00002000:00100000:2.0:1746143842.302171:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3420159) req@ffff88012e359c00 x1830963625056256/t17179873974(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.302181:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963625056256 ext(3145728->3420159) 00010000:00010000:2.0:1746143842.302192:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 23 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.302210:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 23 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.302217:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e359c00 00000100:00100000:0.0:1746143842.305384:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.305489:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625056384 00000100:00100000:1.0:1746143842.305499:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625056384 00010000:00010000:1.0:1746143842.305537:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 23 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.305580:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8141 00000100:00100000:1.0:1746143842.305588:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625056384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.305604:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.305626:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 23 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.305639:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 23 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.305663:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b5798 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->4849663] (req 3145728->3420159) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e48 expref: 23 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.305690:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.305692:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.305700:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.305709:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.305744:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.305756:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627492992:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.305843:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.307048:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627492992:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.307063:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.307094:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625056384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1507us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.307103:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8141 00000100:00100000:0.0:1746143842.311820:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.312348:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625056640 00000100:00100000:2.0:1746143842.312359:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625056640 00002000:00100000:2.0:1746143842.312407:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88012e35a680 x1830963625056640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.312417:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a680 with x1830963625056640 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.312423:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35a680 00000100:00100000:2.0:1746143842.312459:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7271 00000100:00100000:2.0:1746143842.312467:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625056640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.319031:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625056640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6551us (7209us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746143842.319045:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7271 00002000:00100000:2.0:1746143842.319057:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88012e35a680 x1830963625056640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.319067:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a680 with x1830963625056640 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.319073:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35a680 00000100:00100000:0.0:1746143842.323244:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.323321:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625056896 00000100:00100000:1.0:1746143842.323342:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625056896 00000100:00100000:1.0:1746143842.323409:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14014 00000100:00100000:1.0:1746143842.323417:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+286:2829:x1830963625056896:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.323440:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.323461:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b57ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e5d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.323565:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.323584:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.323596:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143842.323606:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143842.323711:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4600/0x87925e4cb73b57ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 289 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.323742:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 288 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.323750:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.323753:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143842.323756:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5200, rc 0) 00000100:00100000:1.0:1746143842.323809:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+288:2829:x1830963625056896:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 393us (581us total) trans 8589945084 rc 0/0 00000100:00100000:1.0:1746143842.323816:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14014 00000100:00100000:0.0:1746143842.329247:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.330131:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625057024 00000100:00100000:1.0:1746143842.330141:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625057024 00000100:00100000:1.0:1746143842.330244:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16663 00000100:00100000:1.0:1746143842.330252:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2829:x1830963625057024:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.330272:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.330290:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e64 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.330346:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.330359:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.330361:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.330365:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2912256->3059711] (req 2912256->3059711) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.330397:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.330409:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.330423:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493120:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.331148:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.333350:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493120:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.333384:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2912256->3059711] (req 2912256->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.333405:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049400, rc 0) 00000100:00100000:1.0:1746143842.333461:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2829:x1830963625057024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3209us (4224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.333471:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16663 00000100:00100000:0.0:1746143842.334614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.334682:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625057152 00000100:00100000:1.0:1746143842.334689:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625057152 00010000:00010000:1.0:1746143842.334717:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.334755:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8142 00000100:00100000:1.0:1746143842.334762:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625057152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.334782:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.334801:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.334812:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.334833:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a45c00/0x87925e4cb73b5791 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e41 expref: 36 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.335394:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.335397:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.335405:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.335414:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.335446:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.335458:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627493248:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.335805:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.337947:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627493248:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.337966:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.338005:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625057152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3243us (3394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.338015:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8142 00000100:00100000:0.0:1746143842.338403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.338766:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625057408 00000100:00100000:3.0:1746143842.338773:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625057408 00002000:00100000:3.0:1746143842.338813:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2912256->2916351) req@ffff88012e35ad80 x1830963625057408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.338823:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963625057408 ext(2912256->2916351) 00002000:00010000:3.0:1746143842.338828:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35ad80 00000100:00100000:3.0:1746143842.338844:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7272 00000100:00100000:3.0:1746143842.338851:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625057408:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143842.339007:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625057408:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 156us (604us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.339014:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7272 00002000:00100000:3.0:1746143842.339019:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2912256->2916351) req@ffff88012e35ad80 x1830963625057408/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.339035:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963625057408 ext(2912256->2916351) 00002000:00010000:3.0:1746143842.339038:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35ad80 00000100:00100000:0.0:1746143842.341826:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.341856:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625057664 00000100:00100000:2.0:1746143842.341866:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625057664 00002000:00100000:2.0:1746143842.341945:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3055616->3059711) req@ffff8800921cc700 x1830963625057664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.341963:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963625057664 ext(3055616->3059711) 00002000:00010000:2.0:1746143842.341968:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:3.0:1746143842.342474:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7273 00000100:00100000:3.0:1746143842.342484:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625057664:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143842.342682:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625057664:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 199us (864us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.342689:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7273 00002000:00100000:3.0:1746143842.342695:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3055616->3059711) req@ffff8800921cc700 x1830963625057664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.342702:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963625057664 ext(3055616->3059711) 00002000:00010000:3.0:1746143842.342705:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:0.0:1746143842.361886:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.362007:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625057792 00000100:00100000:0.0:1746143842.362012:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.362018:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625057792 00000100:00100000:1.0:1746143842.362069:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625057920 00000100:00100000:1.0:1746143842.362071:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625057920 00000100:00100000:3.0:1746143842.362124:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16664 00000100:00100000:3.0:1746143842.362136:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625057792:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143842.362151:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16665 00000100:00100000:1.0:1746143842.362158:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625057920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.362159:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.362172:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.362177:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e6b expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.362185:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e72 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.362226:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493376:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143842.362343:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.362346:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.362355:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.362372:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 23 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143842.362381:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143842.362383:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504e00, rc 0) 00000100:00100000:3.0:1746143842.362424:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625057792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 291us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.362431:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16664 00000100:00100000:1.0:1746143842.363945:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493376:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143842.363978:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e72 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.363988:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e72 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.364013:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049e00, rc 0) 00000100:00100000:1.0:1746143842.364045:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625057920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1887us (2032us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143842.364055:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16665 00000100:00100000:0.0:1746143842.365451:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.365522:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.365596:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058176 00000100:00100000:1.0:1746143842.365605:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058176 00000100:00080000:1.0:1746143842.365633:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746143842.365684:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1212 00000100:00100000:1.0:1746143842.365692:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963625058176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143842.365747:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963625058176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.365753:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1212 00000100:00100000:2.0:1746143842.365947:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058048 00000100:00100000:2.0:1746143842.365952:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058048 00000100:00100000:2.0:1746143842.365984:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 241 00000100:00100000:2.0:1746143842.365989:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a42af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963625058048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143842.366013:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a42af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963625058048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.366019:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 241 00000100:00100000:3.0:1746143842.366645:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.366675:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.366735:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058432 00000100:00100000:2.0:1746143842.366740:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058432 00000100:00100000:1.0:1746143842.366752:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058304 00000100:00100000:1.0:1746143842.366755:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058304 00000100:00100000:2.0:1746143842.366852:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1213 00000100:00100000:2.0:1746143842.366859:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2008:x1830963625058432:12345-192.168.202.3@tcp:400:kworker.0 00000100:00080000:0.0:1746143842.367041:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746143842.367134:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2008:x1830963625058432:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 275us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.367141:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1213 00000100:00100000:1.0:1746143842.367148:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1214 00000100:00100000:1.0:1746143842.367161:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2009:x1830963625058304:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1746143842.367186:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2009:x1830963625058304:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 32us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.367190:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1214 00000100:00100000:0.0:1746143842.373721:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.373800:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058688 00000100:00100000:3.0:1746143842.373811:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058688 00002000:00100000:3.0:1746143842.373860:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880129dc1880 x1830963625058688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.373870:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1880 with x1830963625058688 ext(2097152->3145727) 00002000:00010000:3.0:1746143842.373875:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1880 00000100:00100000:3.0:1746143842.373948:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7274 00000100:00100000:3.0:1746143842.373955:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625058688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.380595:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625058688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6629us (6871us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.380610:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7274 00002000:00100000:3.0:1746143842.380625:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880129dc1880 x1830963625058688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.380635:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc1880 with x1830963625058688 ext(2097152->3145727) 00002000:00010000:3.0:1746143842.380641:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc1880 00000100:00100000:0.0:1746143842.385217:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.385339:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058816 00000100:00100000:1.0:1746143842.385350:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058816 00000100:00100000:1.0:1746143842.385409:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16666 00000100:00100000:1.0:1746143842.385418:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2834:x1830963625058816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.385438:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.385459:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e79 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.385498:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.385506:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.385508:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.385511:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.385542:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 34 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.385554:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 34 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.385566:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.385671:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.387844:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.387872:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.387890:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049e00, rc 0) 00000100:00100000:1.0:1746143842.387966:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2834:x1830963625058816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2548us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.387975:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16666 00000100:00100000:0.0:1746143842.388116:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.388397:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625058944 00000100:00100000:3.0:1746143842.388405:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625058944 00002000:00100000:3.0:1746143842.388443:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2912256->3059711) req@ffff880129dc0000 x1830963625058944/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.388452:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0000 with x1830963625058944 ext(2912256->3059711) 00010000:00010000:3.0:1746143842.388459:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.388471:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143842.388477:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc0000 00000100:00100000:3.0:1746143842.388495:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2690 00000100:00100000:3.0:1746143842.388501:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625058944:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143842.393716:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625058944:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5206us (5593us total) trans 21474841244 rc 0/0 00000100:00100000:3.0:1746143842.393728:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2690 00002000:00100000:3.0:1746143842.393739:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2912256->3059711) req@ffff880129dc0000 x1830963625058944/t21474841244(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.393748:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc0000 with x1830963625058944 ext(2912256->3059711) 00010000:00010000:3.0:1746143842.393757:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.393776:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143842.393783:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129dc0000 00000100:00100000:0.0:1746143842.396822:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.397165:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625059072 00000100:00100000:1.0:1746143842.397174:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625059072 00010000:00010000:1.0:1746143842.397204:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.397864:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8143 00000100:00100000:1.0:1746143842.397872:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625059072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.397884:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.397900:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.397936:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.397957:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b57c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3059711) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e64 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.397972:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.397973:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.397979:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.397986:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.398012:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 23 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.398022:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627493632:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.401626:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.403393:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627493632:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.403411:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.403445:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625059072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5574us (6630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.403454:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8143 00000100:00100000:0.0:1746143842.409520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.410945:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625059328 00000100:00100000:3.0:1746143842.410956:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625059328 00002000:00100000:3.0:1746143842.410997:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096e54380 x1830963625059328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.411007:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54380 with x1830963625059328 ext(2097152->4194303) 00002000:00010000:3.0:1746143842.411012:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e54380 00000100:00100000:3.0:1746143842.411042:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7275 00000100:00100000:3.0:1746143842.411049:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625059328:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143842.412729:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.413174:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625059584 00000100:00100000:2.0:1746143842.413186:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625059584 00002000:00100000:2.0:1746143842.413765:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb4a80 x1830963625059584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.413775:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963625059584 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.413781:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4a80 00000100:00100000:2.0:1746143842.413820:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7276 00000100:00100000:2.0:1746143842.413829:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625059584:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143842.427333:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625059328:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 16268us (17803us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143842.427346:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7275 00002000:00100000:3.0:1746143842.427357:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880096e54380 x1830963625059328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.427365:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54380 with x1830963625059328 ext(2097152->4194303) 00002000:00010000:3.0:1746143842.427370:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e54380 00000100:00100000:2.0:1746143842.433241:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625059584:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 19407us (20509us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.433250:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7276 00002000:00100000:2.0:1746143842.433260:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095cb4a80 x1830963625059584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.433268:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963625059584 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.433272:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb4a80 00000100:00100000:0.0:1746143842.437118:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.437676:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625059840 00000100:00100000:2.0:1746143842.437684:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625059840 00002000:00100000:2.0:1746143842.437722:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88009e493b80 x1830963625059840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.437732:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493b80 with x1830963625059840 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.437736:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493b80 00000100:00100000:2.0:1746143842.437770:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7277 00000100:00100000:2.0:1746143842.437777:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625059840:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143842.438514:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.439011:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625059968 00000100:00100000:0.0:1746143842.439015:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625059968 00000100:00100000:0.0:1746143842.439042:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16667 00000100:00100000:0.0:1746143842.439047:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2836:x1830963625059968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143842.439056:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.439069:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e80 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.439092:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.439098:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.439100:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.439103:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3989504->4079615] (req 3989504->4079615) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.439126:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.439138:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 25 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143842.441934:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493760:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.442025:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.452997:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627493760:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.453011:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143842.453026:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3989504->4079615] (req 3989504->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 25 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.453043:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53400, rc 0) 00000100:00100000:0.0:1746143842.453048:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625060096 00000100:00100000:0.0:1746143842.453053:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625060096 00010000:00010000:0.0:1746143842.453076:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 26 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.453077:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2836:x1830963625059968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14030us (14564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.453085:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16667 00000100:00100000:0.0:1746143842.453112:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8144 00000100:00100000:0.0:1746143842.453118:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625060096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.453128:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.453145:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 25 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.453154:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 25 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.453179:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b57d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e79 expref: 25 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.453194:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.453195:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.453200:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.453208:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.453361:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.453373:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627493888:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.453425:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.453683:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625059840:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 15906us (16578us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746143842.453691:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7277 00002000:00100000:2.0:1746143842.453699:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88009e493b80 x1830963625059840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 655360/655360 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.453706:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493b80 with x1830963625059840 ext(4194304->4849663) 00002000:00010000:2.0:1746143842.453710:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e493b80 00000100:00100000:0.0:1746143842.459576:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627493888:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143842.459595:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.459636:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.459646:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625060096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6527us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.459655:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8144 00000100:00100000:3.0:1746143842.459744:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625060352 00000100:00100000:3.0:1746143842.459750:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625060352 00002000:00100000:3.0:1746143842.459783:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3989504->3993599) req@ffff880095cb4380 x1830963625060352/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.459791:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4380 with x1830963625060352 ext(3989504->3993599) 00002000:00010000:3.0:1746143842.459796:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4380 00000100:00100000:3.0:1746143842.459824:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7278 00000100:00100000:3.0:1746143842.459830:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625060352:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143842.459959:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625060352:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 129us (323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.459964:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7278 00002000:00100000:3.0:1746143842.459969:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3989504->3993599) req@ffff880095cb4380 x1830963625060352/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.459975:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4380 with x1830963625060352 ext(3989504->3993599) 00002000:00010000:3.0:1746143842.459978:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4380 00000100:00100000:0.0:1746143842.473186:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.476218:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625060608 00000100:00100000:2.0:1746143842.476231:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625060608 00002000:00100000:2.0:1746143842.476277:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (4075520->4079615) req@ffff88009e493800 x1830963625060608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.476288:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493800 with x1830963625060608 ext(4075520->4079615) 00002000:00010000:2.0:1746143842.476293:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e493800 00000100:00100000:2.0:1746143842.476341:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7279 00000100:00100000:2.0:1746143842.476348:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625060608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.476484:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625060608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 136us (3304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.476490:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7279 00002000:00100000:2.0:1746143842.476496:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (4075520->4079615) req@ffff88009e493800 x1830963625060608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.476502:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e493800 with x1830963625060608 ext(4075520->4079615) 00002000:00010000:2.0:1746143842.476505:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e493800 00000100:00100000:0.0:1746143842.500622:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.500945:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625060736 00000100:00100000:1.0:1746143842.500952:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625060736 00000100:00100000:1.0:1746143842.501591:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16668 00000100:00100000:1.0:1746143842.501600:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2840:x1830963625060736:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.501615:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.501631:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e87 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.501654:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.501663:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 23 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.501670:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.501677:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.501678:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.501681:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1236992->1511423] (req 1236992->1511423) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.501707:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 9 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.501718:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 9 pid: 3135 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.501728:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627494016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.503352:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 23 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.503363:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 23 pid: 13436 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.503374:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627494144:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.504004:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.504012:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.504020:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627494272:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.504495:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.506598:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627494016:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.508068:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.508097:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.508417:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627494144:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.508427:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627494272:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.508455:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1236992->1511423] (req 1236992->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.508476:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:1.0:1746143842.508525:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2840:x1830963625060736:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6926us (7907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.508532:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16668 00000100:00100000:3.0:1746143842.508621:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625060864 00000100:00100000:3.0:1746143842.508627:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625060864 00010000:00010000:3.0:1746143842.508669:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 10 pid: 3135 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.508697:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625060992 00000100:00100000:3.0:1746143842.508699:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625060992 00010000:00010000:3.0:1746143842.508708:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.508722:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8145 00000100:00100000:3.0:1746143842.508728:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625060864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143842.508729:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8146 00000100:00100000:2.0:1746143842.508738:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625060992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.508739:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.508745:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.508755:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 10 pid: 3135 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.508755:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143842.508764:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 10 pid: 3135 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.508775:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143842.508851:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5641 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d61 expref: 10 pid: 3135 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143842.508867:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143842.508869:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085a00/0x87925e4cb73b56d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dbc expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.508885:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625060864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 157us (821us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143842.508885:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.508891:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8145 00000100:00100000:2.0:1746143842.508903:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625060992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 168us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.508909:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8146 00000100:00080000:1.0:1746143842.509055:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143842.509460:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.509543:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625061120 00000100:00100000:2.0:1746143842.509547:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625061120 00010000:00010000:2.0:1746143842.509560:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.510180:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8147 00000100:00100000:3.0:1746143842.510188:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625061120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.510196:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.510203:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.510213:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.510225:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b5602 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d30 expref: 37 pid: 3135 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.510238:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.510240:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.510249:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.510256:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.510280:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 36 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.510290:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627494400:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143842.510468:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.512321:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627494400:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143842.512344:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.512347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.512378:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625061120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2191us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.512386:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8147 00000100:00100000:2.0:1746143842.512392:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625061376 00000100:00100000:2.0:1746143842.512397:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625061376 00002000:00100000:2.0:1746143842.512424:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1236992->1241087) req@ffff8800939a7100 x1830963625061376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.512432:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7100 with x1830963625061376 ext(1236992->1241087) 00002000:00010000:2.0:1746143842.512436:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7100 00000100:00100000:2.0:1746143842.512450:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7280 00000100:00100000:2.0:1746143842.512456:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625061376:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143842.512647:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625061376:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 190us (299us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.512653:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7280 00002000:00100000:2.0:1746143842.512658:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1236992->1241087) req@ffff8800939a7100 x1830963625061376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.512666:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7100 with x1830963625061376 ext(1236992->1241087) 00002000:00010000:2.0:1746143842.512668:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7100 00000100:00100000:0.0:1746143842.519488:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.519538:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625061632 00000100:00100000:2.0:1746143842.519546:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625061632 00002000:00100000:2.0:1746143842.519580:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1507328->1511423) req@ffff88007f649500 x1830963625061632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.519589:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963625061632 ext(1507328->1511423) 00002000:00010000:2.0:1746143842.519593:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:2.0:1746143842.521277:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7281 00000100:00100000:2.0:1746143842.521290:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625061632:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143842.521428:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625061632:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 142us (1946us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143842.521434:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7281 00002000:00100000:2.0:1746143842.521439:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1507328->1511423) req@ffff88007f649500 x1830963625061632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.521447:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963625061632 ext(1507328->1511423) 00002000:00010000:2.0:1746143842.521450:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:0.0:1746143842.539194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.539368:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625061760 00000100:00100000:2.0:1746143842.539376:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625061760 00000100:00100000:2.0:1746143842.539430:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14015 00000100:00100000:2.0:1746143842.539438:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2843:x1830963625061760:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143842.539459:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.539473:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b57ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e8e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.539522:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539535:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539543:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539554:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539559:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539563:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539619:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539628:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.539634:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.539639:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.539663:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.539673:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.539688:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627494528:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.539774:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.539781:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 33 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.539788:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627494656:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.540842:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.541219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.541247:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062016 00000100:00100000:0.0:1746143842.541251:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062016 00000100:00100000:0.0:1746143842.541281:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5435 00000100:00100000:0.0:1746143842.541286:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:26343:x1830963625062016:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143842.541420:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:26343:x1830963625062016:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 133us (202us total) trans 8589945085 rc 0/0 00000100:00100000:0.0:1746143842.541425:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5435 00000100:00100000:3.0:1746143842.541638:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627494528:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.543344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.543397:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062144 00000100:00100000:2.0:1746143842.543404:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062144 00010000:00010000:2.0:1746143842.543431:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.543466:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8148 00000100:00100000:2.0:1746143842.543472:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:2008:x1830963625062144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.543483:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.543487:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.543496:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.543513:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b57b4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e5d expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.543664:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.543668:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.543676:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.543679:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.543683:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.544133:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:2008:x1830963625062144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 659us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.544140:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8148 00000100:00100000:0.0:1746143842.544876:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.545101:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062400 00000100:00100000:1.0:1746143842.545107:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062400 00000100:00100000:1.0:1746143842.545134:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5436 00000100:00100000:1.0:1746143842.545140:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+34:30658:x1830963625062400:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143842.545285:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+35:30658:x1830963625062400:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 146us (410us total) trans 8589945086 rc 0/0 00000100:00100000:1.0:1746143842.545291:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5436 00000100:00100000:3.0:1746143842.545514:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627494656:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.545535:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143842.547411:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.547523:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062528 00000100:00100000:2.0:1746143842.547529:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062528 00010000:00010000:2.0:1746143842.547554:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 35 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.547575:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8149 00000100:00100000:2.0:1746143842.547582:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625062528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.547593:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.547598:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 35 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.547608:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 35 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.547630:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b5775 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e2c expref: 35 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.547641:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.547644:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.547652:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.547659:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.547688:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.547730:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963625062528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 148us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.547736:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8149 00010000:00010000:3.0:1746143842.547774:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.547783:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143842.547887:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143842.547891:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143842.547907:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548067:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548077:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548082:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548087:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548092:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548097:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7ea00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143842.548100:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548106:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548114:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143842.548116:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143842.548119:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548124:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ea00/0x87925e4cb73b57f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548146:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548154:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548158:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548162:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7fc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143842.548164:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548169:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548174:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008219e600) 00010000:00010000:3.0:1746143842.548176:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143842.548178:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548182:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b57fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.548205:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b57ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.548213:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.548218:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.548220:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143842.548222:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad35800, rc 0) 00000100:00100000:3.0:1746143842.548255:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2843:x1830963625061760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8818us (9068us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.548261:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14015 00000100:00100000:0.0:1746143842.550848:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.550879:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.551065:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.551123:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062656 00000100:00100000:1.0:1746143842.551130:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062656 00000100:00100000:1.0:1746143842.551158:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062784 00000100:00100000:1.0:1746143842.551160:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062784 00000100:00100000:1.0:1746143842.551177:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625062912 00000100:00100000:1.0:1746143842.551179:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625062912 00000100:00100000:1.0:1746143842.551195:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16669 00000100:00100000:1.0:1746143842.551201:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625062656:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143842.551214:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.551228:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5808 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e95 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.551535:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16670 00000100:00100000:3.0:1746143842.551543:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625062784:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.551551:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.551561:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411e9c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.551578:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.551580:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.551587:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.551600:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.551609:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504800, rc 0) 00000100:00100000:3.0:1746143842.551642:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625062784:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 101us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.551647:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16670 00000100:00100000:3.0:1746143842.551661:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16671 00000100:00100000:3.0:1746143842.551665:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625062912:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.551670:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.551676:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73b5816 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ea3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.551717:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627494784:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143842.551760:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00080000:0.0:1746143842.551816:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143842.551880:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627494912:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143842.551903:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.553251:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627494912:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143842.553271:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5808 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e95 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.553281:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5808 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e95 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143842.553428:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627494784:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143842.553444:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73b5816 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ea3 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.553452:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73b5816 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ea3 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.553459:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504400, rc 0) 00010000:00010000:1.0:1746143842.553643:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717600, rc 0) 00000100:00100000:3.0:1746143842.553721:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625062912:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2054us (2655us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143842.553727:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16671 00000100:00100000:1.0:1746143842.553739:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625062656:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2537us (2896us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143842.553745:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16669 00000100:00100000:0.0:1746143842.556814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.556866:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625063168 00000100:00100000:3.0:1746143842.556874:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625063168 00000100:00100000:3.0:1746143842.556945:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14016 00000100:00100000:3.0:1746143842.556952:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2843:x1830963625063168:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.556966:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.556980:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b581d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411eaa expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.557063:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.557076:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.557082:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.557106:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.557116:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 18 pid: 7244 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.557126:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627495040:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.557999:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.560320:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627495040:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.560355:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143842.562237:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.562361:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625063296 00000100:00100000:2.0:1746143842.562367:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625063296 00010000:00010000:2.0:1746143842.562398:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 19 pid: 7244 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.562421:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8150 00000100:00100000:2.0:1746143842.562427:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2008:x1830963625063296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.562438:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.562443:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 19 pid: 7244 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.562462:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 19 pid: 7244 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.562481:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b5801 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e8e expref: 19 pid: 7244 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.562509:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.562512:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.562520:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.562526:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.562555:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.562601:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2008:x1830963625063296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 173us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.562607:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8150 00010000:00010000:0.0:1746143842.562668:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143842.562675:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143842.562690:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143842.562954:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ec00/0x87925e4cb73b581d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eaa expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.562976:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eaa expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.562982:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143842.562984:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143842.562986:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fc00, rc 0) 00000100:00100000:1.0:1746143842.563071:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2843:x1830963625063168:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6118us (6261us total) trans 8589945087 rc 0/0 00000100:00100000:1.0:1746143842.563078:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14016 00000100:00100000:1.0:1746143842.569175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.569226:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.569243:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625063424 00000100:00100000:3.0:1746143842.569251:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625063424 00000100:00100000:0.0:1746143842.569271:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625063552 00000100:00100000:0.0:1746143842.569276:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625063552 00000100:00100000:3.0:1746143842.569299:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16672 00000100:00100000:3.0:1746143842.569305:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625063424:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143842.569306:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16673 00000100:00100000:0.0:1746143842.569311:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625063552:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.569320:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.569320:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.569343:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73b5832 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411eb1 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.569343:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73b5839 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411eb8 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.569383:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627495296:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143842.569383:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627495168:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143842.569462:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.569467:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.572466:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800931c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627495168:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143842.572493:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73b5839 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eb8 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.572516:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ecd800/0x87925e4cb73b5839 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eb8 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.572542:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ecd800, rc 0) 00000100:00100000:2.0:1746143842.572589:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625063552:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3276us (3362us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143842.572600:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16673 00000100:00100000:2.0:1746143842.572650:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627495296:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143842.572663:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73b5832 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eb1 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.572670:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e504400/0x87925e4cb73b5832 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eb1 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.572676:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504400, rc 0) 00000100:00100000:2.0:1746143842.572692:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625063424:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3388us (3525us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143842.572697:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16672 00000100:00100000:0.0:1746143842.575767:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.576095:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625063808 00000100:00100000:1.0:1746143842.576104:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625063808 00000100:00100000:1.0:1746143842.576156:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14017 00000100:00100000:1.0:1746143842.576164:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2843:x1830963625063808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143842.576184:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.576187:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746143842.576207:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b5824 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411eaa expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.576230:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.576234:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143842.576243:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73b5840 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ebf expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.576421:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5847 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.576432:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5847 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.576440:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5847 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143842.576449:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143842.576517:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093716c00/0x87925e4cb73b5840 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ebf expref: 20 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.576527:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5847 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ebf expref: 19 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.576532:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.576534:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143842.576536:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717600, rc 0) 00000100:00100000:1.0:1746143842.576572:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2843:x1830963625063808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 409us (812us total) trans 8589945088 rc 0/0 00000100:00100000:1.0:1746143842.576577:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14017 00000100:00100000:0.0:1746143842.580038:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.580068:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.580093:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.580105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.580116:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.580139:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.580192:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625063936 00000100:00100000:2.0:1746143842.580199:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625063936 00000100:00100000:2.0:1746143842.580242:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064064 00000100:00100000:2.0:1746143842.580244:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064064 00000100:00100000:2.0:1746143842.580257:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064192 00000100:00100000:2.0:1746143842.580259:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064192 00000100:00100000:2.0:1746143842.580267:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064320 00000100:00100000:2.0:1746143842.580269:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064320 00000100:00100000:2.0:1746143842.580277:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064448 00000100:00100000:2.0:1746143842.580278:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064448 00000100:00100000:2.0:1746143842.580286:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064576 00000100:00100000:2.0:1746143842.580288:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064576 00000100:00100000:2.0:1746143842.580299:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16674 00000100:00100000:2.0:1746143842.580305:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625063936:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143842.580355:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580371:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580379:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580386:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 42 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580392:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.580393:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.580396:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580420:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 42 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580430:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 42 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.580441:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627495424:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.580505:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580517:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 22 pid: 9586 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.580524:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627495552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.580545:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 13 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580551:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 13 pid: 9586 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.580559:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627495680:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.580572:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.580587:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16675 00000100:00100000:2.0:1746143842.580593:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625064064:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143842.580609:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580618:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580625:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580631:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580637:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.580639:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.580641:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580653:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580660:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 11 pid: 3135 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.580668:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627495808:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.580689:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 22 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580697:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 22 pid: 9586 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.580704:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627495936:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.580722:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580729:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 35 pid: 3135 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.580740:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627496064:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.580754:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.580768:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16676 00000100:00100000:2.0:1746143842.580773:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625064192:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143842.580787:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580795:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580801:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.580802:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.580804:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580816:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 35 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580823:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.580830:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627496192:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.580845:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.580857:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16677 00000100:00100000:2.0:1746143842.580862:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625064320:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143842.580876:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580884:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580891:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580898:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580902:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.580903:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.580905:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.580940:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580947:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.580954:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627496320:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.580974:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16678 00000100:00100000:1.0:1746143842.580982:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625064448:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143842.580985:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.580995:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 22 pid: 13436 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.580995:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.581002:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627496448:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.581004:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.581010:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.581016:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.581018:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.581025:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 42 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.581026:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.581031:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627496576:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.581033:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.581037:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746143842.581038:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746143842.581040:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd26c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746143842.581040:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.581053:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16679 00000100:00100000:2.0:1746143842.581057:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625064576:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143842.581060:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.581067:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 42 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.581070:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.581074:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627496704:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.581077:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.581081:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.581082:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.581084:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.581099:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 22 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.581099:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.581106:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.581109:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 22 pid: 1947 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.581113:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627496832:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.581116:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627496960:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.581124:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2240 going to sleep for 11 seconds 00010000:00010000:1.0:1746143842.581135:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.581142:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 22 pid: 13430 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.581148:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627497088:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.581169:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.581176:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 13 pid: 9585 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.581181:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627497216:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.581208:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 42 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.581215:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 42 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.581222:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627497344:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.581239:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbea80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.586108:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627495424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.586118:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627495552:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.586125:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627495680:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.586148:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.590412:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627495808:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.590426:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627495936:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.590433:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627496064:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.590456:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.592108:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627496192:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.592124:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.592340:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627496704:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.592422:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627496448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.592429:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627496576:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.592648:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.592749:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627496832:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.592764:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.592818:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094197100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627496960:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.592825:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627497088:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.592831:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627497216:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.592871:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.592892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.592904:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.592927:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.592957:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064960 00000100:00100000:3.0:1746143842.592962:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064960 00010000:00010000:3.0:1746143842.592986:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 43 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.593004:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065472 00000100:00100000:3.0:1746143842.593006:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065472 00010000:00010000:3.0:1746143842.593013:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 36 pid: 3135 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.593021:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065600 00000100:00100000:3.0:1746143842.593023:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065600 00010000:00010000:3.0:1746143842.593029:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 44 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.593039:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8151 00000100:00100000:3.0:1746143842.593044:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625064960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.593055:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.593070:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 44 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143842.593078:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 44 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:3.0:1746143842.593095:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086c00/0x87925e4cb73b4fb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411971 expref: 44 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:0.0:1746143842.593136:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8152 00000100:00100000:0.0:1746143842.593141:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625065472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.593147:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.593156:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 36 pid: 3135 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.593167:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 36 pid: 3135 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.593177:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b55fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d29 expref: 36 pid: 3135 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.593278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593289:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593307:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593334:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593353:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593360:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593368:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593407:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.593428:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627497344:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.593448:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.593467:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064832 00000100:00100000:1.0:1746143842.593470:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064832 00010000:00010000:1.0:1746143842.593479:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 12 pid: 3135 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593488:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065344 00000100:00100000:1.0:1746143842.593489:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065344 00010000:00010000:1.0:1746143842.593494:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 23 pid: 9586 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593505:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065984 00000100:00100000:1.0:1746143842.593506:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065984 00010000:00010000:1.0:1746143842.593512:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 44 pid: 13430 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.593517:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066240 00000100:00100000:1.0:1746143842.593518:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066240 00010000:00010000:1.0:1746143842.593524:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 14 pid: 9585 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593529:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066496 00000100:00100000:1.0:1746143842.593530:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066496 00010000:00010000:1.0:1746143842.593535:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 45 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.593540:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625064704 00000100:00100000:1.0:1746143842.593542:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625064704 00010000:00010000:1.0:1746143842.593546:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 15 pid: 9586 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593553:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065216 00000100:00100000:1.0:1746143842.593554:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065216 00010000:00010000:1.0:1746143842.593559:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 23 pid: 9586 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593565:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065728 00000100:00100000:1.0:1746143842.593566:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065728 00010000:00010000:1.0:1746143842.593570:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593577:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066112 00000100:00100000:1.0:1746143842.593579:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066112 00010000:00010000:1.0:1746143842.593584:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 25 pid: 1947 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.593589:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066368 00000100:00100000:1.0:1746143842.593590:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066368 00010000:00010000:1.0:1746143842.593595:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 16 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593600:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066624 00000100:00100000:1.0:1746143842.593601:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066624 00010000:00010000:1.0:1746143842.593606:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 26 pid: 13430 timeout: 1001 lvb_type: 1 00000100:00100000:1.0:1746143842.593613:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8153 00000100:00100000:1.0:1746143842.593616:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963625065600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.593621:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.593629:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 45 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593635:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 45 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593645:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087800/0x87925e4cb73b56fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411de6 expref: 45 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593661:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.593687:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625065600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.593691:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8153 00000100:00100000:1.0:1746143842.593702:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8154 00000100:00100000:1.0:1746143842.593705:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625064832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.593711:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.593716:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 12 pid: 3135 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593722:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 12 pid: 3135 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593730:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5656 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d5a expref: 12 pid: 3135 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593737:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.593745:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625064832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 40us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.593749:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8154 00000100:00100000:1.0:1746143842.593755:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8155 00000100:00100000:1.0:1746143842.593759:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625065344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.593763:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.593767:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 26 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593774:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 26 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593781:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d428000/0x87925e4cb73b5028 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119b7 expref: 26 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593787:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.593795:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625065344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 36us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.593799:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8155 00000100:00100000:1.0:1746143842.593805:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8156 00000100:00100000:1.0:1746143842.593808:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625065984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.593812:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.593819:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593826:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593835:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107600/0x87925e4cb73b5617 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d45 expref: 43 pid: 13430 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593843:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.593856:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625065984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.593863:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8156 00000100:00100000:1.0:1746143842.593871:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8157 00000100:00100000:1.0:1746143842.593874:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625066240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.593879:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.593884:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 16 pid: 9585 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593890:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 16 pid: 9585 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593898:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504800/0x87925e4cb73b580f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e9c expref: 16 pid: 9585 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.593904:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.593930:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625066240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.593934:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8157 00000100:00100000:1.0:1746143842.593941:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8158 00000100:00100000:1.0:1746143842.593944:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625066496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.593949:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.593954:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 41 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593960:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 41 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593971:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b57a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e56 expref: 41 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.593977:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.593987:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625066496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 42us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.593991:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8158 00000100:00100000:1.0:1746143842.593997:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8159 00000100:00100000:1.0:1746143842.594001:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625064704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.594006:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.594010:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 14 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594017:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 14 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594025:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c529600/0x87925e4cb73b4f10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411939 expref: 14 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594032:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594033:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594036:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594043:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594062:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.594072:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625064704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 71us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594076:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8159 00000100:00100000:1.0:1746143842.594083:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8160 00000100:00100000:1.0:1746143842.594087:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625065216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.594093:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.594097:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 23 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594104:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 23 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594112:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e521a00/0x87925e4cb73b56cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411db5 expref: 23 pid: 9586 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594117:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594119:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594121:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594126:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594135:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.594144:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625065216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594149:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8160 00000100:00100000:1.0:1746143842.594163:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8161 00000100:00100000:1.0:1746143842.594166:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625065728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.594171:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.594176:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594184:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594193:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084a00/0x87925e4cb73b56e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411dc3 expref: 24 pid: 13436 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594200:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.594209:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625065728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 42us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594214:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8161 00000100:00100000:1.0:1746143842.594222:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8162 00000100:00100000:1.0:1746143842.594226:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625066112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.594232:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.594238:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 22 pid: 1947 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.594244:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 22 pid: 1947 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.594255:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b50ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [4849664->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a58 expref: 22 pid: 1947 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.594262:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.594271:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136337800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625066112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594275:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8162 00000100:00100000:1.0:1746143842.594283:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8163 00000100:00100000:1.0:1746143842.594287:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625066368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.594291:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.594296:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 12 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594302:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 12 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594309:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594311:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594313:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594318:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594339:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.594349:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625066368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594354:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8163 00000100:00100000:1.0:1746143842.594363:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8164 00000100:00100000:1.0:1746143842.594367:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625066624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.594373:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.594378:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 20 pid: 13430 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594385:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 20 pid: 13430 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594393:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e504e00/0x87925e4cb73b57c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e6b expref: 20 pid: 13430 timeout: 1001 lvb_type: 1 00010000:00010000:1.0:1746143842.594399:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594400:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.594402:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594407:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594417:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.594426:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625066624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 58us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594430:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8164 00010000:00010000:1.0:1746143842.594449:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594457:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594469:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594475:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594480:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594485:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143842.594489:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594495:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594504:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594509:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b585c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.594534:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625064064:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13941us (14465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594541:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16675 00010000:00010000:1.0:1746143842.594557:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594563:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594572:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594577:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594582:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594587:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093717e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143842.594589:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594595:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594603:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.594607:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717e00/0x87925e4cb73b5871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.594637:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625064448:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13657us (14520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.594642:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16678 00010000:00010000:3.0:1746143842.595062:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.595081:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625064960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2036us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.595087:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8151 00010000:00010000:3.0:1746143842.595125:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b5648 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d68 expref: 10 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.595133:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627496320:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.595147:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595153:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595157:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595167:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595172:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595181:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595186:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.595189:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595194:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595201:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595206:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a2c00/0x87925e4cb73b586a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.595231:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625064320:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 14368us (15124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.595235:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16677 00010000:00010000:3.0:1746143842.595253:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595259:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595268:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595274:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595279:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595284:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801321a4200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.595286:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595291:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595297:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.595303:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801321a4200/0x87925e4cb73b5855 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.595335:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625063936:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 15029us (15303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.595339:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16674 00010000:00010000:0.0:1746143842.595434:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.595457:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625065472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2316us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.595463:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8152 00000100:00100000:2.0:1746143842.595557:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065088 00000100:00100000:2.0:1746143842.595563:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065088 00000100:00100000:2.0:1746143842.595576:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625065856 00000100:00100000:2.0:1746143842.595577:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625065856 00002000:00100000:2.0:1746143842.595600:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3989504->4079615) req@ffff88009391ea00 x1830963625065856/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.595608:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963625065856 ext(3989504->4079615) 00010000:00010000:2.0:1746143842.595613:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.595622:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 22 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.595627:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391ea00 00000100:00100000:2.0:1746143842.595652:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2691 00000100:00100000:2.0:1746143842.595658:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625065856:12345-192.168.202.3@tcp:4:cat.0 00002000:00100000:2.0:1746143842.595733:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1236992->1511423) req@ffff88009719ce00 x1830963625065088/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.595740:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ce00 with x1830963625065088 ext(1236992->1511423) 00010000:00010000:2.0:1746143842.595745:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.595753:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 35 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.595758:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009719ce00 00000100:00100000:2.0:1746143842.595775:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2692 00000100:00100000:2.0:1746143842.595780:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625065088:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143842.603862:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625065856:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8196us (10925us total) trans 21474841245 rc 0/0 00000100:00100000:2.0:1746143842.603874:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2691 00002000:00100000:2.0:1746143842.603884:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3989504->4079615) req@ffff88009391ea00 x1830963625065856/t21474841245(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.603892:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963625065856 ext(3989504->4079615) 00010000:00010000:2.0:1746143842.603901:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.604138:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:2.0:1746143842.604147:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009391ea00 00000100:00100000:3.0:1746143842.605248:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625065088:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9464us (12597us total) trans 21474841246 rc 0/0 00000100:00100000:3.0:1746143842.605256:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2692 00002000:00100000:3.0:1746143842.605263:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1236992->1511423) req@ffff88009719ce00 x1830963625065088/t21474841246(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.605270:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ce00 with x1830963625065088 ext(1236992->1511423) 00010000:00010000:3.0:1746143842.605276:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.605284:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00002000:00010000:3.0:1746143842.605290:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009719ce00 00000100:00100000:0.0:1746143842.606022:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.606155:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066752 00000100:00100000:1.0:1746143842.606162:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066752 00010000:00010000:1.0:1746143842.606183:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.606205:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8165 00000100:00100000:1.0:1746143842.606211:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625066752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.606222:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.606235:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.606244:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.606262:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53400/0x87925e4cb73b57de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3989504->4079615) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e80 expref: 24 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.606276:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.606278:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.606282:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.606289:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.606308:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143842.606312:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.606321:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.606348:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.606350:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625066752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 139us (330us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143842.606354:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.606357:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8165 00010000:00010000:3.0:1746143842.606361:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.606366:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7ce00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.606369:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.606377:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.606386:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.606391:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b5878 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.607036:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625064576:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 25977us (26895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.607043:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16679 00000100:00100000:0.0:1746143842.607074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.607110:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625066880 00000100:00100000:2.0:1746143842.607114:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625066880 00010000:00010000:2.0:1746143842.607130:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.607147:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8166 00000100:00100000:2.0:1746143842.607152:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963625066880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.607159:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.607166:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.607188:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.607202:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b57e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e87 expref: 37 pid: 9586 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.607220:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.607221:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.607226:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.607232:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.607244:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143842.607315:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607337:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607348:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607355:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607360:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607369:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.607372:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607377:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607385:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.607390:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b5863 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.607433:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625064192:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 26659us (27339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.607439:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16676 00000100:00100000:2.0:1746143842.607497:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625066880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 343us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.607503:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8166 00000100:00100000:0.0:1746143842.609823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.610002:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625067136 00000100:00100000:1.0:1746143842.610010:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625067136 00000100:00100000:1.0:1746143842.610048:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14018 00000100:00100000:1.0:1746143842.610054:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2843:x1830963625067136:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:1.0:1746143842.610161:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746143842.610180:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b5695 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d8b expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610241:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c800/0x87925e4cb73b5672 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411d84 expref: 18 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610249:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.610252:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143842.610272:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.610281:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610288:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 287 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610293:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610299:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 33 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610305:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610310:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 33 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610316:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610321:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 10/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.610355:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610365:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.610376:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497472:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.610905:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 33 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.610933:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 33 pid: 14991 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.610945:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497600:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.611710:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 287 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.611719:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.611726:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497728:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.611768:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 33 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.611775:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 33 pid: 10936 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.611781:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497856:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.611799:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.611805:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 33 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.611810:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497984:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.611827:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 287 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.611836:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 287 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.611842:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627498112:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.611858:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.611864:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 33 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.611869:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627498240:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.611879:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.613820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.613865:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625067392 00000100:00100000:2.0:1746143842.613873:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625067392 00000100:00100000:2.0:1746143842.613929:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5437 00000100:00100000:2.0:1746143842.613936:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e24a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:26343:x1830963625067392:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143842.613950:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497472:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.613958:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497600:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.613965:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497728:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.614603:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e24a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:26343:x1830963625067392:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 665us (784us total) trans 8589945089 rc 0/0 00000100:00100000:2.0:1746143842.614611:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5437 00000100:00100000:0.0:1746143842.614783:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.614861:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.614935:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.614968:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625067776 00000100:00100000:0.0:1746143842.614972:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625067776 00010000:00010000:0.0:1746143842.614991:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143842.615009:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068032 00000100:00100000:0.0:1746143842.615011:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068032 00010000:00010000:0.0:1746143842.615020:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 34 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:0.0:1746143842.615037:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8167 00000100:00100000:0.0:1746143842.615042:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:2008:x1830963625067776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.615049:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.615054:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.615062:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.615079:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133567400/0x87925e4cb73b5067 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119ef expref: 289 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.615092:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143842.615097:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143842.615105:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.615123:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:2008:x1830963625067776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.615128:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8167 00000100:00100000:0.0:1746143842.615158:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8168 00000100:00100000:0.0:1746143842.615163:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963625068032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.615168:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.615172:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 34 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.615182:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 34 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:0.0:1746143842.615191:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143842.615194:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143842.615199:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.615211:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2009:x1830963625068032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.615216:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8168 00000100:00100000:3.0:1746143842.615302:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625067648 00000100:00100000:3.0:1746143842.615306:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625067648 00000100:00100000:3.0:1746143842.615334:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5438 00000100:00100000:3.0:1746143842.615339:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:30523:x1830963625067648:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143842.615411:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+35:30523:x1830963625067648:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 71us (629us total) trans 8589945090 rc 0/0 00000100:00100000:3.0:1746143842.615416:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5438 00000100:00100000:1.0:1746143842.615492:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497856:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.615500:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082087400/0x87925e4cb73b5059 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e1 expref: 34 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.615509:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627497984:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.615517:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627498112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.615523:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627498240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.615558:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143842.616343:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.617010:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.617066:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.617124:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068160 00000100:00100000:1.0:1746143842.617129:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068160 00010000:00010000:1.0:1746143842.617149:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 288 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.617164:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068288 00000100:00100000:1.0:1746143842.617166:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068288 00010000:00010000:1.0:1746143842.617174:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 34 pid: 7245 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.617186:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625067904 00000100:00100000:1.0:1746143842.617188:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625067904 00010000:00010000:1.0:1746143842.617193:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 35 pid: 10936 timeout: 1001 lvb_type: 0 00000100:00100000:1.0:1746143842.617205:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8169 00000100:00100000:1.0:1746143842.617210:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:2008:x1830963625068160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.617218:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.617222:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 288 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617229:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 288 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617242:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408dc00/0x87925e4cb73b510f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a66 expref: 288 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617255:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.617258:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.617265:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.617288:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:2008:x1830963625068160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.617293:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8169 00000100:00100000:1.0:1746143842.617304:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8170 00000100:00100000:1.0:1746143842.617308:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625068288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.617313:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.617317:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 35 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617336:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 35 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617347:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012408ca00/0x87925e4cb73b50c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411a3c expref: 35 pid: 7245 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617354:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.617357:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.617362:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.617375:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963625068288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.617383:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8170 00000100:00100000:1.0:1746143842.617394:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8171 00000100:00100000:1.0:1746143842.617399:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2009:x1830963625067904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.617405:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.617408:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 33 pid: 10936 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617415:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 33 pid: 10936 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617424:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b5060 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484119e8 expref: 33 pid: 10936 timeout: 1001 lvb_type: 0 00010000:00010000:1.0:1746143842.617430:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.617433:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.617438:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.617450:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2009:x1830963625067904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.617455:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8171 00000100:00100000:0.0:1746143842.618410:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.618451:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068416 00000100:00100000:3.0:1746143842.618456:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068416 00010000:00010000:3.0:1746143842.618473:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00000100:00100000:3.0:1746143842.618499:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8172 00000100:00100000:3.0:1746143842.618505:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+287:2009:x1830963625068416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.618512:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.618516:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.618523:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.618620:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b5752 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411e17 expref: 287 pid: 6587 timeout: 1001 lvb_type: 0 00010000:00010000:3.0:1746143842.618630:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.618633:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.618638:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.618673:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2009:x1830963625068416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 168us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.618679:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8172 00000100:00100000:0.0:1746143842.619215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.619370:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068544 00000100:00100000:2.0:1746143842.619379:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068544 00010000:00010000:2.0:1746143842.619395:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 32 pid: 14991 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.619418:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8173 00000100:00100000:2.0:1746143842.619423:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2009:x1830963625068544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.619430:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.619434:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 32 pid: 14991 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.619441:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 32 pid: 14991 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.619453:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b5584 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ce3 expref: 32 pid: 14991 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.619462:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.619465:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.619472:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.619477:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.619501:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.619522:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963625068544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.619528:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8173 00010000:00010000:1.0:1746143842.619528:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143842.619535:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:1.0:1746143842.619736:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3248, 88 off273680 00000004:00080000:1.0:1746143842.619743:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901843830989ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619784:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3242, 88 off272800 00000004:00080000:1.0:1746143842.619789:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901843876943ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619812:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3243, 88 off272888 00000004:00080000:1.0:1746143842.619815:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901843903069ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619823:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3249, 88 off273768 00000004:00080000:1.0:1746143842.619826:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901843913697ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619832:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3250, 88 off273856 00000004:00080000:1.0:1746143842.619834:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901843922197ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619841:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3244, 88 off272976 00000004:00080000:1.0:1746143842.619844:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901843931427ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619853:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3245, 88 off273064 00000004:00080000:1.0:1746143842.619856:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901843943374ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619863:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3246, 88 off273152 00000004:00080000:1.0:1746143842.619866:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901843954107ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619874:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3251, 88 off273944 00000004:00080000:1.0:1746143842.619877:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901843964639ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619886:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3247, 88 off273240 00000004:00080000:1.0:1746143842.619890:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901843977815ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619898:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3252, 88 off274032 00000004:00080000:1.0:1746143842.619901:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901843988637ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619907:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3248, 88 off273328 00000004:00080000:1.0:1746143842.619929:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901844016297ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143842.619939:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3253, 88 off274120 00000004:00080000:1.0:1746143842.619942:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901844029975ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619949:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3254, 88 off274208 00000004:00080000:1.0:1746143842.619951:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901844039399ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619958:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3255, 88 off274296 00000004:00080000:1.0:1746143842.619960:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901844048445ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619966:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3256, 88 off274384 00000004:00080000:1.0:1746143842.619969:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901844056755ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143842.619976:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3249, 88 off273416 00000004:00080000:1.0:1746143842.619978:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901844066030ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143842.621962:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945091 is committed 00000004:00080000:2.0:1746143842.622137:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2462 committed 00000004:00080000:2.0:1746143842.622154:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2472 committed 00000004:00080000:2.0:1746143842.622165:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2471 committed 00000004:00080000:2.0:1746143842.622167:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2470 committed 00000004:00080000:2.0:1746143842.622168:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2469 committed 00000004:00080000:2.0:1746143842.622169:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2461 committed 00000004:00080000:2.0:1746143842.622171:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2468 committed 00000004:00080000:2.0:1746143842.622172:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2460 committed 00000004:00080000:2.0:1746143842.622174:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2467 committed 00000004:00080000:2.0:1746143842.622176:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2459 committed 00000004:00080000:2.0:1746143842.622177:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2458 committed 00000004:00080000:2.0:1746143842.622179:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2457 committed 00000004:00080000:2.0:1746143842.622181:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2466 committed 00000004:00080000:2.0:1746143842.622182:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2465 committed 00000004:00080000:2.0:1746143842.622183:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2456 committed 00000004:00080000:2.0:1746143842.622185:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2455 committed 00000004:00080000:2.0:1746143842.622186:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2464 committed 00000001:00080000:2.0:1746143842.622192:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945090 is committed 00000001:00080000:2.0:1746143842.622196:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945089 is committed 00000100:00100000:2.0:1746143842.622288:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627498368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143842.622313:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627498496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.622337:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627498752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.622365:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.622388:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.622402:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.622416:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.622419:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.622431:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.622433:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.622444:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627500288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.622446:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.622460:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.622460:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.622472:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.622473:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746143842.622477:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627498624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143842.622481:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627500032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.622490:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.622503:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.622515:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.623292:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627498752 00000100:00100000:0.0:1746143842.623298:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627498752 00000100:00100000:0.0:1746143842.623988:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499264 00000100:00100000:0.0:1746143842.623992:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499264 00000100:00100000:1.0:1746143842.624043:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.624072:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.624464:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627498496 00000100:00100000:3.0:1746143842.624469:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627498496 00000100:00100000:1.0:1746143842.624489:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627500160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.624492:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499776 00000100:00100000:2.0:1746143842.624496:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499776 00000100:00100000:1.0:1746143842.624510:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.624514:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499008 00000100:00100000:2.0:1746143842.624516:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499008 00000100:00100000:2.0:1746143842.624523:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627500288 00000100:00100000:2.0:1746143842.624524:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627500288 00000100:00100000:2.0:1746143842.624530:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499520 00000100:00100000:2.0:1746143842.624532:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499520 00000100:00100000:1.0:1746143842.624532:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627498624 00000100:00100000:1.0:1746143842.624534:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627498624 00000100:00100000:2.0:1746143842.624542:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499136 00000100:00100000:2.0:1746143842.624543:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499136 00000100:00100000:1.0:1746143842.624548:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499648 00000100:00100000:2.0:1746143842.624550:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627500160 00000100:00100000:1.0:1746143842.624550:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499648 00000100:00100000:2.0:1746143842.624552:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627500160 00000100:00100000:1.0:1746143842.624559:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16680 00000100:00100000:1.0:1746143842.624564:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963627498752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.624593:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16681 00000100:00100000:2.0:1746143842.624599:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3772:x1830963627499264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.624656:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16682 00000100:00100000:1.0:1746143842.624661:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627498496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.624694:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627499264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (2290us total) trans 21474841247 rc 0/0 00000100:00100000:2.0:1746143842.624699:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16681 00000100:00100000:2.0:1746143842.624711:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16683 00000100:00100000:2.0:1746143842.624716:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627499776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.624720:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627498496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (2300us total) trans 21474841249 rc 0/0 00000100:00100000:1.0:1746143842.624725:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16682 00000100:00100000:1.0:1746143842.624736:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16684 00000100:00100000:1.0:1746143842.624741:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3774:x1830963627499008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143842.624778:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:1.0:1746143842.624781:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000100:00100000:2.0:1746143842.624783:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627499776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (2351us total) trans 17179873975 rc 0/0 00002000:00010000:1.0:1746143842.624783:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143842.624784:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.624786:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:2.0:1746143842.624788:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16683 00000100:00100000:2.0:1746143842.624800:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16685 00000100:00100000:2.0:1746143842.624804:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627500288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.624805:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627499008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (2357us total) trans 21474841250 rc 0/0 00000100:00100000:1.0:1746143842.624810:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16684 00000100:00100000:1.0:1746143842.624820:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16686 00000100:00100000:1.0:1746143842.624824:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3774:x1830963627499520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143842.624841:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:2.0:1746143842.624843:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.624845:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143842.624846:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.624848:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:2.0:1746143842.624866:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627500288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (2405us total) trans 17179873976 rc 0/0 00000100:00100000:2.0:1746143842.624871:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16685 00000100:00100000:1.0:1746143842.624879:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627499520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (2405us total) trans 17179873977 rc 0/0 00000100:00100000:2.0:1746143842.624881:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16687 00000100:00100000:1.0:1746143842.624884:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16686 00000100:00100000:2.0:1746143842.624885:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627498624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.624893:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16688 00000100:00100000:1.0:1746143842.624897:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627499136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.624950:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627498624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (2458us total) trans 21474841251 rc 0/0 00000100:00100000:2.0:1746143842.624955:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16687 00000100:00100000:1.0:1746143842.624961:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627499136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (2444us total) trans 21474841252 rc 0/0 00000100:00100000:2.0:1746143842.624965:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16689 00000100:00100000:2.0:1746143842.624970:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627499648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.625001:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16690 00000100:00100000:0.0:1746143842.625007:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627500160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143842.625049:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143842.625051:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.625053:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143842.625054:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.625056:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:3.0:1746143842.625074:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.625077:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627500160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (566us total) trans 17179873978 rc 0/0 00000100:00100000:0.0:1746143842.625081:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16690 00000100:00100000:0.0:1746143842.625090:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627500032 00000100:00100000:0.0:1746143842.625093:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627500032 00000100:00100000:0.0:1746143842.625102:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16691 00000004:00080000:3.0:1746143842.625103:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610ce00/2, rc 0, transno 21474841249 00000100:00100000:0.0:1746143842.625105:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627500032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.625108:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627498496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143842.625115:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610ed80/2, rc 0, transno 21474841250 00000100:00100000:3.0:1746143842.625118:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499008:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143842.625128:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdd500/2, rc 0, transno 17179873977 00000100:00100000:3.0:1746143842.625134:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.625138:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143842.625143:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.625155:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963627500032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (81us total) trans 17179873979 rc 0/0 00000100:00100000:3.0:1746143842.625161:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.625161:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16691 00000100:00100000:0.0:1746143842.625169:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499392 00000100:00100000:3.0:1746143842.625170:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.625171:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499392 00000100:00100000:0.0:1746143842.625178:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16692 00000100:00100000:3.0:1746143842.625182:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.625182:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963627499392:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143842.625193:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136637100/2, rc 0, transno 17179873979 00000100:00100000:3.0:1746143842.625197:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627500032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.625232:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627499392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (70us total) trans 17179873980 rc 0/0 00000100:00100000:0.0:1746143842.625237:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16692 00000100:00100000:0.0:1746143842.625244:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627499904 00000100:00100000:0.0:1746143842.625247:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627499904 00000100:00100000:0.0:1746143842.625258:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16693 00000100:00100000:0.0:1746143842.625261:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627499904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.625396:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3772:x1830963627499648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 425us (1323us total) trans 17179873982 rc 0/0 00000100:00100000:2.0:1746143842.625402:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16689 00000100:00100000:2.0:1746143842.625420:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.625639:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627498880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.625657:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.625670:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627500416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.625682:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.625789:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627498368 00000100:00100000:3.0:1746143842.625793:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627498368 00000100:00100000:3.0:1746143842.625807:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627498880 00000100:00100000:3.0:1746143842.625809:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627498880 00000100:00100000:3.0:1746143842.625816:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627500416 00000100:00100000:3.0:1746143842.625817:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627500416 00000100:00100000:3.0:1746143842.625824:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16694 00000100:00100000:3.0:1746143842.625828:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963627498368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143842.625887:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3773:x1830963627498368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (466us total) trans 21474841253 rc 0/0 00000100:00100000:3.0:1746143842.625892:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16694 00000100:00100000:3.0:1746143842.625901:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16695 00000100:00100000:3.0:1746143842.625904:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3773:x1830963627498880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143842.625970:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3773:x1830963627498880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (312us total) trans 21474841254 rc 0/0 00000100:00100000:0.0:1746143842.626207:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963627499904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 943us (1023us total) trans 17179873981 rc 0/0 00000100:00100000:3.0:1746143842.626395:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16695 00000100:00100000:2.0:1746143842.626507:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16696 00000100:00100000:2.0:1746143842.626513:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3773:x1830963627500416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.626566:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3773:x1830963627500416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (883us total) trans 17179873983 rc 0/0 00000100:00100000:2.0:1746143842.626570:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16696 00000004:00080000:2.0:1746143842.626588:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b800/2, rc 0, transno 17179873983 00000100:00100000:2.0:1746143842.626590:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627500416:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.626597:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610e680/2, rc 0, transno 21474841253 00000100:00100000:2.0:1746143842.626599:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627498368:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.626604:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610e300/2, rc 0, transno 21474841254 00000100:00100000:2.0:1746143842.626606:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627498880:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143842.627112:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143842.627116:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.627118:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143842.627120:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.627121:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143842.627142:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627498752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2578us (4777us total) trans 21474841248 rc 0/0 00000100:00100000:2.0:1746143842.627147:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16680 00000100:00100000:0.0:1746143842.627249:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16693 00000100:00080000:0.0:1746143842.627267:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746143842.627271:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746143842.627289:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdc380/2, rc 0, transno 17179873980 00000100:00100000:0.0:1746143842.627293:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143842.627300:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136635f80/2, rc 0, transno 17179873981 00000100:00100000:0.0:1746143842.627303:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627499904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.627396:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16688 00000004:00080000:2.0:1746143842.627617:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610dc00/2, rc 0, transno 21474841251 00000100:00100000:2.0:1746143842.627621:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627498624:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.627628:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30e00/2, rc 0, transno 21474841252 00000100:00100000:2.0:1746143842.627630:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499136:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.627638:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bdd180/2, rc 0, transno 17179873982 00000100:00100000:2.0:1746143842.627640:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.627647:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136634a80/2, rc 0, transno 17179873978 00000100:00100000:2.0:1746143842.627649:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627500160:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.627655:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d8380/2, rc 0, transno 17179873975 00000100:00100000:2.0:1746143842.627658:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.627664:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4df80/2, rc 0, transno 17179873976 00000100:00100000:2.0:1746143842.627666:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627500288:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.627672:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009610c000/2, rc 0, transno 21474841248 00000100:00100000:2.0:1746143842.627674:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627498752:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.627679:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30700/2, rc 0, transno 21474841247 00000100:00100000:2.0:1746143842.627682:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627499264:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746143842.627717:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093416a00 reply state ffff880091145400 transno 8589945091 ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.627733:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.627741:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.627744:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143842.627746:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746143842.628429:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143842.628447:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2843:x1830963625067136:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 18390us (18628us total) trans 8589945091 rc 0/0 00000100:00100000:2.0:1746143842.628454:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14018 00010000:00010000:3.0:1746143842.628518:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.628525:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.628531:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.628536:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880124adf800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143842.628539:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.628545:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.628553:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.628555:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143842.628557:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143842.628561:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124adf800/0x87925e4cb73b587f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143842.631520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.631597:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068672 00000100:00100000:0.0:1746143842.631605:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068672 00000100:00100000:0.0:1746143842.631645:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14019 00000100:00100000:0.0:1746143842.631653:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2843:x1830963625068672:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143842.631670:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.631685:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ec6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.631730:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.631742:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.631755:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143842.631758:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143842.631761:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:0.0:1746143842.631809:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2843:x1830963625068672:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 156us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.631815:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14019 00000100:00100000:1.0:1746143842.636362:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.636801:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068800 00000100:00100000:2.0:1746143842.636809:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068800 00000100:00100000:2.0:1746143842.636847:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14020 00000100:00100000:2.0:1746143842.636855:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2843:x1830963625068800:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143842.636870:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.636886:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b588d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ecd expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.636973:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73b5894 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.636985:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73b5894 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.636994:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73b5894 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143842.637021:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143842.637025:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143842.637040:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73b5894 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.637060:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b588d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ecd expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.637089:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73b5894 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ecd expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.637096:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.637098:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143842.637100:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717a00, rc 0) 00000100:00100000:2.0:1746143842.638639:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2843:x1830963625068800:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1780us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.638647:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14020 00000100:00100000:0.0:1746143842.641881:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.641949:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.641970:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.641982:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.642007:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.642060:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625068928 00000100:00100000:3.0:1746143842.642068:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625068928 00000100:00100000:0.0:1746143842.642071:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.642088:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069056 00000100:00100000:0.0:1746143842.642091:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069056 00000100:00100000:3.0:1746143842.642106:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069184 00000100:00100000:3.0:1746143842.642108:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069184 00000100:00100000:0.0:1746143842.642108:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069440 00000100:00100000:0.0:1746143842.642110:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069440 00000100:00100000:3.0:1746143842.642118:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069312 00000100:00100000:3.0:1746143842.642119:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069312 00000100:00100000:0.0:1746143842.642120:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069568 00000100:00100000:0.0:1746143842.642121:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069568 00000100:00100000:3.0:1746143842.642133:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16697 00000100:00100000:3.0:1746143842.642213:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625068928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.642228:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.642242:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ed4 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143842.642260:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a5e, atime: 0x68140a5d, ctime: 0x68140a5e, blocks: 0x748 00010000:00010000:3.0:1746143842.642275:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.642277:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.642284:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.642298:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 11 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.642307:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad34000, rc 0) 00000100:00100000:3.0:1746143842.642356:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625068928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 216us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.642572:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16698 00000100:00100000:0.0:1746143842.642579:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625069056:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143842.642595:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16699 00000100:00100000:2.0:1746143842.642603:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625069184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143842.642611:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143842.642611:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16700 00000100:00100000:1.0:1746143842.642618:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625069440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143842.642621:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ee2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.642624:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.642632:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ef0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143842.642635:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a62, atime: 0x68140a62, ctime: 0x68140a62, blocks: 0x808 00002000:00010000:1.0:1746143842.642642:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a62, atime: 0x68140a61, ctime: 0x68140a62, blocks: 0x1510 00010000:00010000:2.0:1746143842.642643:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.642644:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.642649:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.642649:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.642650:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.642654:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 12 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.642658:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.642663:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 12 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.642669:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323b200, rc 0) 00010000:00010000:2.0:1746143842.642670:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c800, rc 0) 00000100:00100000:1.0:1746143842.642685:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625069440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 68us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.642689:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625069184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 88us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.642690:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16700 00000100:00100000:2.0:1746143842.642694:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16699 00000100:00100000:1.0:1746143842.642705:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16701 00000100:00100000:2.0:1746143842.642709:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16702 00000100:00100000:1.0:1746143842.642710:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625069312:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143842.642713:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625069568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143842.642716:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.642719:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.642723:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ee9 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.642725:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ef7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143842.642731:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a62, atime: 0x68140a61, ctime: 0x68140a62, blocks: 0x808 00002000:00010000:2.0:1746143842.642734:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a62, atime: 0x68140a62, ctime: 0x68140a62, blocks: 0x1008 00010000:00010000:1.0:1746143842.642737:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.642738:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.642740:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.642742:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.642742:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 12 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.642745:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.642749:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 12 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.642754:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143842.642755:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323bc00, rc 0) 00010000:00010000:2.0:1746143842.642761:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:1.0:1746143842.642770:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625069312:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.642774:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16701 00000100:00100000:2.0:1746143842.642788:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625069568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 74us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.642794:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16702 00010000:00010000:0.0:1746143842.642844:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.642852:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411edb expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143842.642862:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a62, atime: 0x68140a62, ctime: 0x68140a61, blocks: 0x808 00010000:00010000:0.0:1746143842.642870:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.642871:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.642875:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143842.642884:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143842.642891:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30800, rc 0) 00000100:00100000:3.0:1746143842.642933:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16697 00000100:00100000:0.0:1746143842.643189:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625069056:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 610us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.643195:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16698 00000100:00100000:0.0:1746143842.646970:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.646994:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.647007:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.647023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.647030:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.647048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.647062:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069824 00000100:00100000:3.0:1746143842.647070:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069824 00000100:00100000:2.0:1746143842.647100:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070080 00000100:00100000:2.0:1746143842.647104:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070080 00000100:00100000:3.0:1746143842.647107:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070336 00000100:00100000:3.0:1746143842.647109:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070336 00000100:00100000:1.0:1746143842.647113:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069696 00000100:00100000:1.0:1746143842.647116:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069696 00000100:00100000:2.0:1746143842.647120:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625069952 00000100:00100000:2.0:1746143842.647122:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625069952 00000100:00100000:3.0:1746143842.647127:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070208 00000100:00100000:3.0:1746143842.647130:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070208 00000100:00100000:1.0:1746143842.647136:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16703 00000100:00100000:1.0:1746143842.647142:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625069824:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143842.647177:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16704 00000100:00100000:2.0:1746143842.647181:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625070080:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143842.647224:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625069824:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.647230:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16703 00000100:00100000:0.0:1746143842.647236:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16705 00000100:00100000:0.0:1746143842.647240:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625070336:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143842.647243:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16706 00000100:00100000:1.0:1746143842.647247:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625069696:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143842.647287:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625070080:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.647291:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16704 00000100:00100000:3.0:1746143842.647304:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16707 00000100:00100000:0.0:1746143842.647308:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625070336:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.647309:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625069952:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143842.647309:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625069696:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 62us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.647311:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16705 00000100:00100000:1.0:1746143842.647315:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16706 00000100:00100000:0.0:1746143842.647319:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16708 00000100:00100000:0.0:1746143842.647331:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625070208:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143842.647354:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625069952:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.647359:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16707 00000100:00100000:0.0:1746143842.647365:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625070208:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.647370:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16708 00000100:00100000:0.0:1746143842.649641:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.649679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.649706:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.649719:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.649730:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.649762:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.649835:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070464 00000100:00100000:2.0:1746143842.649842:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070464 00000100:00100000:1.0:1746143842.649843:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070720 00000100:00100000:1.0:1746143842.649847:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070720 00000100:00100000:2.0:1746143842.649869:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070976 00000100:00100000:2.0:1746143842.649871:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070976 00000100:00100000:1.0:1746143842.650172:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070592 00000100:00100000:1.0:1746143842.650179:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070592 00000100:00100000:1.0:1746143842.650195:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625070848 00000100:00100000:1.0:1746143842.650196:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625070848 00000100:00100000:1.0:1746143842.650453:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625071104 00000100:00100000:1.0:1746143842.650457:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625071104 00000100:00100000:2.0:1746143842.650463:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16709 00000100:00100000:2.0:1746143842.650471:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625070464:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143842.650474:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16710 00000100:00100000:1.0:1746143842.650479:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625070720:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143842.650542:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625070720:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 62us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.650547:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16710 00000100:00100000:1.0:1746143842.650558:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16711 00000100:00100000:1.0:1746143842.650562:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625070976:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143842.650605:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16712 00000100:00100000:3.0:1746143842.650613:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625070592:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143842.650658:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16713 00000100:00100000:0.0:1746143842.650664:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625070848:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143842.650724:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625070464:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 254us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.650730:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16709 00000100:00100000:2.0:1746143842.650741:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16714 00000100:00100000:2.0:1746143842.650746:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625071104:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143842.650771:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625071104:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 25us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.650776:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16714 00000100:00100000:1.0:1746143842.651069:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625070976:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 504us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.651074:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16711 00000100:00100000:3.0:1746143842.651168:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625070592:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 556us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.651175:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16712 00000100:00100000:0.0:1746143842.651216:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625070848:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 552us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.651225:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16713 00000100:00100000:0.0:1746143842.656387:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.656509:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625071232 00000100:00100000:2.0:1746143842.656517:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625071232 00000100:00100000:2.0:1746143842.656615:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16715 00000100:00100000:2.0:1746143842.656623:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625071232:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143842.656795:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143842.656799:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.656802:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143842.656803:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.656805:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143842.657105:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625071232:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 481us (724us total) trans 21474841255 rc 0/0 00000100:00100000:2.0:1746143842.657111:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16715 00000100:00100000:0.0:1746143842.660092:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.660149:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625071360 00000100:00100000:2.0:1746143842.660156:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625071360 00000100:00100000:2.0:1746143842.660401:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16716 00000100:00100000:2.0:1746143842.660407:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625071360:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143842.660563:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143842.660566:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.660568:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143842.660570:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143842.660572:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:2.0:1746143842.660613:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625071360:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 205us (525us total) trans 17179873984 rc 0/0 00000100:00100000:2.0:1746143842.660618:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16716 00000100:00100000:0.0:1746143842.673104:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.673135:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.673752:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625071616 00000100:00100000:2.0:1746143842.673759:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625071616 00000100:00100000:0.0:1746143842.673773:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.673792:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.673935:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625071872 00000100:00100000:3.0:1746143842.673939:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625071872 00000100:00100000:0.0:1746143842.673950:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.674041:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625072128 00000100:00100000:3.0:1746143842.674044:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625072128 00000100:00100000:0.0:1746143842.674047:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.674060:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625072384 00000100:00100000:3.0:1746143842.674067:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625072384 00000100:00100000:0.0:1746143842.674067:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.674078:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625072768 00000100:00100000:3.0:1746143842.674080:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625072768 00000100:00100000:3.0:1746143842.674088:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625072896 00000100:00100000:3.0:1746143842.674090:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625072896 00000100:00100000:0.0:1746143842.674091:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.674096:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625073152 00000100:00100000:3.0:1746143842.674098:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625073152 00000100:00100000:3.0:1746143842.674104:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625073408 00000100:00100000:3.0:1746143842.674105:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625073408 00000100:00100000:3.0:1746143842.674115:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7282 00000100:00100000:3.0:1746143842.674121:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625071616:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143842.674154:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.674166:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.674167:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.674172:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.674181:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.674202:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7283 00000100:00100000:2.0:1746143842.674208:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625071872:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143842.674224:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.674236:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.674237:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.674240:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.674249:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.674300:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7284 00000100:00100000:0.0:1746143842.674306:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625072128:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143842.674320:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.674449:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7285 00000100:00100000:1.0:1746143842.674456:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2011:x1830963625072384:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143842.674469:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.674476:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.674477:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.674480:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.674487:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.674746:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7286 00000100:00100000:3.0:1746143842.674751:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625072768:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143842.674766:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.674772:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.674773:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.674775:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.674783:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.674863:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7287 00000100:00100000:2.0:1746143842.674869:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2010:x1830963625072896:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143842.674883:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.674889:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.674890:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.674893:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.674897:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.674899:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.674900:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.674902:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.674932:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.675602:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7288 00000100:00100000:3.0:1746143842.675607:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2011:x1830963625073152:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143842.675624:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.675634:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.675636:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.675638:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.675645:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.675724:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7289 00000100:00100000:0.0:1746143842.675730:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2011:x1830963625073408:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143842.675744:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.675750:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.675751:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.675754:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.675761:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.684987:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.685002:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.685010:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.685016:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.685019:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.685026:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.685041:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.685046:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b58c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.685134:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2011:x1830963625071616:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 11008us (12031us total) trans 0 rc 950272/950272 00000100:00100000:3.0:1746143842.685142:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7282 00010000:00010000:3.0:1746143842.686940:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.686952:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.686960:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.686965:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.686968:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.686976:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.686990:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.686996:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b58cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.687058:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2011:x1830963625071872:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 12846us (13916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.687071:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7283 00010000:00010000:3.0:1746143842.689764:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.689779:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.689786:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.689792:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.689795:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.689803:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.689818:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.689823:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b27600/0x87925e4cb73b58e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.689894:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625072768:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 15138us (15939us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.689903:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7286 00010000:00010000:1.0:1746143842.696682:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.696696:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.696703:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.696709:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143842.696713:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.696721:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.696736:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.696742:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31c00/0x87925e4cb73b58d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.696859:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625072128:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 22548us (23081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.696869:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7284 00010000:00010000:2.0:1746143842.700233:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.700246:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.700253:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.700259:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143842.700262:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.700268:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.700289:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.700294:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b58e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.700385:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625072896:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 25513us (26333us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.700394:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7287 00010000:00010000:3.0:1746143842.707435:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.707448:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.707456:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.707462:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b26200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143842.707465:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.707472:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.707485:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.707490:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b58ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.707564:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625073152:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 31952us (33492us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.707572:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7288 00010000:00010000:1.0:1746143842.708252:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.708261:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.708267:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.708272:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad35800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143842.708275:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.708281:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.708290:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.708295:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad35800/0x87925e4cb73b58da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.708365:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625072384:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 33909us (34570us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.708372:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7285 00010000:00010000:2.0:1746143842.710861:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.710873:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.710880:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.710886:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143842.710890:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.710898:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.710970:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.710977:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31e00/0x87925e4cb73b58f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.711035:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625073408:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 35302us (36940us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.711044:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7289 00000100:00100000:0.0:1746143842.715820:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.715890:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625073664 00000100:00100000:2.0:1746143842.715897:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625073664 00000100:00100000:2.0:1746143842.715947:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14021 00000100:00100000:2.0:1746143842.715953:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2843:x1830963625073664:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1746143842.715992:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.716014:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717a00/0x87925e4cb73b5894 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ecd expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.716027:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.716031:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143842.716063:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.716072:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.716079:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00010000:2.0:1746143842.716159:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e35bb80 reply state ffff880090e3d000 transno 8589945092 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.716166:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.716171:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.716173:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746143842.716175:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143842.716244:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2843:x1830963625073664:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 290us (429us total) trans 8589945092 rc 0/0 00000100:00100000:2.0:1746143842.716249:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14021 00000100:00100000:2.0:1746143842.717853:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.717965:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625073792 00000100:00100000:3.0:1746143842.717971:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625073792 00000100:00100000:3.0:1746143842.717998:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16717 00000100:00100000:3.0:1746143842.718003:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2843:x1830963625073792:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.718016:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.718028:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411efe expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.718047:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.718053:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.718055:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.718058:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.718079:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.718088:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.718097:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627500544:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.718161:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.720368:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627500544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.720389:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.720402:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26200, rc 0) 00000100:00100000:3.0:1746143842.720435:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2843:x1830963625073792:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2431us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.720446:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16717 00000100:00100000:0.0:1746143842.722561:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.722651:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625073920 00000100:00100000:2.0:1746143842.722657:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625073920 00010000:00010000:2.0:1746143842.722686:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.722726:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8174 00000100:00100000:2.0:1746143842.722734:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625073920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.722744:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.722760:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.722769:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.722788:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad34000/0x87925e4cb73b589b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ed4 expref: 13 pid: 9839 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.722814:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.722816:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.722821:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.722828:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.722854:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.722866:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627500672:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.722950:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.725298:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.725411:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627500672:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143842.725418:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074048 00000100:00100000:3.0:1746143842.725424:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074048 00010000:00010000:2.0:1746143842.725428:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.725553:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625073920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2819us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.725565:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8174 00000100:00100000:3.0:1746143842.725664:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16718 00000100:00100000:3.0:1746143842.725671:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2843:x1830963625074048:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.725684:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.725698:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f05 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.725717:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.725723:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.725725:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.725728:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.725750:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.725759:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.725769:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627500800:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.726005:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.728657:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627500800:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.728679:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.728692:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:3.0:1746143842.728734:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2843:x1830963625074048:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3064us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.728742:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16718 00000100:00100000:0.0:1746143842.729753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.729817:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074176 00000100:00100000:2.0:1746143842.729823:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074176 00010000:00010000:2.0:1746143842.729849:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.729889:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8175 00000100:00100000:2.0:1746143842.729896:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625074176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.729907:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.729953:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.729964:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.729983:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30800/0x87925e4cb73b58be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411edb expref: 13 pid: 9587 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.729999:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.730001:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.730007:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.730014:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.730037:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.730047:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627500928:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.730175:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.731293:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627500928:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.731306:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.731344:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625074176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1447us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.731350:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8175 00000100:00100000:0.0:1746143842.731658:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.732553:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074304 00000100:00100000:3.0:1746143842.732558:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074304 00000100:00100000:3.0:1746143842.732607:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16719 00000100:00100000:3.0:1746143842.732612:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2843:x1830963625074304:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.732626:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.732643:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f0c expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.732663:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.732669:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.732671:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.732674:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.732695:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.732702:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.732710:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627501056:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.732767:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.734030:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627501056:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.734045:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.734058:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7fa00, rc 0) 00000100:00100000:3.0:1746143842.734083:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2843:x1830963625074304:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1470us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.734090:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16719 00000100:00100000:0.0:1746143842.734451:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.734563:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074432 00000100:00100000:2.0:1746143842.734568:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074432 00010000:00010000:2.0:1746143842.734587:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.734613:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8176 00000100:00100000:2.0:1746143842.734619:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625074432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.734743:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.734758:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.734767:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.734782:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b58a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee2 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.734804:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.734806:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.734811:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.734821:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.734842:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.734851:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627501184:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.734930:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.737364:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627501184:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.737380:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.737417:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625074432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2797us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.737426:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8176 00000100:00100000:0.0:1746143842.738442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.738519:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074560 00000100:00100000:3.0:1746143842.738526:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074560 00000100:00100000:3.0:1746143842.738645:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16720 00000100:00100000:3.0:1746143842.738651:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2843:x1830963625074560:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.738664:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.738676:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f13 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.738697:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.738703:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.738704:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.738707:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.738733:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.738742:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.738751:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627501312:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.739166:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.741157:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627501312:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.741180:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.741198:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f200, rc 0) 00000100:00100000:3.0:1746143842.741239:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2843:x1830963625074560:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2587us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.741246:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16720 00000100:00100000:0.0:1746143842.741678:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.741731:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074688 00000100:00100000:2.0:1746143842.741741:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074688 00010000:00010000:2.0:1746143842.741762:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.741794:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8177 00000100:00100000:2.0:1746143842.741800:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625074688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.741810:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.741826:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.741840:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.741859:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323bc00/0x87925e4cb73b58b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ee9 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.741882:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.741884:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.741889:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.741896:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.741990:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.742001:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627501440:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.742044:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.744035:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627501440:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.744052:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.744082:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625074688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2282us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.744090:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8177 00000100:00100000:0.0:1746143842.744173:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.744253:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074816 00000100:00100000:3.0:1746143842.744258:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074816 00000100:00100000:3.0:1746143842.744284:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16721 00000100:00100000:3.0:1746143842.744288:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2843:x1830963625074816:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143842.744300:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.744310:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f1a expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.744345:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.744352:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.744353:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.744356:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.744377:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.744386:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00000100:00100000:3.0:1746143842.744395:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627501568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.744440:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.745788:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627501568:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.745805:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.745818:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27000, rc 0) 00000100:00100000:3.0:1746143842.746128:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2843:x1830963625074816:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1620us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.746137:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16721 00000100:00100000:0.0:1746143842.747220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.747286:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625074944 00000100:00100000:2.0:1746143842.747293:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625074944 00010000:00010000:2.0:1746143842.747316:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.747359:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8178 00000100:00100000:2.0:1746143842.747365:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625074944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.747376:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.747392:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.747401:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.747418:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b58a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef0 expref: 13 pid: 12328 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.747443:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.747444:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.747450:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.747456:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.747480:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.747490:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627501696:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.747549:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.749139:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627501696:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.749154:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.749195:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625074944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1830us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.749203:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8178 00000100:00100000:0.0:1746143842.749268:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.749318:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075072 00000100:00100000:3.0:1746143842.749338:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075072 00000100:00100000:2.0:1746143842.749477:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16722 00000100:00100000:2.0:1746143842.749484:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2843:x1830963625075072:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143842.749497:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.749511:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f21 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.749534:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.749540:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.749542:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.749545:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.749565:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.749574:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.749583:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627501824:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.749637:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.751160:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627501824:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.751178:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.751190:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512e00, rc 0) 00000100:00100000:2.0:1746143842.751263:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2843:x1830963625075072:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1779us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.751274:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16722 00000100:00100000:0.0:1746143842.751468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.751562:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075200 00000100:00100000:2.0:1746143842.751567:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075200 00010000:00010000:2.0:1746143842.751586:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00000100:00100000:2.0:1746143842.751615:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8179 00000100:00100000:2.0:1746143842.751621:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625075200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.751630:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.751645:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.751656:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.751672:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b58b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ef7 expref: 13 pid: 12327 timeout: 1001 lvb_type: 1 00010000:00010000:2.0:1746143842.751696:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.751698:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.751702:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.751709:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.751727:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.751735:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627501952:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.752026:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.752947:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627501952:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.752959:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.752989:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625075200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1368us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.752996:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8179 00000100:00100000:2.0:1746143842.755471:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.755492:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.755505:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.755522:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075328 00000100:00100000:2.0:1746143842.755528:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075328 00000100:00100000:2.0:1746143842.755555:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075584 00000100:00100000:2.0:1746143842.755557:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075584 00000100:00100000:2.0:1746143842.757131:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075840 00000100:00100000:2.0:1746143842.757139:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075840 00000100:00100000:3.0:1746143842.757224:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16723 00000100:00100000:3.0:1746143842.757234:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625075328:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143842.757355:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143842.757358:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143838 -> 1746143842 00002000:00010000:3.0:1746143842.757360:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143837 -> 1746143842 00002000:00010000:3.0:1746143842.757362:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143838 -> 1746143843 00002000:00010000:3.0:1746143842.757363:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:3.0:1746143842.757399:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625075328:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 167us (1933us total) trans 17179873985 rc 0/0 00000100:00100000:3.0:1746143842.757405:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16723 00000100:00100000:3.0:1746143842.757419:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16724 00000100:00100000:3.0:1746143842.757424:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625075584:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143842.757475:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143842.757477:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.757479:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.757480:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143842 -> 1746143843 00002000:00010000:3.0:1746143842.757482:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143842.757496:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625075584:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 72us (2003us total) trans 21474841256 rc 0/0 00000100:00100000:3.0:1746143842.757501:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16724 00000100:00100000:3.0:1746143842.757601:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16725 00000100:00100000:3.0:1746143842.757606:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625075840:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143842.757644:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:3.0:1746143842.757646:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.757648:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143841 -> 1746143842 00002000:00010000:3.0:1746143842.757650:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143842 -> 1746143843 00002000:00010000:3.0:1746143842.757651:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:3.0:1746143842.757666:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625075840:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 61us (2161us total) trans 17179873986 rc 0/0 00000100:00100000:3.0:1746143842.757672:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16725 00000100:00100000:0.0:1746143842.758646:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.758664:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075456 00000100:00100000:0.0:1746143842.758668:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075456 00000100:00100000:0.0:1746143842.758686:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16726 00000100:00100000:0.0:1746143842.758690:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625075456:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143842.758742:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143842.758745:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.758746:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.758748:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143841 -> 1746143843 00002000:00010000:0.0:1746143842.758750:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143842.758765:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625075456:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 75us (121us total) trans 21474841257 rc 0/0 00000100:00100000:0.0:1746143842.758770:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16726 00000100:00100000:0.0:1746143842.758810:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.758819:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075712 00000100:00100000:0.0:1746143842.758821:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075712 00000100:00100000:0.0:1746143842.758834:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16727 00000100:00100000:0.0:1746143842.758838:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625075712:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143842.758873:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143842.758876:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.758877:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143841 -> 1746143842 00002000:00010000:0.0:1746143842.758879:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143842 -> 1746143843 00002000:00010000:0.0:1746143842.758880:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143842.758893:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625075712:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 55us (83us total) trans 17179873987 rc 0/0 00000100:00100000:0.0:1746143842.758897:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16727 00000100:00100000:0.0:1746143842.758946:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.758956:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625075968 00000100:00100000:0.0:1746143842.758958:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625075968 00000100:00100000:0.0:1746143842.758970:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16728 00000100:00100000:0.0:1746143842.758974:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625075968:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143842.759009:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143842.759012:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.759013:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.759015:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143842 -> 1746143843 00002000:00010000:0.0:1746143842.759017:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143842.759031:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625075968:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 57us (84us total) trans 21474841258 rc 0/0 00000100:00100000:0.0:1746143842.759036:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16728 00000100:00100000:0.0:1746143842.761170:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.761255:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625076224 00000100:00100000:2.0:1746143842.761261:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625076224 00000100:00100000:2.0:1746143842.761305:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5439 00000100:00100000:2.0:1746143842.761312:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2843:x1830963625076224:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:2.0:1746143842.761362:0:7247:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5847 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ebf expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.761395:0:7247:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.761406:0:7247:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.761412:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.761436:0:7247:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.761446:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 10 pid: 7244 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.761455:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963627502080:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.761525:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.762849:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963627502080:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.762865:0:7247:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746143842.764367:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.764521:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625076352 00000100:00100000:2.0:1746143842.764528:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625076352 00010000:00010000:2.0:1746143842.764555:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 11 pid: 7244 timeout: 1001 lvb_type: 0 00000100:00100000:2.0:1746143842.764632:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8180 00000100:00100000:2.0:1746143842.764639:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625076352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.764650:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.764655:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 11 pid: 7244 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.764665:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 11 pid: 7244 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.764682:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5886 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ec6 expref: 11 pid: 7244 timeout: 1001 lvb_type: 0 00010000:00010000:2.0:1746143842.764699:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.764703:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.764710:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.764716:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.764730:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143842.764744:0:7247:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.764749:0:7247:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000040:00080000:2.0:1746143842.765051:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3257, 88 off274472 00000004:00080000:2.0:1746143842.765057:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901989144867ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766113:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3250, 88 off273504 00000004:00080000:2.0:1746143842.766119:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990206398ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766139:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3251, 88 off273592 00000004:00080000:2.0:1746143842.766142:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990229450ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766151:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3258, 88 off274560 00000004:00080000:2.0:1746143842.766153:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990241306ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766160:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3259, 88 off274648 00000004:00080000:2.0:1746143842.766163:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990250605ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766170:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3252, 88 off273680 00000004:00080000:2.0:1746143842.766172:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990260131ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766308:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3253, 88 off273768 00000004:00080000:2.0:1746143842.766312:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990399903ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766331:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3254, 88 off273856 00000004:00080000:2.0:1746143842.766334:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990422170ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766350:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3260, 88 off274736 00000004:00080000:2.0:1746143842.766354:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990442130ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766400:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3255, 88 off273944 00000004:00080000:2.0:1746143842.766404:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990491994ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766424:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3261, 88 off274824 00000004:00080000:2.0:1746143842.766428:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990515591ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766435:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3256, 88 off274032 00000004:00080000:2.0:1746143842.766438:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990525653ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143842.766446:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3262, 88 off274912 00000004:00080000:2.0:1746143842.766448:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990536034ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766455:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3263, 88 off275000 00000004:00080000:2.0:1746143842.766457:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990545441ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766464:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3264, 88 off275088 00000004:00080000:2.0:1746143842.766466:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990554381ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766594:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3265, 88 off275176 00000004:00080000:2.0:1746143842.766598:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 901990685466ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143842.766606:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3257, 88 off274120 00000004:00080000:2.0:1746143842.766608:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 901990695835ns, next at 850789974850ns, rc = 0 00000100:00100000:0.0:1746143842.767081:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625076352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2436us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.767090:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8180 00000001:00080000:2.0:1746143842.769391:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945093 is committed 00000004:00080000:2.0:1746143842.769398:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2470 committed 00000004:00080000:2.0:1746143842.769410:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2481 committed 00000004:00080000:2.0:1746143842.769415:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2480 committed 00000004:00080000:2.0:1746143842.769418:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2479 committed 00000004:00080000:2.0:1746143842.769420:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2478 committed 00000004:00080000:2.0:1746143842.769421:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2469 committed 00000004:00080000:2.0:1746143842.769422:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2477 committed 00000004:00080000:2.0:1746143842.769424:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2468 committed 00000004:00080000:2.0:1746143842.769426:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2476 committed 00000004:00080000:2.0:1746143842.769428:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2467 committed 00000004:00080000:2.0:1746143842.769430:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2466 committed 00000004:00080000:2.0:1746143842.769432:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2465 committed 00000004:00080000:2.0:1746143842.769433:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2475 committed 00000004:00080000:2.0:1746143842.769434:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2474 committed 00000004:00080000:2.0:1746143842.769435:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2464 committed 00000004:00080000:2.0:1746143842.769437:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2463 committed 00000004:00080000:2.0:1746143842.769439:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2473 committed 00000004:00010000:2.0:1746143842.769480:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800961f1f80 reply state ffff88012b7f7800 transno 8589945093 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143842.769496:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746143842.769503:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627502208:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143842.769505:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.769507:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143842.769510:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746143842.769515:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.769516:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143842.769521:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5847 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ebf expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.769536:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627502336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.769547:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.769561:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502208 00000100:00100000:1.0:1746143842.769566:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502208 00000100:00100000:0.0:1746143842.769573:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627502720:0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1746143842.769582:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143842.769586:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.769590:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502720 00000100:00100000:2.0:1746143842.769591:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2843:x1830963625076224:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 8279us (8424us total) trans 8589945093 rc 0/0 00000100:00100000:1.0:1746143842.769591:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502720 00000100:00100000:0.0:1746143842.769596:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143842.769598:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5439 00000100:00100000:0.0:1746143842.769601:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627502592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.769602:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16729 00000100:00100000:1.0:1746143842.769607:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627502208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.769612:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.769624:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627502464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.769624:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627503104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.769634:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.769645:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746143842.769698:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143842.769701:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.769703:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.769704:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:1.0:1746143842.769706:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00010000:00010000:3.0:1746143842.769801:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769812:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769817:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769822:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143842.769825:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769830:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769842:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.769844:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143842.769846:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769850:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b58fd lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.769868:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143842.769875:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143842.769880:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143842.769883:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143842.769885:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143842.769890:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143842.769895:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.769897:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143842.769899:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746143842.769903:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b592e lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746143842.769961:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502592 00000100:00100000:0.0:1746143842.769964:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502592 00000100:00100000:0.0:1746143842.769979:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503104 00000100:00100000:0.0:1746143842.769981:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503104 00000100:00100000:0.0:1746143842.769989:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502464 00000100:00100000:0.0:1746143842.769991:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502464 00000100:00100000:0.0:1746143842.769999:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16730 00000100:00100000:0.0:1746143842.770003:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3774:x1830963627502720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143842.770157:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627503616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.770295:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627502976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.770312:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.770339:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627503488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.770353:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.770370:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627504000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.770401:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3774:x1830963627502208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 793us (853us total) trans 21474841259 rc 0/0 00000100:00100000:1.0:1746143842.770407:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16729 00000100:00100000:1.0:1746143842.770416:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502976 00000100:00100000:1.0:1746143842.770419:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502976 00000100:00100000:1.0:1746143842.770426:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503488 00000100:00100000:1.0:1746143842.770428:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503488 00000100:00100000:1.0:1746143842.770436:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16731 00000100:00100000:1.0:1746143842.770439:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3774:x1830963627502592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143842.770481:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143842.770483:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.770485:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143842.770486:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.770488:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:1.0:1746143842.770506:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3774:x1830963627502592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (892us total) trans 21474841261 rc 0/0 00000100:00100000:1.0:1746143842.770514:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16731 00000100:00100000:1.0:1746143842.770523:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16732 00000100:00100000:1.0:1746143842.770527:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3774:x1830963627503104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.770589:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3774:x1830963627503104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (942us total) trans 21474841262 rc 0/0 00000100:00100000:1.0:1746143842.770595:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16732 00000100:00100000:1.0:1746143842.770603:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16733 00000100:00100000:1.0:1746143842.770607:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3772:x1830963627502464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143842.770641:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143842.770643:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.770645:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.770647:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:1.0:1746143842.770648:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143842.770665:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963627502464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1019us total) trans 21474841263 rc 0/0 00000100:00100000:1.0:1746143842.770670:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16733 00000100:00100000:1.0:1746143842.770683:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16734 00000100:00100000:1.0:1746143842.770687:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3772:x1830963627502976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.770746:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963627502976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (420us total) trans 21474841264 rc 0/0 00000100:00100000:1.0:1746143842.770751:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16734 00000100:00100000:1.0:1746143842.770760:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16735 00000100:00100000:1.0:1746143842.770764:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3772:x1830963627503488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143842.770813:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:1.0:1746143842.770815:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.770817:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.770818:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:1.0:1746143842.770820:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:2.0:1746143842.771061:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.771884:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.771894:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3774:x1830963627502720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1889us (2305us total) trans 21474841260 rc 0/0 00000100:00100000:0.0:1746143842.771902:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16730 00000100:00100000:3.0:1746143842.771908:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627504128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.771930:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627504000 00000100:00100000:0.0:1746143842.771934:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627504000 00000100:00100000:3.0:1746143842.771947:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.771949:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503616 00000100:00100000:0.0:1746143842.771950:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503616 00000100:00100000:0.0:1746143842.771956:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627504128 00000100:00100000:0.0:1746143842.771957:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627504128 00000100:00100000:3.0:1746143842.771958:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143842.771962:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627503232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.771965:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16736 00000100:00100000:0.0:1746143842.771969:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3772:x1830963627504000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.771975:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.771982:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627503744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.771997:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746143842.772031:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143842.772033:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.772035:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143842.772037:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.772038:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143842.772059:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3772:x1830963627504000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (998us total) trans 17179873989 rc 0/0 00000100:00100000:0.0:1746143842.772064:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16736 00000100:00100000:0.0:1746143842.772072:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503232 00000100:00100000:0.0:1746143842.772074:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503232 00000100:00100000:0.0:1746143842.772081:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503744 00000100:00100000:0.0:1746143842.772082:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503744 00000100:00100000:0.0:1746143842.772089:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16737 00000100:00100000:0.0:1746143842.772092:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963627503616:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.772131:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7a300/2, rc 0, transno 17179873989 00000100:00100000:2.0:1746143842.772139:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627504000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.772146:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963627503616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (262us total) trans 17179873990 rc 0/0 00000004:00080000:2.0:1746143842.772147:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5ad80/2, rc 0, transno 21474841263 00000100:00100000:0.0:1746143842.772150:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16737 00000100:00100000:2.0:1746143842.772151:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627502464:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.772156:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58380/2, rc 0, transno 21474841264 00000100:00100000:2.0:1746143842.772159:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627502976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.772159:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16738 00000100:00100000:0.0:1746143842.772162:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963627504128:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.772168:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78a80/2, rc 0, transno 17179873988 00000100:00100000:2.0:1746143842.772171:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627503488:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143842.772202:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:0.0:1746143842.772204:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.772205:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143842.772206:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.772208:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143842.772225:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963627504128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (278us total) trans 17179873991 rc 0/0 00000100:00100000:0.0:1746143842.772230:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16738 00000100:00100000:0.0:1746143842.772237:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16739 00000100:00100000:1.0:1746143842.772310:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963627503488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1102us (1513us total) trans 17179873988 rc 0/0 00000100:00100000:1.0:1746143842.772316:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16735 00000100:00100000:1.0:1746143842.772339:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16740 00000100:00100000:1.0:1746143842.772345:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627503744:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143842.772351:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7ad80/2, rc 0, transno 17179873990 00000100:00100000:3.0:1746143842.772354:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627503616:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143842.772359:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7a680/2, rc 0, transno 17179873991 00000100:00100000:3.0:1746143842.772361:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627504128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.772364:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143842.772368:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627504256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.772383:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.772397:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627504256 00000100:00100000:1.0:1746143842.772416:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3773:x1830963627503744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (416us total) trans 17179873992 rc 0/0 00000100:00100000:1.0:1746143842.772421:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16740 00000100:00100000:1.0:1746143842.772440:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.772454:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627502848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.772471:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.772483:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627503360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.772490:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502336 00000100:00100000:2.0:1746143842.772493:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502336 00000100:00100000:1.0:1746143842.772496:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.772502:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627503872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.772506:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627502848 00000100:00100000:2.0:1746143842.772508:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627502848 00000100:00100000:2.0:1746143842.772512:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503360 00000100:00100000:2.0:1746143842.772514:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503360 00000100:00100000:1.0:1746143842.772514:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143842.772519:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627503872 00000100:00100000:2.0:1746143842.772520:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627503872 00000100:00100000:2.0:1746143842.772528:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16741 00000100:00100000:2.0:1746143842.772531:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627502336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.772540:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16742 00000100:00100000:1.0:1746143842.772545:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627502848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143842.772593:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:1.0:1746143842.772596:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.772598:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143842.772599:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.772602:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:1.0:1746143842.772622:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627502848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (150us total) trans 21474841265 rc 0/0 00000100:00100000:1.0:1746143842.772627:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16742 00000100:00100000:1.0:1746143842.772637:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16743 00000100:00100000:1.0:1746143842.772641:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3771:x1830963627503360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143842.772676:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143842.772679:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.772681:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.772682:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:1.0:1746143842.772684:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143842.772700:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3771:x1830963627503360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (203us total) trans 17179873993 rc 0/0 00000100:00100000:1.0:1746143842.772704:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16743 00000100:00100000:1.0:1746143842.772713:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16744 00000100:00100000:1.0:1746143842.772717:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3771:x1830963627503872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.772767:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3771:x1830963627503872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (252us total) trans 17179873994 rc 0/0 00000100:00100000:1.0:1746143842.772772:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16744 00000004:00080000:1.0:1746143842.772790:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7bb80/2, rc 0, transno 17179873993 00000100:00100000:1.0:1746143842.772794:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627503360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143842.772799:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78700/2, rc 0, transno 17179873994 00000100:00100000:1.0:1746143842.772802:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627503872:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143842.772807:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5b100/2, rc 0, transno 21474841265 00000100:00100000:1.0:1746143842.772809:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627502848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.772909:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3773:x1830963627503232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143842.772971:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143842.772973:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.772975:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.772977:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:0.0:1746143842.772978:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:0.0:1746143842.772996:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627503232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 755us (1020us total) trans 17179873995 rc 0/0 00000100:00100000:0.0:1746143842.773001:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16739 00000004:00080000:0.0:1746143842.773024:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59880/2, rc 0, transno 21474841261 00000100:00100000:0.0:1746143842.773027:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627502592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143842.773033:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5a680/2, rc 0, transno 21474841262 00000100:00100000:0.0:1746143842.773035:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627503104:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143842.773042:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59f80/2, rc 0, transno 21474841260 00000100:00100000:0.0:1746143842.773044:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627502720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143842.773050:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5bb80/2, rc 0, transno 21474841259 00000100:00100000:3.0:1746143842.773052:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627504256 00000100:00100000:0.0:1746143842.773052:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627502208:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143842.773130:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143842.773133:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:2.0:1746143842.773135:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:2.0:1746143842.773136:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:2.0:1746143842.773138:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000004:00080000:3.0:1746143842.773167:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79c00/2, rc 0, transno 17179873995 00000100:00100000:3.0:1746143842.773170:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627503232:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143842.773177:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78000/2, rc 0, transno 17179873992 00000100:00100000:3.0:1746143842.773179:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627503744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.773235:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16745 00000100:00100000:3.0:1746143842.773239:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627504256:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143842.773255:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58000/2, rc 0, transno 21474841266 00000100:00100000:1.0:1746143842.773259:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627502336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.773352:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627502336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 690us (781us total) trans 21474841266 rc 0/0 00000100:00100000:2.0:1746143842.773359:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16741 00000100:00100000:3.0:1746143842.773875:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627504256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 634us (1489us total) trans 17179873996 rc 0/0 00000100:00100000:3.0:1746143842.773880:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16745 00000004:00080000:0.0:1746143842.773948:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129dc3800/2, rc 0, transno 17179873996 00000100:00100000:0.0:1746143842.773952:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627504256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.779205:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.779284:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625076480 00000100:00100000:2.0:1746143842.779292:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625076480 00000100:00100000:2.0:1746143842.779397:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14022 00000100:00100000:2.0:1746143842.779405:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2843:x1830963625076480:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143842.779424:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.779440:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f28 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.779606:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.779618:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.779631:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.779633:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143842.779636:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513400, rc 0) 00000100:00100000:2.0:1746143842.779857:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2843:x1830963625076480:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 452us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.779862:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14022 00000100:00100000:0.0:1746143842.782950:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.783032:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625076736 00000100:00100000:2.0:1746143842.783040:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625076736 00000100:00100000:2.0:1746143842.783089:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5440 00000100:00100000:2.0:1746143842.783095:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2843:x1830963625076736:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143842.784543:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2843:x1830963625076736:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1442us (1628us total) trans 8589945094 rc 0/0 00000100:00100000:2.0:1746143842.784551:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5440 00000100:00100000:0.0:1746143842.811577:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.811664:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625076992 00000100:00100000:2.0:1746143842.811672:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625076992 00000100:00100000:2.0:1746143842.811724:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14023 00000100:00100000:2.0:1746143842.811729:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2851:x1830963625076992:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143842.811746:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.811760:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b593c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f2f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.811818:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811829:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811837:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811847:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811852:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811856:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811959:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811967:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.811972:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143842.811979:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143842.812034:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812040:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812052:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812058:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812063:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143842.812066:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812071:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812080:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143842.812083:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143842.812092:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812100:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b5943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812122:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812127:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812131:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812136:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143842.812138:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812146:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812156:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8e00) 00010000:00010000:2.0:1746143842.812158:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143842.812160:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812172:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513200/0x87925e4cb73b594a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.812467:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b593c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.812479:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.812485:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.812487:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143842.812489:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717600, rc 0) 00000100:00100000:2.0:1746143842.812546:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2851:x1830963625076992:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 816us (985us total) trans 8589945095 rc 0/0 00000100:00100000:2.0:1746143842.812552:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14023 00000100:00100000:1.0:1746143842.816331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.816414:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625077248 00000100:00100000:2.0:1746143842.816421:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625077248 00000100:00100000:2.0:1746143842.816471:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14024 00000100:00100000:2.0:1746143842.816478:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+260:2856:x1830963625077248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.816497:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.816517:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b595f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f36 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.816579:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816722:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816733:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816744:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816749:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816753:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816826:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816833:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816838:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143842.816844:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143842.816899:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816904:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816908:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816988:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.816993:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad34000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143842.816996:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817002:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817011:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143842.817013:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143842.817016:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817021:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817030:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817035:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817039:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817043:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad35800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143842.817045:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817053:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817058:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8800) 00010000:00010000:2.0:1746143842.817059:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143842.817061:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817066:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad35800/0x87925e4cb73b596d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143842.817096:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513000/0x87925e4cb73b595f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.817107:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.817112:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.817114:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143842.817116:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:2.0:1746143842.817159:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2856:x1830963625077248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 680us (844us total) trans 8589945096 rc 0/0 00000100:00100000:2.0:1746143842.817165:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14024 00000100:00100000:0.0:1746143842.821160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.821201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.821235:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.821254:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625077504 00000100:00100000:0.0:1746143842.821261:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625077504 00000100:00100000:0.0:1746143842.821296:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625077760 00000100:00100000:0.0:1746143842.821298:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625077760 00000100:00100000:0.0:1746143842.821315:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14025 00000100:00100000:0.0:1746143842.821329:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2855:x1830963625077504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143842.821349:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.821373:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b5982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f3d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821459:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b5989 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.821470:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b5989 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.821480:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b5989 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143842.821488:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143842.821563:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97200/0x87925e4cb73b5982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f3d expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821579:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b5989 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f3d expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821586:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143842.821588:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746143842.821590:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96600, rc 0) 00000100:00100000:0.0:1746143842.821622:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2855:x1830963625077504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 301us (473us total) trans 8589945097 rc 0/0 00000100:00100000:0.0:1746143842.821628:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14025 00000100:00100000:0.0:1746143842.821640:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14026 00000100:00100000:0.0:1746143842.821645:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:2853:x1830963625077760:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143842.821652:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.821657:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b5997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f44 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821685:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.821693:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821700:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821706:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.821736:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821745:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 263 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.821755:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627504384:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143842.821816:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.821823:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 10 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.821830:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627504512:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.821848:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8c600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.822112:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625077888 00000100:00100000:3.0:1746143842.822116:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625077888 00000100:00100000:3.0:1746143842.822137:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16746 00000100:00100000:3.0:1746143842.822141:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+39:2856:x1830963625077888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.822149:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.822156:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f4b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.822173:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.822179:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.822180:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.822183:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.822197:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.822203:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143842.822211:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627504640:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.822235:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.825230:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627504384:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.825241:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627504512:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.825260:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143842.825340:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627504640:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.825359:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.825372:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635000, rc 0) 00000100:00100000:0.0:1746143842.825415:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.825465:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078272 00000100:00100000:2.0:1746143842.825470:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078272 00000100:00100000:2.0:1746143842.825503:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14027 00000100:00100000:2.0:1746143842.825509:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2855:x1830963625078272:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.825523:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.825534:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b59ac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f52 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.826158:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.826168:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.826173:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.826185:0:10936:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.826193:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143842.826431:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.826446:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.826461:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.826475:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078016 00000100:00100000:0.0:1746143842.826478:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078016 00010000:00010000:0.0:1746143842.826496:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 13 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.826518:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078400 00000100:00100000:0.0:1746143842.826520:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078400 00010000:00010000:0.0:1746143842.826530:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.826541:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078144 00000100:00100000:0.0:1746143842.826543:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078144 00010000:00010000:0.0:1746143842.826550:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 264 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.826567:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8181 00000100:00100000:0.0:1746143842.826572:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625078016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.826579:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.826583:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 13 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.826591:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 13 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.826606:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093717600/0x87925e4cb73b5951 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f2f expref: 13 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.826616:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143842.826620:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.826625:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143842.826630:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.826634:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143842.826638:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.826659:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625078016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.826665:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8181 00000100:00100000:0.0:1746143842.826696:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8182 00000100:00100000:0.0:1746143842.826701:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625078400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.826714:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.826728:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.826735:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.826744:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8183 00010000:00010000:0.0:1746143842.826748:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b5904 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411efe expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.826752:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963625078144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.826757:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.826759:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.826759:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.826764:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 264 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.826764:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.826770:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.826772:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 264 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.826783:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30e00/0x87925e4cb73b5974 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f36 expref: 264 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.826792:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.826795:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.826798:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143842.826802:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627504768:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.826804:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.826809:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.826815:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143842.826820:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143842.826824:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143842.826831:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122667300 going to sleep for 11 seconds 00010000:00010000:1.0:1746143842.826840:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.826858:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963625078144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.826864:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8183 00010000:00010000:2.0:1746143842.826944:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.826951:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143842.826963:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143842.827046:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b5997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.827063:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 263 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.827069:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 263 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.827074:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323b200, rc 0) 00000100:00100000:2.0:1746143842.827105:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2853:x1830963625077760:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5459us (5869us total) trans 8589945098 rc 0/0 00000100:00100000:2.0:1746143842.827111:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14026 00000100:00100000:3.0:1746143842.827172:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2856:x1830963625077888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5028us (5968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.827179:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16746 00000100:00100000:0.0:1746143842.830240:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.830706:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627504768:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.830721:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.831350:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625078400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4646us (4901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.831361:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8182 00000100:00100000:0.0:1746143842.831423:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.831491:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078784 00000100:00100000:2.0:1746143842.831496:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078784 00010000:00010000:2.0:1746143842.831519:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 263 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.831549:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8184 00000100:00100000:2.0:1746143842.831555:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963625078784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.831565:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.831570:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 263 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.831584:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 263 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.831602:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b599e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f44 expref: 263 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.831613:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143842.831616:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.831629:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.831636:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.831650:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.831660:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078656 00000100:00100000:3.0:1746143842.831665:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078656 00000100:00100000:3.0:1746143842.831688:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14028 00000100:00100000:3.0:1746143842.831693:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2851:x1830963625078656:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143842.831706:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.831708:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143842.831717:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b5989 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f3d expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.831730:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.831732:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143842.831739:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b59c1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f59 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.831742:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:2008:x1830963625078784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 185us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.831748:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8184 00010000:00010000:3.0:1746143842.831768:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143842.831770:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143842.831775:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.831776:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143842.831781:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.831785:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.831801:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746143842.831808:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143842.831810:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 7 pid: 7244 timeout: 1002 lvb_type: 0 00000004:00200000:2.0:1746143842.831811:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1746143842.831821:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627504896:192.168.202.3@tcp:104: 00000004:00010000:2.0:1746143842.831825:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000020 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143842.831856:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b59ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.831866:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.831872:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143842.831878:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627505024:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.831889:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.831995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.832204:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625078912 00000100:00100000:3.0:1746143842.832208:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625078912 00000100:00100000:3.0:1746143842.832230:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14029 00000100:00100000:3.0:1746143842.832235:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2856:x1830963625078912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.832243:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.832249:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f60 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.832507:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.832514:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.832520:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00010000:00010000:3.0:1746143842.832581:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.832588:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.832599:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.832607:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.832616:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.832618:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143842.832620:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.832625:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133566800, rc 0) 00000100:00100000:2.0:1746143842.832831:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2855:x1830963625078272:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7320us (7416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.832837:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14027 00000100:00100000:3.0:1746143842.833001:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2856:x1830963625078912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 765us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.833007:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14029 00000100:00100000:3.0:1746143842.835580:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.835605:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079040 00000100:00100000:3.0:1746143842.835610:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079040 00010000:00010000:3.0:1746143842.835633:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 8 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143842.835666:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8185 00000100:00100000:3.0:1746143842.835671:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625079040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.835681:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.835686:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 8 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.835695:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 8 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.835711:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.835714:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.835724:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143842.835728:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.835757:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625079040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.835763:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8185 00010000:00010000:0.0:1746143842.835803:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b5935 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f28 expref: 7 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.835836:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627504896:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.835928:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627505024:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143842.835956:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143842.835960:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.836394:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079168 00000100:00100000:1.0:1746143842.836398:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079168 00010000:00010000:1.0:1746143842.836413:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.836428:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8186 00000100:00100000:1.0:1746143842.836432:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2011:x1830963625079168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.836438:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.836442:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.836450:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.836460:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b59b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f52 expref: 12 pid: 10936 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.836474:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.836477:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.836486:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.836491:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143842.836497:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.836512:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.836534:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625079168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.836539:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8186 00010000:00010000:0.0:1746143842.836596:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143842.836603:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000040:00080000:0.0:1746143842.836975:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3266, 88 off275264 00000004:00080000:0.0:1746143842.836981:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061067945ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837008:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3258, 88 off274208 00000004:00080000:0.0:1746143842.837011:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061098931ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837021:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3259, 88 off274296 00000004:00080000:0.0:1746143842.837025:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061112800ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837031:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3267, 88 off275352 00000004:00080000:0.0:1746143842.837034:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061121541ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837039:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3268, 88 off275440 00000004:00080000:0.0:1746143842.837041:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061129320ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837049:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3260, 88 off274384 00000004:00080000:0.0:1746143842.837052:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061139582ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837153:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3261, 88 off274472 00000004:00080000:0.0:1746143842.837158:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061245517ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837180:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3262, 88 off274560 00000004:00080000:0.0:1746143842.837182:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061270163ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837190:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3269, 88 off275528 00000004:00080000:0.0:1746143842.837193:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061280573ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837199:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3263, 88 off274648 00000004:00080000:0.0:1746143842.837201:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061289225ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837210:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3270, 88 off275616 00000004:00080000:0.0:1746143842.837212:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061299920ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837219:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3264, 88 off274736 00000004:00080000:0.0:1746143842.837221:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061309167ns, next at 850789974850ns, rc = 0 00000040:00080000:0.0:1746143842.837229:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3271, 88 off275704 00000004:00080000:0.0:1746143842.837231:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061319497ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837238:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3272, 88 off275792 00000004:00080000:0.0:1746143842.837240:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061327971ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837246:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3273, 88 off275880 00000004:00080000:0.0:1746143842.837248:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061336075ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837255:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3274, 88 off275968 00000004:00080000:0.0:1746143842.837257:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 902061345296ns, next at 850790015893ns, rc = 0 00000040:00080000:0.0:1746143842.837265:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3265, 88 off274824 00000004:00080000:0.0:1746143842.837268:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 902061355877ns, next at 850789974850ns, rc = 0 00000100:00100000:0.0:1746143842.837370:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.837411:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079296 00000100:00100000:3.0:1746143842.837415:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079296 00000100:00100000:3.0:1746143842.837437:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14030 00000100:00100000:3.0:1746143842.837441:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2855:x1830963625079296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.837453:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.837463:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f67 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.837498:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.837506:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.837514:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.837516:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143842.837518:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.837523:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:3.0:1746143842.837779:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2855:x1830963625079296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 336us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.837784:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14030 00000001:00080000:2.0:1746143842.839949:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945099 is committed 00000004:00080000:2.0:1746143842.839961:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2478 committed 00000004:00080000:2.0:1746143842.839978:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2490 committed 00000004:00080000:2.0:1746143842.839989:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2489 committed 00000004:00080000:2.0:1746143842.839994:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2488 committed 00000004:00080000:2.0:1746143842.839996:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2487 committed 00000004:00080000:2.0:1746143842.839997:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2477 committed 00000004:00080000:2.0:1746143842.839999:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2486 committed 00000004:00080000:2.0:1746143842.840000:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2476 committed 00000004:00080000:2.0:1746143842.840002:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2485 committed 00000004:00080000:2.0:1746143842.840004:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2475 committed 00000004:00080000:2.0:1746143842.840005:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2474 committed 00000004:00080000:2.0:1746143842.840007:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2473 committed 00000004:00080000:2.0:1746143842.840008:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2484 committed 00000004:00080000:2.0:1746143842.840011:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2483 committed 00000004:00080000:2.0:1746143842.840013:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2472 committed 00000004:00080000:2.0:1746143842.840015:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2471 committed 00000004:00080000:2.0:1746143842.840016:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2482 committed 00000001:00080000:2.0:1746143842.840021:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945098 is committed 00000001:00080000:2.0:1746143842.840033:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945094 is committed 00000100:00100000:2.0:1746143842.840065:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627505280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.840123:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627505152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840156:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.840190:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627505664:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.840204:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505152 00000100:00100000:1.0:1746143842.840205:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.840210:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505152 00000100:00100000:1.0:1746143842.840217:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840230:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.840240:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505664 00000100:00100000:3.0:1746143842.840242:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505664 00000100:00100000:1.0:1746143842.840244:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840257:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.840258:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506176 00000100:00100000:3.0:1746143842.840260:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506176 00000100:00100000:0.0:1746143842.840264:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627505536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.840271:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506688 00000100:00100000:3.0:1746143842.840272:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506688 00000100:00100000:1.0:1746143842.840274:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746143842.840280:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627505792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.840286:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16747 00000100:00100000:0.0:1746143842.840290:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.840292:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3771:x1830963627505152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840303:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505536 00000100:00100000:1.0:1746143842.840308:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505536 00000100:00100000:0.0:1746143842.840310:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.840338:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.840349:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506048 00000100:00100000:0.0:1746143842.840350:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840352:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506048 00000100:00100000:0.0:1746143842.840364:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.840366:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16748 00000100:00100000:0.0:1746143842.840370:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627507072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840372:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3771:x1830963627505664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.840382:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.840391:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00002000:00010000:3.0:1746143842.840394:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746143842.840395:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627505408:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143842.840397:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.840399:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.840406:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00000100:00100000:0.0:1746143842.840406:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746143842.840408:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143842.840412:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627505920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.840426:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.840445:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.840453:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3771:x1830963627505152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (296us total) trans 21474841267 rc 0/0 00000100:00100000:2.0:1746143842.840455:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.840459:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16747 00002000:00010000:1.0:1746143842.840464:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:1.0:1746143842.840467:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.840469:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:1.0:1746143842.840471:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00000100:00100000:3.0:1746143842.840472:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506432 00000100:00100000:0.0:1746143842.840472:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627507072 00002000:00010000:1.0:1746143842.840473:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:3.0:1746143842.840474:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506432 00000100:00100000:0.0:1746143842.840475:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627507072 00000100:00100000:3.0:1746143842.840482:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505408 00000100:00100000:3.0:1746143842.840484:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505408 00000100:00100000:2.0:1746143842.840488:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505920 00000100:00100000:0.0:1746143842.840489:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505280 00000100:00100000:2.0:1746143842.840490:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505920 00000100:00100000:0.0:1746143842.840490:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505280 00000100:00100000:3.0:1746143842.840494:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16749 00000100:00100000:1.0:1746143842.840496:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627505664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (289us total) trans 17179873997 rc 0/0 00000100:00100000:3.0:1746143842.840497:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3771:x1830963627506176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.840500:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16750 00000100:00100000:1.0:1746143842.840504:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16748 00000100:00100000:0.0:1746143842.840505:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3771:x1830963627506688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.840507:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16751 00000100:00100000:2.0:1746143842.840511:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3774:x1830963627505536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.840518:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16752 00000100:00100000:1.0:1746143842.840522:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3774:x1830963627506048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143842.840542:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143842.840544:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.840547:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.840548:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:3.0:1746143842.840550:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:2.0:1746143842.840569:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143842.840571:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:2.0:1746143842.840573:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00000100:00100000:3.0:1746143842.840575:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3771:x1830963627506176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (343us total) trans 21474841268 rc 0/0 00002000:00010000:2.0:1746143842.840575:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:2.0:1746143842.840577:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143842.840580:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3774:x1830963627506048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (241us total) trans 17179873999 rc 0/0 00000100:00100000:3.0:1746143842.840581:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16749 00000100:00100000:0.0:1746143842.840581:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3771:x1830963627506688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (321us total) trans 21474841269 rc 0/0 00000100:00100000:1.0:1746143842.840586:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16752 00000100:00100000:2.0:1746143842.840591:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3774:x1830963627505536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (301us total) trans 17179873998 rc 0/0 00000100:00100000:0.0:1746143842.840591:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16750 00000100:00100000:3.0:1746143842.840595:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16753 00000100:00100000:2.0:1746143842.840599:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16751 00000100:00100000:3.0:1746143842.840600:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3774:x1830963627506432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840603:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16754 00000100:00100000:0.0:1746143842.840606:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16755 00000100:00100000:1.0:1746143842.840607:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3774:x1830963627507072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.840609:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16756 00000100:00100000:0.0:1746143842.840610:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3774:x1830963627505408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.840612:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3772:x1830963627505280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143842.840646:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143842.840648:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00000100:00100000:1.0:1746143842.840649:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16757 00002000:00010000:2.0:1746143842.840650:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:3.0:1746143842.840651:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143842.840652:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00002000:00010000:2.0:1746143842.840653:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:1.0:1746143842.840653:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3774:x1830963627505920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143842.840654:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143842.840656:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143842.840657:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143842.840659:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00002000:00010000:0.0:1746143842.840672:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143842.840674:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.840676:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143842 -> 1746143842 00002000:00010000:0.0:1746143842.840678:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143843 -> 1746143843 00000100:00100000:2.0:1746143842.840679:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3772:x1830963627505280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (223us total) trans 17179874000 rc 0/0 00002000:00010000:0.0:1746143842.840680:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143842.840684:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3774:x1830963627506432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (319us total) trans 21474841270 rc 0/0 00000100:00100000:2.0:1746143842.840684:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16756 00000100:00100000:3.0:1746143842.840689:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16753 00000100:00100000:0.0:1746143842.840695:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3774:x1830963627505408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (287us total) trans 21474841271 rc 0/0 00000100:00100000:2.0:1746143842.840697:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143842.840700:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16755 00000100:00100000:1.0:1746143842.840704:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3774:x1830963627505920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (276us total) trans 17179874001 rc 0/0 00000100:00100000:1.0:1746143842.840709:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16757 00000100:00100000:0.0:1746143842.840709:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506560 00000100:00100000:0.0:1746143842.840712:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506560 00000100:00100000:2.0:1746143842.840713:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.840721:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16758 00000100:00100000:1.0:1746143842.840725:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3774:x1830963627506560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143842.840729:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143842.840735:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506944 00000100:00100000:3.0:1746143842.840738:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506944 00000100:00100000:0.0:1746143842.840748:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3774:x1830963627507072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (365us total) trans 21474841272 rc 0/0 00000100:00100000:3.0:1746143842.840752:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16759 00000004:00080000:2.0:1746143842.840754:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f64aa00/2, rc 0, transno 17179873998 00000100:00100000:0.0:1746143842.840755:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16754 00000100:00100000:3.0:1746143842.840756:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3774:x1830963627506944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143842.840762:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627505536:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143842.840765:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00000004:00080000:2.0:1746143842.840769:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492a00/2, rc 0, transno 17179873999 00000100:00100000:2.0:1746143842.840772:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143842.840780:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136336d80/2, rc 0, transno 21474841270 00000100:00100000:2.0:1746143842.840782:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.840788:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719ed80/2, rc 0, transno 21474841272 00000100:00100000:2.0:1746143842.840790:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627507072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.840797:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136337800/2, rc 0, transno 21474841271 00000100:00100000:2.0:1746143842.840800:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627505408:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143842.840803:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746143842.840805:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492680/2, rc 0, transno 17179874001 00000100:00100000:2.0:1746143842.840808:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627505920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.840809:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3774:x1830963627506944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (78us total) trans 21474841273 rc 0/0 00010000:00010000:0.0:1746143842.840813:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:3.0:1746143842.840814:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16759 00000004:00080000:2.0:1746143842.840816:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719ca80/2, rc 0, transno 21474841273 00010000:00010000:0.0:1746143842.840816:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1746143842.840818:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506944:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143842.840820:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.840830:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746143842.840834:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f648000/2, rc 0, transno 17179874000 00000100:00100000:2.0:1746143842.840837:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627505280:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143842.840841:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.840843:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746143842.840847:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627507200:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746143842.840854:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.840861:0:6587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.840864:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746143842.840867:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.840891:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.840900:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627507328:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143842.840971:0:6587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 260 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.840979:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627507456:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143842.840992:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00002000:00010000:1.0:1746143842.841305:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.841307:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143842.841309:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143842.841310:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:1.0:1746143842.841357:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3774:x1830963627506560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 630us (658us total) trans 17179874002 rc 0/0 00000100:00100000:1.0:1746143842.841362:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16758 00000100:00100000:1.0:1746143842.841371:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627507200 00000100:00100000:1.0:1746143842.841374:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627507200 00000100:00100000:1.0:1746143842.841384:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16760 00000100:00100000:1.0:1746143842.841388:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3772:x1830963627507200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.841444:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3772:x1830963627507200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (579us total) trans 17179874003 rc 0/0 00000100:00100000:1.0:1746143842.841448:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16760 00000100:00100000:1.0:1746143842.841473:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.841501:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.841519:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143842.841529:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143842.841541:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143842.841556:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136334000/2, rc 0, transno 21474841267 00000100:00100000:1.0:1746143842.841559:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627505152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143842.841567:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457f100/2, rc 0, transno 17179873997 00000100:00100000:1.0:1746143842.841570:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627505664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143842.841578:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136336680/2, rc 0, transno 21474841268 00000100:00100000:1.0:1746143842.841581:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143842.841587:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719dc00/2, rc 0, transno 21474841269 00000100:00100000:1.0:1746143842.841589:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.841598:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32300/2, rc 0, transno 17179874002 00000100:00100000:1.0:1746143842.841601:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627505792 00000100:00100000:1.0:1746143842.841604:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627505792 00000100:00100000:2.0:1746143842.841605:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627506560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.841616:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506304 00000100:00100000:1.0:1746143842.841618:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506304 00000100:00100000:2.0:1746143842.841622:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627506816 00000100:00100000:2.0:1746143842.841625:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627506816 00000100:00100000:1.0:1746143842.841630:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16761 00000100:00100000:1.0:1746143842.841633:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3771:x1830963627505792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143842.841638:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16762 00000100:00100000:0.0:1746143842.841646:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3771:x1830963627506304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143842.841650:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16763 00000100:00100000:3.0:1746143842.841657:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3771:x1830963627506816:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143842.841667:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31f80/2, rc 0, transno 17179874003 00000100:00100000:2.0:1746143842.841671:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627507200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143842.841687:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3771:x1830963627505792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (213us total) trans 17179874004 rc 0/0 00000100:00100000:1.0:1746143842.841692:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16761 00002000:00010000:0.0:1746143842.841698:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143842.841701:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143842.841702:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143842.841703:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143842.841705:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143842.841707:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00002000:00010000:3.0:1746143842.841712:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143842.841714:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143842.841716:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143842.841718:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143842.841726:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3771:x1830963627506304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (206us total) trans 17179874005 rc 0/0 00000100:00100000:0.0:1746143842.841732:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16762 00000100:00100000:3.0:1746143842.841745:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3771:x1830963627506816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (202us total) trans 21474841274 rc 0/0 00000100:00100000:3.0:1746143842.841750:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16763 00000004:00080000:1.0:1746143842.841795:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e358e00/2, rc 0, transno 17179874004 00000100:00100000:1.0:1746143842.841798:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627505792:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143842.841803:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33100/2, rc 0, transno 17179874005 00000100:00100000:1.0:1746143842.841806:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143842.841812:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719fb80/2, rc 0, transno 21474841274 00000100:00100000:1.0:1746143842.841815:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627506816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143842.843755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.843792:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.843817:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627507456:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.843858:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079552 00000100:00100000:1.0:1746143842.843865:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079552 00000100:00100000:1.0:1746143842.843904:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14031 00000100:00100000:1.0:1746143842.843943:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+261:2853:x1830963625079552:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143842.843960:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.843977:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73b59dd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f6e expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.844034:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73b59dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f6e expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.844047:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73b59dd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f6e expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.844065:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143842.844067:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143842.844071:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:1.0:1746143842.844110:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:2853:x1830963625079552:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 199us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.844115:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14031 00000100:00100000:0.0:1746143842.844118:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.844528:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627507328:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.844560:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b59c1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 10 pid: 6587 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143842.844601:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.844625:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634400, rc 0) 00000100:00100000:2.0:1746143842.844667:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2851:x1830963625078656:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12973us (14432us total) trans 8589945099 rc 0/0 00000100:00100000:2.0:1746143842.844674:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14028 00000100:00100000:3.0:1746143842.844935:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079424 00000100:00100000:3.0:1746143842.844941:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079424 00000100:00100000:3.0:1746143842.844967:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079680 00000100:00100000:3.0:1746143842.844969:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079680 00000100:00100000:3.0:1746143842.844978:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5441 00000100:00100000:3.0:1746143842.844983:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:2856:x1830963625079424:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:0.0:1746143842.844984:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5442 00000100:00100000:0.0:1746143842.844992:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e24a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2855:x1830963625079680:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:3.0:1746143842.845054:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:2856:x1830963625079424:12345-192.168.202.3@tcp:49:cat.0 Request processed in 71us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.845060:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5441 00000100:00100000:0.0:1746143842.845334:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e24a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2855:x1830963625079680:12345-192.168.202.3@tcp:49:cat.0 Request processed in 342us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.845340:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5442 00000100:00100000:1.0:1746143842.845464:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.846825:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079808 00000100:00100000:0.0:1746143842.846832:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079808 00000100:00100000:0.0:1746143842.846879:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5443 00000100:00100000:0.0:1746143842.846885:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:2853:x1830963625079808:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:0.0:1746143842.847004:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:2853:x1830963625079808:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 118us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.847010:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5443 00000100:00100000:1.0:1746143842.847737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.847774:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625079936 00000100:00100000:1.0:1746143842.847775:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.847778:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625079936 00000100:00100000:3.0:1746143842.847804:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 999 00000100:00100000:3.0:1746143842.847815:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:2010:x1830963625079936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.847822:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143842.847835:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625080064 00000100:00100000:2.0:1746143842.847838:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625080064 00010000:00010000:3.0:1746143842.847841:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84e800/0x87925e4cb73b59dd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f6e expref: 262 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.847856:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143842.847859:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.847865:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5444 00000100:00100000:2.0:1746143842.847870:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2851:x1830963625080064:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143842.847876:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+261:2010:x1830963625079936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 68us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.847881:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 999 00000100:00100000:2.0:1746143842.847941:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2851:x1830963625080064:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.847949:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5444 00000100:00100000:0.0:1746143842.849589:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.849652:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625080192 00000100:00100000:1.0:1746143842.849659:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625080192 00000100:00100000:1.0:1746143842.849698:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16764 00000100:00100000:1.0:1746143842.849705:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2855:x1830963625080192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.849716:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.849728:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f75 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.849750:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.849752:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.849757:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.849773:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.849781:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ee00, rc 0) 00000100:00100000:1.0:1746143842.849814:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2855:x1830963625080192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.849819:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16764 00000100:00100000:2.0:1746143842.852264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.852589:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.852644:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625080320 00000100:00100000:0.0:1746143842.852652:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625080320 00000100:00100000:0.0:1746143842.852699:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16765 00000100:00100000:0.0:1746143842.852705:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2851:x1830963625080320:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143842.852717:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143842.852731:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f7c expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.852754:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.852760:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143842.852761:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143842.852764:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3792896->4108287] (req 3792896->4108287) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.852789:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.852799:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 13 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.852809:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627507584:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.852869:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.852903:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625080576 00000100:00100000:3.0:1746143842.852908:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625080576 00002000:00100000:3.0:1746143842.852948:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880093f7a680 x1830963625080576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.852956:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f7a680 with x1830963625080576 ext(0->1048575) 00002000:00010000:3.0:1746143842.852960:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f7a680 00000100:00100000:3.0:1746143842.852974:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7290 00000100:00100000:3.0:1746143842.852978:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625080576:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143842.853698:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.853737:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625080832 00000100:00100000:1.0:1746143842.853741:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625080832 00002000:00100000:1.0:1746143842.853757:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009eb87100 x1830963625080832/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.853764:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87100 with x1830963625080832 ext(0->1048575) 00002000:00010000:1.0:1746143842.853767:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87100 00000100:00100000:1.0:1746143842.853781:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7291 00000100:00100000:1.0:1746143842.853785:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625080832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143842.857124:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627507584:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.857125:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143842.857148:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3792896->4108287] (req 3792896->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.857162:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7e00, rc 0) 00000100:00100000:1.0:1746143842.857203:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2851:x1830963625080320:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4497us (4945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.857208:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625080960 00000100:00100000:1.0:1746143842.857211:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16765 00000100:00100000:3.0:1746143842.857214:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625080960 00010000:00010000:3.0:1746143842.857235:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143842.857265:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8187 00000100:00100000:3.0:1746143842.857270:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625080960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143842.857280:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143842.857295:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.857308:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.857334:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27000/0x87925e4cb73b5920 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f1a expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.857349:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.857350:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.857356:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.857362:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.857383:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.857391:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627507712:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143842.857429:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.862285:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625080576:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9293us (9684us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.862285:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625080832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8486us (8575us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.862297:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7291 00002000:00100000:1.0:1746143842.862310:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009eb87100 x1830963625080832/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.862319:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87100 with x1830963625080832 ext(0->1048575) 00002000:00010000:1.0:1746143842.862335:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87100 00000100:00100000:3.0:1746143842.862364:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7290 00002000:00100000:3.0:1746143842.862370:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880093f7a680 x1830963625080576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.862377:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f7a680 with x1830963625080576 ext(0->1048575) 00002000:00010000:3.0:1746143842.862382:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f7a680 00000100:00100000:3.0:1746143842.862423:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627507712:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143842.862440:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143842.862462:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625080960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5191us (5341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.862473:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8187 00000100:00100000:0.0:1746143842.862999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.863114:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625081216 00000100:00100000:3.0:1746143842.863121:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625081216 00002000:00100000:3.0:1746143842.863210:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3792896->3796991) req@ffff88009eb87480 x1830963625081216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.863217:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87480 with x1830963625081216 ext(3792896->3796991) 00002000:00010000:3.0:1746143842.863225:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87480 00000100:00100000:3.0:1746143842.863249:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7292 00000100:00100000:3.0:1746143842.863256:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625081216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.863514:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625081216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 253us (510us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.863520:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7292 00002000:00100000:3.0:1746143842.863525:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3792896->3796991) req@ffff88009eb87480 x1830963625081216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.863531:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87480 with x1830963625081216 ext(3792896->3796991) 00002000:00010000:3.0:1746143842.863533:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87480 00000100:00100000:0.0:1746143842.871160:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.871219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.871280:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625081600 00000100:00100000:1.0:1746143842.871290:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625081600 00000100:00100000:1.0:1746143842.871354:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16766 00000100:00100000:1.0:1746143842.871362:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2855:x1830963625081600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143842.871382:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143842.871400:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f83 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.871431:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.871437:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.871439:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143842.871441:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.871473:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 14 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.871484:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.871498:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627507840:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.871516:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625081472 00000100:00100000:3.0:1746143842.871521:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625081472 00002000:00100000:3.0:1746143842.871562:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4104192->4108287) req@ffff88009eb86d80 x1830963625081472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143842.871587:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00002000:00100000:3.0:1746143842.871619:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb86d80 with x1830963625081472 ext(4104192->4108287) 00002000:00010000:3.0:1746143842.871624:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb86d80 00000100:00100000:3.0:1746143842.871639:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7293 00000100:00100000:3.0:1746143842.871645:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625081472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.871772:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625081472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 127us (622us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.871779:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7293 00002000:00100000:3.0:1746143842.871785:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4104192->4108287) req@ffff88009eb86d80 x1830963625081472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.871791:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb86d80 with x1830963625081472 ext(4104192->4108287) 00002000:00010000:3.0:1746143842.871793:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb86d80 00000100:00100000:0.0:1746143842.872032:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.872071:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.872124:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625081728 00000100:00100000:2.0:1746143842.872130:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625081728 00000100:00100000:2.0:1746143842.872161:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625081856 00000100:00100000:2.0:1746143842.872164:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625081856 00000100:00100000:2.0:1746143842.872179:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16767 00000100:00100000:2.0:1746143842.872183:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2856:x1830963625081728:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143842.872186:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16768 00010000:00010000:2.0:1746143842.872191:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143842.872193:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2853:x1830963625081856:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143842.872198:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f8a expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.872200:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.872210:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f91 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.872211:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.872215:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 37 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.872224:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 37 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.872227:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.872233:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85000, rc 0) 00010000:00010000:3.0:1746143842.872234:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.872239:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.872241:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.872243:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [921600->1048575] (req 921600->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.872258:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 20 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.872268:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2856:x1830963625081728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 83us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143842.872272:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 20 pid: 9839 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.872273:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16767 00000100:00100000:3.0:1746143842.872280:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627507968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.872335:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.872343:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143842.872350:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627508096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.872368:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.873210:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627507840:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.873233:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.873244:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84f200, rc 0) 00000100:00100000:1.0:1746143842.873304:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2855:x1830963625081600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1942us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.873310:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16766 00000100:00100000:0.0:1746143842.875460:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.875491:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627507968:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.875500:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627508096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.875522:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [921600->1048575] (req 921600->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.875536:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551000, rc 0) 00000100:00100000:3.0:1746143842.875585:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2853:x1830963625081856:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3392us (3512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.875594:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16768 00000100:00100000:2.0:1746143842.876087:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625081984 00000100:00100000:2.0:1746143842.876095:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625081984 00010000:00010000:2.0:1746143842.876128:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.876161:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8188 00000100:00100000:2.0:1746143842.876168:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625081984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143842.876182:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.876202:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.876212:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.876235:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b590b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f05 expref: 15 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.876258:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.876260:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.876267:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.876275:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.876283:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.876284:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.876287:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.876300:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.876342:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.876355:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627508224:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143842.876480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.876547:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625082240 00000100:00100000:1.0:1746143842.876551:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625082240 00000100:00100000:1.0:1746143842.876576:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5445 00000100:00100000:1.0:1746143842.876580:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2851:x1830963625082240:12345-192.168.202.3@tcp:35:multiop.0 00010000:00010000:2.0:1746143842.876588:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.876596:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627508352:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.876614:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.876783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.876800:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625082368 00000100:00100000:0.0:1746143842.876803:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625082368 00010000:00010000:0.0:1746143842.876817:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 21 pid: 9839 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.876834:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8189 00000100:00100000:0.0:1746143842.876839:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625082368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.876847:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.876859:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 21 pid: 9839 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.876866:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 21 pid: 9839 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.876877:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ee00/0x87925e4cb73b59e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f75 expref: 21 pid: 9839 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.876890:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.876907:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625082368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.876930:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8189 00000100:00100000:0.0:1746143842.876967:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.876978:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625082496 00000100:00100000:0.0:1746143842.876981:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625082496 00010000:00010000:0.0:1746143842.876991:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.877007:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8190 00000100:00100000:0.0:1746143842.877011:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625082496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.877017:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143842.877023:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.877030:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.877039:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b59a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f4b expref: 41 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.877047:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.877048:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.877051:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.877057:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.877073:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.877079:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627508480:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143842.877103:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.877108:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2851:x1830963625082240:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 526us (628us total) trans 8589945100 rc 0/0 00000100:00100000:1.0:1746143842.877115:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5445 00000100:00100000:2.0:1746143842.879210:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627508224:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.879223:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627508352:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.879244:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.879296:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627508480:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143842.879305:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143842.879391:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625082496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2377us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143842.879400:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8190 00000100:00100000:2.0:1746143842.879589:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625081984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3421us (4136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.879595:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8188 00000100:00100000:0.0:1746143842.882424:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.882639:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625082752 00000100:00100000:1.0:1746143842.882648:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625082752 00002000:00100000:1.0:1746143842.882694:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (921600->925695) req@ffff88009eb87800 x1830963625082752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.882704:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87800 with x1830963625082752 ext(921600->925695) 00002000:00010000:1.0:1746143842.882710:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87800 00000100:00100000:1.0:1746143842.882744:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7294 00000100:00100000:1.0:1746143842.882752:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625082752:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143842.882904:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625082752:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 152us (491us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143842.882931:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7294 00002000:00100000:1.0:1746143842.882941:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (921600->925695) req@ffff88009eb87800 x1830963625082752/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.882948:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87800 with x1830963625082752 ext(921600->925695) 00002000:00010000:1.0:1746143842.882950:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87800 00000100:00100000:0.0:1746143842.884475:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.884531:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083008 00000100:00100000:3.0:1746143842.884539:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083008 00002000:00100000:3.0:1746143842.884574:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009eb87b80 x1830963625083008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.884582:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87b80 with x1830963625083008 ext(1048576->2097151) 00002000:00010000:3.0:1746143842.884586:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb87b80 00000100:00100000:3.0:1746143842.884615:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7295 00000100:00100000:3.0:1746143842.884622:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625083008:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143842.885770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.885794:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083264 00000100:00100000:1.0:1746143842.885799:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083264 00002000:00100000:1.0:1746143842.885824:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8801368e9500 x1830963625083264/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.885831:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963625083264 ext(1048576->2097151) 00002000:00010000:1.0:1746143842.885835:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:1.0:1746143842.885850:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7296 00000100:00100000:1.0:1746143842.885856:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625083264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.891510:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625083008:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6875us (7028us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.891524:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7295 00002000:00100000:3.0:1746143842.891537:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009eb87b80 x1830963625083008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.891547:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87b80 with x1830963625083008 ext(1048576->2097151) 00002000:00010000:3.0:1746143842.891554:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb87b80 00000100:00100000:1.0:1746143842.892909:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625083264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7044us (7134us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.892939:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7296 00002000:00100000:1.0:1746143842.892947:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8801368e9500 x1830963625083264/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.892955:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963625083264 ext(1048576->2097151) 00002000:00010000:1.0:1746143842.892960:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:0.0:1746143842.895798:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.895849:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.895998:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083392 00000100:00100000:3.0:1746143842.896011:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083392 00000100:00100000:3.0:1746143842.896078:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083520 00000100:00100000:3.0:1746143842.896081:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083520 00000100:00100000:3.0:1746143842.896103:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16769 00000100:00100000:3.0:1746143842.896111:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2856:x1830963625083392:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143842.896115:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16770 00000100:00100000:2.0:1746143842.896126:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2853:x1830963625083520:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143842.896131:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.896134:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.896150:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f98 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.896150:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411f9f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.896181:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.896181:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.896189:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.896194:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.896194:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.896196:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.896196:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.896198:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 40 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.896199:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.896227:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.896228:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.896239:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 40 pid: 9839 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.896250:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627508736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.896253:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 13 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143842.896263:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627508608:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.896357:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.896359:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143842.896365:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.896372:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627508864:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.896393:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.900369:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.900406:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.900421:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.900427:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083776 00000100:00100000:1.0:1746143842.900436:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083776 00000100:00100000:0.0:1746143842.900440:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083904 00000100:00100000:0.0:1746143842.900443:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083904 00000100:00100000:2.0:1746143842.900461:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625083648 00000100:00100000:2.0:1746143842.900465:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625083648 00010000:00010000:0.0:1746143842.900476:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 41 pid: 9839 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.900481:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16771 00010000:00010000:2.0:1746143842.900483:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.900488:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2855:x1830963625083776:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143842.900499:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8191 00000100:00100000:2.0:1746143842.900503:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8192 00010000:00010000:1.0:1746143842.900504:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143842.900504:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625083904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143842.900508:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625083648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143842.900516:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143842.900517:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.900519:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fa6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900532:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.900532:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 41 pid: 9839 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.900540:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143842.900542:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 41 pid: 9839 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.900545:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900555:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.900559:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143842.900570:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.900571:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.900571:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900578:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900585:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900592:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.900593:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746143842.900593:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625083904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (187us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143842.900596:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.900603:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8191 00010000:00010000:2.0:1746143842.900607:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.900615:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00010000:00010000:3.0:1746143842.900621:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7fa00/0x87925e4cb73b5912 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f0c expref: 14 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.900631:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.900636:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2855:x1830963625083776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 149us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.900640:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627508608:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143842.900641:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16771 00000100:00100000:2.0:1746143842.900642:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627508992:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143842.900648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.900661:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625084032 00010000:00010000:3.0:1746143842.900664:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143842.900664:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625084032 00010000:00010000:3.0:1746143842.900672:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00010000:00010000:0.0:1746143842.900674:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 25 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.900687:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8193 00000100:00100000:0.0:1746143842.900692:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625084032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143842.900694:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2856:x1830963625083392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4584us (4906us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143842.900694:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.900698:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143842.900699:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16769 00000100:00100000:2.0:1746143842.900702:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627509120:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143842.900704:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 25 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.900711:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 25 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.900717:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00010000:00010000:0.0:1746143842.900733:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.900735:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143842.900739:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900741:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85000/0x87925e4cb73b59f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f8a expref: 39 pid: 9839 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143842.900745:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143842.900765:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143842.900766:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627508736:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.900776:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84f200/0x87925e4cb73b59f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f83 expref: 25 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143842.900777:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800961f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627509248:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.900785:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627508864:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143842.900797:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00010000:00010000:2.0:1746143842.900802:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.900814:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00000100:00100000:2.0:1746143842.900832:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2853:x1830963625083520:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4709us (4982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.900837:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16770 00000100:00100000:0.0:1746143842.904780:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.905097:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627508992:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143842.905109:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627509120:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143842.905131:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143842.905192:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625083648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4681us (4767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.905204:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8192 00000100:00100000:2.0:1746143842.905259:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625084288 00000100:00100000:2.0:1746143842.905265:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625084288 00002000:00100000:2.0:1746143842.905298:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800961f2d80 x1830963625084288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.905307:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f2d80 with x1830963625084288 ext(1048576->2097151) 00002000:00010000:2.0:1746143842.905312:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961f2d80 00000100:00100000:2.0:1746143842.905340:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7297 00000100:00100000:2.0:1746143842.905346:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625084288:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143842.906226:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.906669:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800961f2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627509248:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.906686:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.906707:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625084032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6014us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.906716:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8193 00000100:00100000:3.0:1746143842.906879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.906962:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625084544 00000100:00100000:3.0:1746143842.906974:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625084544 00002000:00100000:3.0:1746143842.907003:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1138688->1142783) req@ffff8800961f3100 x1830963625084544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.907012:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f3100 with x1830963625084544 ext(1138688->1142783) 00002000:00010000:3.0:1746143842.907017:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961f3100 00000100:00100000:3.0:1746143842.907029:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625084800 00000100:00100000:3.0:1746143842.907031:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625084800 00002000:00100000:3.0:1746143842.907040:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095e30000 x1830963625084800/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.907046:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30000 with x1830963625084800 ext(1048576->2097151) 00002000:00010000:3.0:1746143842.907048:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30000 00000100:00100000:3.0:1746143842.907074:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7298 00000100:00100000:3.0:1746143842.907081:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625084544:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143842.907093:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7299 00000100:00100000:1.0:1746143842.907100:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625084800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.907168:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625084544:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 88us (943us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143842.907174:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7298 00002000:00100000:3.0:1746143842.907178:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1138688->1142783) req@ffff8800961f3100 x1830963625084544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/4536 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.907185:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f3100 with x1830963625084544 ext(1138688->1142783) 00002000:00010000:3.0:1746143842.907188:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961f3100 00000100:00100000:2.0:1746143842.913654:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625084288:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8296us (8875us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.913667:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7297 00002000:00100000:2.0:1746143842.913680:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800961f2d80 x1830963625084288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.913695:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f2d80 with x1830963625084288 ext(1048576->2097151) 00002000:00010000:2.0:1746143842.913701:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961f2d80 00000100:00100000:0.0:1746143842.915476:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.915709:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625084800:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8608us (8830us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.915720:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7299 00002000:00100000:1.0:1746143842.915730:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095e30000 x1830963625084800/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.915738:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e30000 with x1830963625084800 ext(1048576->2097151) 00002000:00010000:1.0:1746143842.915744:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e30000 00000100:00100000:2.0:1746143842.915885:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625085056 00000100:00100000:2.0:1746143842.915892:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625085056 00000100:00100000:2.0:1746143842.915938:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5446 00000100:00100000:2.0:1746143842.915944:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+261:2853:x1830963625085056:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143842.916138:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:2853:x1830963625085056:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 193us (670us total) trans 8589945101 rc 0/0 00000100:00100000:2.0:1746143842.916144:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5446 00000100:00100000:0.0:1746143842.921034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.921091:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.921266:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625085184 00000100:00100000:2.0:1746143842.921276:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625085184 00000100:00100000:3.0:1746143842.921335:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625085312 00000100:00100000:3.0:1746143842.921339:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625085312 00000100:00100000:2.0:1746143842.921342:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16772 00000100:00100000:2.0:1746143842.921349:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2855:x1830963625085184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.921373:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143842.921399:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16773 00000100:00100000:3.0:1746143842.921404:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2856:x1830963625085312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.921413:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.921454:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fad expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.921461:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fb4 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.921483:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.921491:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.921493:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.921497:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.921506:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143842.921509:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.921521:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.921530:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551200, rc 0) 00010000:00010000:2.0:1746143842.921532:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 12 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.921544:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 12 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.921555:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627509376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143842.921604:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2856:x1830963625085312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 199us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.921610:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16773 00000100:00100000:2.0:1746143842.921656:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.923295:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.923435:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625085440 00000100:00100000:1.0:1746143842.923442:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625085440 00000100:00100000:2.0:1746143842.923463:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627509376:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143842.923470:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 13 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.923482:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.923494:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b7a00, rc 0) 00000100:00100000:1.0:1746143842.923506:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8194 00000100:00100000:1.0:1746143842.923513:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625085440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.923524:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143842.923537:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2855:x1830963625085184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2188us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.923544:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16772 00010000:00010000:1.0:1746143842.923545:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 13 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.923556:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 13 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.923576:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b5919 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f13 expref: 13 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.923605:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.923608:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.923614:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.923625:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.923633:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.923634:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.923638:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.923645:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.923669:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.923679:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627509504:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.924192:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.924202:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627509632:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.924351:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.927433:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627509504:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.927445:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627509632:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.927465:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.927519:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625085440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4005us (4227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.927529:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8194 00000100:00100000:0.0:1746143842.930067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.930169:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625085696 00000100:00100000:1.0:1746143842.930177:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625085696 00002000:00100000:1.0:1746143842.930225:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800961f0a80 x1830963625085696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.930233:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f0a80 with x1830963625085696 ext(1048576->2097151) 00002000:00010000:1.0:1746143842.930239:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961f0a80 00000100:00100000:1.0:1746143842.930273:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7300 00000100:00100000:1.0:1746143842.930281:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625085696:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143842.931941:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.932006:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625085952 00000100:00100000:3.0:1746143842.932013:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625085952 00002000:00100000:3.0:1746143842.932046:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093f78700 x1830963625085952/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.932055:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f78700 with x1830963625085952 ext(1048576->2097151) 00002000:00010000:3.0:1746143842.932061:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f78700 00000100:00100000:3.0:1746143842.932555:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7301 00000100:00100000:3.0:1746143842.932562:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625085952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143842.938462:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625085696:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8174us (8395us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.938473:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7300 00002000:00100000:1.0:1746143842.938482:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800961f0a80 x1830963625085696/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.938490:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f0a80 with x1830963625085696 ext(1048576->2097151) 00002000:00010000:1.0:1746143842.938496:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961f0a80 00000100:00100000:3.0:1746143842.941419:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625085952:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8845us (9501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.941432:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7301 00002000:00100000:3.0:1746143842.941446:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093f78700 x1830963625085952/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.941455:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f78700 with x1830963625085952 ext(1048576->2097151) 00002000:00010000:3.0:1746143842.941460:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f78700 00000100:00100000:0.0:1746143842.945629:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.945686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.945762:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086080 00000100:00100000:3.0:1746143842.945773:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086080 00000100:00100000:2.0:1746143842.945787:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086208 00000100:00100000:2.0:1746143842.945791:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086208 00000100:00100000:2.0:1746143842.945831:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16774 00000100:00100000:2.0:1746143842.945839:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625086208:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143842.945843:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16775 00000100:00100000:3.0:1746143842.945848:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625086080:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.945856:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.945857:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.945873:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73b5a2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fbb expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.945873:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6400/0x87925e4cb73b5a31 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fc2 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.945945:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627509888:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143842.945945:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627509760:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143842.946024:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143842.946024:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00002000:00010000:3.0:1746143842.947136:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143842 -> 1746143843 00002000:00010000:3.0:1746143842.947141:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143842 -> 1746143843 00000100:00100000:3.0:1746143842.947158:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627509888:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143842.947181:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73b5a2a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fbb expref: 42 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.947192:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551c00/0x87925e4cb73b5a2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fbb expref: 42 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143842.947218:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551c00, rc 0) 00010000:00010000:2.0:1746143842.947258:0:1947:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143842.947261:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625086080:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1411us (1642us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143842.947271:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16775 00000100:00100000:2.0:1746143842.947275:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627509760:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143842.947289:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6400/0x87925e4cb73b5a31 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc2 expref: 39 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.947297:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6400/0x87925e4cb73b5a31 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc2 expref: 39 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143842.947306:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6400, rc 0) 00000100:00100000:2.0:1746143842.947337:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625086208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1500us (1650us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143842.947343:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16774 00000100:00100000:0.0:1746143842.947521:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.947568:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086464 00000100:00100000:3.0:1746143842.947573:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086464 00002000:00100000:3.0:1746143842.947596:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800961f1500 x1830963625086464/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.947602:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f1500 with x1830963625086464 ext(2097152->3145727) 00002000:00010000:3.0:1746143842.947606:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961f1500 00000100:00100000:3.0:1746143842.947626:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7302 00000100:00100000:3.0:1746143842.947630:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625086464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143842.951200:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.951287:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086592 00000100:00100000:2.0:1746143842.951296:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086592 00000100:00100000:2.0:1746143842.951486:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16776 00000100:00100000:2.0:1746143842.951494:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2856:x1830963625086592:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.951611:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.951628:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fc9 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.951658:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.951666:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.951668:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.951672:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.951702:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.951713:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 22 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.951725:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627510016:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.952245:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.952484:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625086464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4851us (4962us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143842.952494:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7302 00002000:00100000:3.0:1746143842.952503:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800961f1500 x1830963625086464/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.952513:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f1500 with x1830963625086464 ext(2097152->3145727) 00010000:00010000:3.0:1746143842.952519:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 21 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.952530:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 21 pid: 13430 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143842.952536:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800961f1500 00000100:00100000:2.0:1746143842.953116:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627510016:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143842.953135:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.953147:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6000, rc 0) 00000100:00100000:2.0:1746143842.953180:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2856:x1830963625086592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1688us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.953186:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16776 00000100:00100000:0.0:1746143842.954308:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.954577:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086720 00000100:00100000:3.0:1746143842.954584:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086720 00002000:00100000:3.0:1746143842.954622:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3792896->4108287) req@ffff8800961f1880 x1830963625086720/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143842.954630:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f1880 with x1830963625086720 ext(3792896->4108287) 00010000:00010000:3.0:1746143842.954637:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 21 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.954648:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 21 pid: 13430 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143842.954655:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800961f1880 00000100:00100000:3.0:1746143842.954689:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2693 00000100:00100000:3.0:1746143842.954696:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625086720:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143842.955103:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.955235:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086848 00000100:00100000:2.0:1746143842.955240:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086848 00000100:00100000:2.0:1746143842.955273:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16777 00000100:00100000:2.0:1746143842.955279:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2855:x1830963625086848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.955288:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.955304:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fd0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.955342:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.955349:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.955351:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143842.955354:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.955380:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.955390:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 12 pid: 9585 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143842.955401:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627510144:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143842.955467:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143842.957367:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.957440:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627510144:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143842.957467:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.957520:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625086976 00000100:00100000:1.0:1746143842.957526:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625086976 00010000:00010000:1.0:1746143842.957554:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143842.957751:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6600, rc 0) 00000100:00100000:3.0:1746143842.957794:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2855:x1830963625086848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2514us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.957839:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8195 00000100:00100000:1.0:1746143842.957846:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625086976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.957859:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.957876:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.957885:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.957905:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e512e00/0x87925e4cb73b5927 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f21 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.957945:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.957947:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.957953:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.957961:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.957987:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.957998:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627510272:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.958053:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143842.958100:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16777 00000100:00100000:2.0:1746143842.958635:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625086720:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3937us (4326us total) trans 17179874006 rc 0/0 00000100:00100000:2.0:1746143842.958644:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2693 00002000:00100000:2.0:1746143842.958653:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3792896->4108287) req@ffff8800961f1880 x1830963625086720/t17179874006(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/448 e 0 to 0 dl 1746143853 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.958661:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961f1880 with x1830963625086720 ext(3792896->4108287) 00010000:00010000:2.0:1746143842.958669:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143842.958684:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746143842.958691:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800961f1880 00000100:00100000:1.0:1746143842.960581:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627510272:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.960600:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.960653:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625086976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2807us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.960663:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8195 00000100:00100000:0.0:1746143842.962662:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.962760:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625087232 00000100:00100000:2.0:1746143842.962768:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625087232 00002000:00100000:2.0:1746143842.962803:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012ee34000 x1830963625087232/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.962812:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee34000 with x1830963625087232 ext(2097152->3145727) 00002000:00010000:2.0:1746143842.962816:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee34000 00000100:00100000:2.0:1746143842.963592:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7303 00000100:00100000:2.0:1746143842.963601:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625087232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143842.964454:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.964849:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625087360 00000100:00100000:1.0:1746143842.964855:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625087360 00010000:00010000:1.0:1746143842.964879:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143842.964901:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8196 00000100:00100000:1.0:1746143842.964906:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625087360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143842.964936:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143842.964951:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.964963:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.964981:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b59eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3792896->4108287) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f7c expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143842.964992:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.964994:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143842.965000:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.965007:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143842.965033:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 41 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143842.965044:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627510400:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143842.965093:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143842.968800:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627510400:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143842.968821:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143842.968881:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625087360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3973us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143842.968890:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8196 00000100:00100000:0.0:1746143842.973122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.973207:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625087616 00000100:00100000:1.0:1746143842.973216:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625087616 00002000:00100000:1.0:1746143842.973258:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012ee34700 x1830963625087616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.973268:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee34700 with x1830963625087616 ext(2097152->3145727) 00002000:00010000:1.0:1746143842.973272:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee34700 00000100:00100000:1.0:1746143842.973309:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7304 00000100:00100000:1.0:1746143842.973317:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625087616:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143842.973366:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625087232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9765us (10709us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143842.973374:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7303 00002000:00100000:2.0:1746143842.973379:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012ee34000 x1830963625087232/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.973386:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee34000 with x1830963625087232 ext(2097152->3145727) 00002000:00010000:2.0:1746143842.973389:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee34000 00010000:00010000:2.0:1746143842.977709:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143842.978999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143842.979232:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625087744 00000100:00100000:3.0:1746143842.979239:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625087744 00000100:00100000:3.0:1746143842.979290:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16778 00000100:00100000:3.0:1746143842.979298:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2855:x1830963625087744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143842.979312:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143842.979335:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fd7 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.979355:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.979357:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143842.979363:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.979377:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143842.979385:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a200, rc 0) 00000100:00100000:3.0:1746143842.979435:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2855:x1830963625087744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 138us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143842.979441:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16778 00000100:00100000:1.0:1746143842.981866:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625087616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8543us (8745us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.981876:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7304 00002000:00100000:1.0:1746143842.981886:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012ee34700 x1830963625087616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.981895:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee34700 with x1830963625087616 ext(2097152->3145727) 00002000:00010000:1.0:1746143842.981900:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee34700 00000100:00100000:0.0:1746143842.985533:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.985612:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625087872 00000100:00100000:2.0:1746143842.985619:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625087872 00000100:00100000:2.0:1746143842.985658:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16779 00000100:00100000:2.0:1746143842.985663:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2856:x1830963625087872:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143842.985676:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143842.985687:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fde expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.985704:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.985705:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143842.985710:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.985720:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143842.985726:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84800, rc 0) 00000100:00100000:2.0:1746143842.985754:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2856:x1830963625087872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143842.985759:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16779 00000100:00100000:0.0:1746143842.988144:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.988191:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143842.988461:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625088256 00000100:00100000:1.0:1746143842.988468:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625088256 00002000:00100000:1.0:1746143842.988506:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012ee35180 x1830963625088256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.988514:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35180 with x1830963625088256 ext(3145728->4194303) 00002000:00010000:1.0:1746143842.988518:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee35180 00000100:00100000:1.0:1746143842.988545:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625088384 00000100:00100000:1.0:1746143842.988548:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625088384 00002000:00100000:1.0:1746143842.988561:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88012ee35500 x1830963625088384/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.988566:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35500 with x1830963625088384 ext(3145728->4194303) 00002000:00010000:1.0:1746143842.988569:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee35500 00000100:00100000:1.0:1746143842.988585:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7305 00000100:00100000:1.0:1746143842.988592:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625088256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.989141:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7306 00000100:00100000:3.0:1746143842.989150:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625088384:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143842.997513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143842.997601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143842.997714:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625088640 00000100:00100000:2.0:1746143842.997722:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625088640 00002000:00100000:2.0:1746143842.997755:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012ee35880 x1830963625088640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.997764:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35880 with x1830963625088640 ext(2097152->4194303) 00002000:00010000:2.0:1746143842.997768:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee35880 00000100:00100000:2.0:1746143842.997780:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625088896 00000100:00100000:2.0:1746143842.997782:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625088896 00002000:00100000:2.0:1746143842.997791:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012ee35c00 x1830963625088896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/0 e 0 to 0 dl 1746143853 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143842.997797:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35c00 with x1830963625088896 ext(3145728->4194303) 00002000:00010000:2.0:1746143842.997799:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee35c00 00000100:00100000:2.0:1746143842.997815:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7307 00000100:00100000:2.0:1746143842.997820:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625088640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143842.998147:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7308 00000100:00100000:3.0:1746143842.998156:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625088896:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143842.998361:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625088256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9768us (10221us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143842.998368:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7305 00002000:00100000:1.0:1746143842.998373:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012ee35180 x1830963625088256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143842.998378:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35180 with x1830963625088256 ext(3145728->4194303) 00002000:00010000:1.0:1746143842.998381:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee35180 00000100:00100000:3.0:1746143843.000359:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625088384:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11204us (12160us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.000369:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7306 00002000:00100000:3.0:1746143843.000378:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88012ee35500 x1830963625088384/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.000387:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35500 with x1830963625088384 ext(3145728->4194303) 00002000:00010000:3.0:1746143843.000392:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee35500 00000100:00100000:2.0:1746143843.009620:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625088640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11789us (12104us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143843.009632:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7307 00002000:00100000:2.0:1746143843.009642:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012ee35880 x1830963625088640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.009650:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35880 with x1830963625088640 ext(2097152->4194303) 00002000:00010000:2.0:1746143843.009655:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ee35880 00000100:00100000:0.0:1746143843.009958:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.010005:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625089024 00000100:00100000:0.0:1746143843.010005:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.010012:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625089024 00000100:00100000:3.0:1746143843.010056:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625089152 00000100:00100000:3.0:1746143843.010059:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625089152 00000100:00100000:3.0:1746143843.010082:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16780 00000100:00100000:2.0:1746143843.010094:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16781 00000100:00100000:2.0:1746143843.010104:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625089152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.010117:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.010131:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5a54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fec expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.010169:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627510528:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143843.010175:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625089024:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.010183:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.010192:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5a5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411fe5 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.010210:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.010219:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627510656:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143843.010505:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.011882:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625088896:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13724us (14277us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.011891:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7308 00002000:00100000:3.0:1746143843.011899:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012ee35c00 x1830963625088896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:238/0 lens 488/440 e 0 to 0 dl 1746143853 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.011907:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee35c00 with x1830963625088896 ext(3145728->4194303) 00002000:00010000:3.0:1746143843.011930:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee35c00 00002000:00010000:3.0:1746143843.012388:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime: 1746143842 -> 1746143843 00002000:00010000:3.0:1746143843.012391:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143842 -> 1746143843 00000100:00100000:3.0:1746143843.012402:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627510656:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143843.012426:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5a5b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fe5 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.012437:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5a5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fe5 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.012460:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8bc00, rc 0) 00000100:00100000:3.0:1746143843.012489:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625089024:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2401us (2531us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143843.012495:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16780 00002000:00010000:2.0:1746143843.012846:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143842 -> 1746143843 00002000:00010000:2.0:1746143843.012849:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143842 -> 1746143843 00000100:00100000:2.0:1746143843.012859:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627510528:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.012875:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5a54 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fec expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.012889:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b5a54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fec expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.012899:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85e00, rc 0) 00000100:00100000:2.0:1746143843.012953:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625089152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2850us (2947us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.012959:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16781 00000100:00100000:0.0:1746143843.018213:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.018458:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625089408 00000100:00100000:3.0:1746143843.018467:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625089408 00002000:00100000:3.0:1746143843.018504:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012ee36680 x1830963625089408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.018513:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee36680 with x1830963625089408 ext(4194304->4853759) 00002000:00010000:3.0:1746143843.018518:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee36680 00000100:00100000:3.0:1746143843.018551:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7309 00000100:00100000:3.0:1746143843.018558:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625089408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.021412:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.021601:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625089664 00000100:00100000:2.0:1746143843.021608:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625089664 00002000:00100000:2.0:1746143843.021662:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012ee36a00 x1830963625089664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.021671:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee36a00 with x1830963625089664 ext(4194304->4853759) 00002000:00010000:2.0:1746143843.021676:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee36a00 00000100:00100000:2.0:1746143843.021708:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7310 00000100:00100000:2.0:1746143843.021716:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625089664:12345-192.168.202.3@tcp:3:cat.0 00000100:00080000:0.0:1746143843.021890:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143843.023929:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625089408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5351us (5704us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143843.023938:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7309 00002000:00100000:3.0:1746143843.023946:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012ee36680 x1830963625089408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.023953:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee36680 with x1830963625089408 ext(4194304->4853759) 00002000:00010000:3.0:1746143843.023958:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee36680 00000100:00100000:2.0:1746143843.026408:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625089664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4685us (4994us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143843.026417:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7310 00002000:00100000:2.0:1746143843.026426:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012ee36a00 x1830963625089664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.026434:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee36a00 with x1830963625089664 ext(4194304->4853759) 00002000:00010000:2.0:1746143843.026439:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee36a00 00000100:00100000:0.0:1746143843.027387:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.027428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.027525:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625089792 00000100:00100000:2.0:1746143843.027532:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625089792 00000100:00100000:2.0:1746143843.027642:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625089920 00000100:00100000:2.0:1746143843.027645:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625089920 00000100:00100000:3.0:1746143843.027653:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16782 00000100:00100000:3.0:1746143843.027666:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625089792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.027679:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.027696:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73b5a62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ff3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.027714:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16783 00000100:00100000:2.0:1746143843.027719:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625089920:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.027726:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.027734:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5a69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248411ffa expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.027736:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627510784:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143843.027757:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627510912:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143843.027801:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.027805:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.029683:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627510784:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143843.029706:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73b5a62 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ff3 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.029717:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b000/0x87925e4cb73b5a62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ff3 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.029729:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b000, rc 0) 00000100:00100000:3.0:1746143843.029775:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625089792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2113us (2389us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143843.029781:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16782 00000100:00100000:2.0:1746143843.029832:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627510912:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.029847:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5a69 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ffa expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.029855:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5a69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411ffa expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.029875:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:2.0:1746143843.029902:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625089920:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2182us (2473us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.029907:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16783 00000100:00100000:0.0:1746143843.035019:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.035090:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625090176 00000100:00100000:2.0:1746143843.035098:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625090176 00000100:00100000:2.0:1746143843.035158:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5447 00000100:00100000:2.0:1746143843.035166:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2856:x1830963625090176:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143843.035349:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2856:x1830963625090176:12345-192.168.202.3@tcp:35:cat.0 Request processed in 184us (337us total) trans 8589945102 rc 0/0 00000100:00100000:2.0:1746143843.035355:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5447 00000100:00080000:0.0:1746143843.036149:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143843.036177:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.036212:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625090304 00000100:00100000:0.0:1746143843.036216:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625090304 00000100:00100000:2.0:1746143843.036227:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.036485:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625090432 00000100:00100000:0.0:1746143843.036488:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625090432 00000100:00100000:1.0:1746143843.036506:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16784 00000100:00100000:1.0:1746143843.036514:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625090304:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.036524:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143843.036530:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16785 00000100:00100000:0.0:1746143843.036536:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625090432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.036538:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b5a70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412001 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.036544:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.036553:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5a77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412008 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.036579:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ee37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627511168:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143843.036580:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627511040:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143843.037297:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.037383:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.041602:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ee37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627511168:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.041635:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5a77 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412008 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.041647:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5a77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412008 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.041659:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ca00, rc 0) 00000100:00100000:2.0:1746143843.041708:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625090432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5172us (5480us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.041715:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16785 00000100:00100000:1.0:1746143843.041795:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627511040:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143843.041810:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b5a70 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412001 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.041819:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b5a70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412001 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.041829:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086e00, rc 0) 00000100:00100000:1.0:1746143843.041845:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625090304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5333us (5670us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143843.041850:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16784 00000100:00100000:2.0:1746143843.047229:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.047229:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.047282:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625090688 00000100:00100000:3.0:1746143843.047285:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625090944 00000100:00100000:2.0:1746143843.047289:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625090688 00000100:00100000:3.0:1746143843.047290:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625090944 00000100:00100000:2.0:1746143843.047338:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14032 00000100:00100000:3.0:1746143843.047339:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5448 00000100:00100000:3.0:1746143843.047345:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2855:x1830963625090944:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143843.047345:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2860:x1830963625090688:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.047363:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.047377:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841200f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.047425:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047437:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047446:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047458:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047463:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143843.047514:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2855:x1830963625090944:12345-192.168.202.3@tcp:35:cat.0 Request processed in 168us (292us total) trans 8589945103 rc 0/0 00000100:00100000:3.0:1746143843.047519:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5448 00010000:00010000:2.0:1746143843.047697:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00080000:0.0:1746143843.047699:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143843.047765:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047773:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047779:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143843.047787:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143843.047823:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047828:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047832:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047836:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047842:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.047845:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047850:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047898:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143843.047901:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.047905:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047909:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2e00/0x87925e4cb73b5a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047953:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047959:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047963:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047967:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.047969:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047973:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047979:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b0a000) 00010000:00010000:2.0:1746143843.047981:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.047983:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.047987:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5a8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.048014:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 266 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.048024:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.048030:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.048032:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143843.048034:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb3800, rc 0) 00000100:00100000:2.0:1746143843.048065:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+265:2860:x1830963625090688:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 721us (837us total) trans 8589945104 rc 0/0 00000100:00100000:2.0:1746143843.048070:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14032 00000100:00100000:0.0:1746143843.053827:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.053941:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625091072 00000100:00100000:1.0:1746143843.053950:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625091072 00000100:00100000:1.0:1746143843.054017:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16786 00000100:00100000:1.0:1746143843.054024:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2860:x1830963625091072:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143843.054038:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.054052:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412016 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.054079:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.054289:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.054295:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.054297:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.054300:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3928064->4108287] (req 3928064->4108287) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.054336:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.054346:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.054356:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627511296:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.054448:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 24 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.054456:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 24 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00080000:0.0:1746143843.054501:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143843.054613:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627511424:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.054645:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.056465:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627511296:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.056474:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627511424:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.056497:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3928064->4108287] (req 3928064->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 40 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.056510:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086600, rc 0) 00000100:00100000:1.0:1746143843.056556:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2860:x1830963625091072:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2532us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.056564:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16786 00000100:00100000:0.0:1746143843.059695:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.059745:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.059829:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625091200 00000100:00100000:2.0:1746143843.059838:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625091200 00010000:00010000:2.0:1746143843.059867:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.059892:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625091328 00000100:00100000:2.0:1746143843.059895:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625091328 00010000:00010000:2.0:1746143843.059905:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.059938:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8197 00000100:00100000:1.0:1746143843.059946:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625091200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.059959:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.059980:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.059991:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.060008:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5a3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd0 expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.060023:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.060055:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625091200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.060061:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8197 00000100:00100000:1.0:1746143843.060075:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8198 00000100:00100000:1.0:1746143843.060079:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625091328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.060088:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.060094:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.060101:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.060111:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b5a4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fde expref: 40 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.060118:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.060119:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.060125:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 39 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.060132:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 39 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.060157:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 39 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.060168:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627511552:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143843.060206:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.061804:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627511552:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143843.061819:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.061850:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625091328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1765us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.061858:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8198 00000100:00100000:0.0:1746143843.062251:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.062306:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625091584 00000100:00100000:2.0:1746143843.062312:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625091584 00002000:00100000:2.0:1746143843.062351:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3928064->3932159) req@ffff880091084380 x1830963625091584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.062360:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091084380 with x1830963625091584 ext(3928064->3932159) 00002000:00010000:2.0:1746143843.062364:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091084380 00000100:00100000:2.0:1746143843.062386:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7311 00000100:00100000:2.0:1746143843.062392:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625091584:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143843.062501:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625091584:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 109us (250us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143843.062507:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7311 00002000:00100000:2.0:1746143843.062511:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3928064->3932159) req@ffff880091084380 x1830963625091584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.062517:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091084380 with x1830963625091584 ext(3928064->3932159) 00002000:00010000:2.0:1746143843.062520:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091084380 00000100:00100000:0.0:1746143843.065682:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.065759:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625091840 00000100:00100000:2.0:1746143843.065768:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625091840 00002000:00100000:2.0:1746143843.065803:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (4104192->4108287) req@ffff880091084700 x1830963625091840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.065812:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091084700 with x1830963625091840 ext(4104192->4108287) 00002000:00010000:2.0:1746143843.065816:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091084700 00000100:00100000:2.0:1746143843.065846:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7312 00000100:00100000:2.0:1746143843.065854:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625091840:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143843.065979:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625091840:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 126us (303us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143843.065985:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7312 00002000:00100000:2.0:1746143843.065991:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (4104192->4108287) req@ffff880091084700 x1830963625091840/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.065997:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091084700 with x1830963625091840 ext(4104192->4108287) 00002000:00010000:2.0:1746143843.065999:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091084700 00000100:00100000:0.0:1746143843.068438:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.068525:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625092096 00000100:00100000:3.0:1746143843.068535:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625092096 00000100:00100000:3.0:1746143843.068597:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5449 00000100:00100000:3.0:1746143843.068604:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2860:x1830963625092096:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143843.068810:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2860:x1830963625092096:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 200us (376us total) trans 8589945105 rc 0/0 00000100:00100000:3.0:1746143843.068815:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5449 00000100:00100000:0.0:1746143843.102368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.102467:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625092352 00000100:00100000:2.0:1746143843.102478:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625092352 00000100:00100000:2.0:1746143843.102548:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14033 00000100:00100000:2.0:1746143843.102555:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2865:x1830963625092352:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.102575:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.102590:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b5aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841201d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.102663:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102673:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102682:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102693:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102698:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102702:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102782:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102790:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102796:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143843.102803:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143843.102861:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102866:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102871:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102877:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102881:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb2000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.102884:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102890:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102898:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143843.102900:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.102903:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102908:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102969:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102973:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102978:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102982:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd87000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.102984:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102989:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.102994:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b0af00) 00010000:00010000:2.0:1746143843.102996:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.102998:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.103002:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87000/0x87925e4cb73b5ab6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.103030:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b5aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.103039:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.103045:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.103047:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143843.103049:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87200, rc 0) 00000100:00100000:2.0:1746143843.103092:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2865:x1830963625092352:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 538us (737us total) trans 8589945106 rc 0/0 00000100:00100000:2.0:1746143843.103099:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14033 00000100:00100000:0.0:1746143843.114105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.115042:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625092480 00000100:00100000:1.0:1746143843.115052:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625092480 00000100:00100000:1.0:1746143843.115116:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16787 00000100:00100000:1.0:1746143843.115124:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2865:x1830963625092480:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143843.115140:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.115154:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412024 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.115179:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 38 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.115185:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.115187:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.115190:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2678784->2932735] (req 2678784->2932735) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.115215:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 38 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.115224:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 38 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.115234:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627511680:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.115339:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.117745:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627511680:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.117768:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2678784->2932735] (req 2678784->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.117781:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087c00, rc 0) 00000100:00100000:1.0:1746143843.117823:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2865:x1830963625092480:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2699us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.117831:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16787 00000100:00100000:1.0:1746143843.119150:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.119445:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625092608 00000100:00100000:3.0:1746143843.119453:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625092608 00002000:00100000:3.0:1746143843.119486:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3928064->4108287) req@ffff88009eb84a80 x1830963625092608/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.119494:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84a80 with x1830963625092608 ext(3928064->4108287) 00010000:00010000:3.0:1746143843.119501:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 39 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.119513:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 39 pid: 1945 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.119518:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009eb84a80 00000100:00100000:3.0:1746143843.119547:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2694 00000100:00100000:3.0:1746143843.119554:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625092608:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143843.123111:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625092608:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3549us (3955us total) trans 21474841275 rc 0/0 00000100:00100000:3.0:1746143843.123122:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2694 00002000:00100000:3.0:1746143843.123133:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3928064->4108287) req@ffff88009eb84a80 x1830963625092608/t21474841275(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.123141:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84a80 with x1830963625092608 ext(3928064->4108287) 00010000:00010000:3.0:1746143843.123150:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 41 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.123163:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 41 pid: 1945 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.123169:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009eb84a80 00000100:00100000:0.0:1746143843.126463:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.126553:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625092736 00000100:00100000:1.0:1746143843.126561:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625092736 00010000:00010000:1.0:1746143843.126589:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 41 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.126663:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8199 00000100:00100000:1.0:1746143843.126670:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625092736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.126683:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143843.126695:0:7229:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143842 -> 1746143843 00010000:00010000:1.0:1746143843.126701:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 41 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.126712:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 41 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.126731:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086600/0x87925e4cb73b5aa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4108287) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412016 expref: 41 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.126764:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.126766:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.126772:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.126780:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.126808:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.126818:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627511808:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143843.126886:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.129687:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627511808:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143843.129704:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.129744:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625092736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3073us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.129752:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8199 00000100:00100000:0.0:1746143843.133223:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.133731:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625092992 00000100:00100000:3.0:1746143843.133739:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625092992 00002000:00100000:3.0:1746143843.133778:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2928640->2932735) req@ffff880091085880 x1830963625092992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.133786:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091085880 with x1830963625092992 ext(2928640->2932735) 00002000:00010000:3.0:1746143843.133791:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091085880 00000100:00100000:3.0:1746143843.133820:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7313 00000100:00100000:3.0:1746143843.133826:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625092992:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143843.134111:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625092992:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 284us (893us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143843.134118:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7313 00002000:00100000:3.0:1746143843.134124:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2928640->2932735) req@ffff880091085880 x1830963625092992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.134131:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091085880 with x1830963625092992 ext(2928640->2932735) 00002000:00010000:3.0:1746143843.134134:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091085880 00000100:00100000:0.0:1746143843.138906:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.139144:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625093248 00000100:00100000:3.0:1746143843.139153:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625093248 00000100:00100000:3.0:1746143843.139201:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5450 00000100:00100000:3.0:1746143843.139208:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2865:x1830963625093248:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143843.139429:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2865:x1830963625093248:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 221us (529us total) trans 8589945107 rc 0/0 00000100:00100000:3.0:1746143843.139436:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5450 00000100:00100000:0.0:1746143843.164265:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.164593:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625093504 00000100:00100000:2.0:1746143843.164603:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625093504 00000100:00100000:2.0:1746143843.164661:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14034 00000100:00100000:2.0:1746143843.164668:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2869:x1830963625093504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.164692:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.164710:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b5ad2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841202b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.164811:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.164825:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.164835:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143843.164844:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143843.164964:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b5ad2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.164996:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 16 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.165003:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.165007:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143843.165010:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb2000, rc 0) 00000100:00100000:2.0:1746143843.165055:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2869:x1830963625093504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 388us (802us total) trans 8589945108 rc 0/0 00000100:00100000:2.0:1746143843.165061:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14034 00000100:00100000:0.0:1746143843.167786:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.167982:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.168211:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625093632 00000100:00100000:1.0:1746143843.168220:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625093632 00000100:00100000:1.0:1746143843.168264:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625093760 00000100:00100000:1.0:1746143843.168266:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625093760 00000100:00100000:1.0:1746143843.168293:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16788 00000100:00100000:1.0:1746143843.168300:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625093632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.168327:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.168344:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b5ae7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412032 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.168398:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627511936:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143843.168469:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.168718:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16789 00000100:00100000:0.0:1746143843.168725:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625093760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143843.168733:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.168744:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189c800/0x87925e4cb73b5aee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412039 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.168769:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627512064:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143843.168792:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.171394:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627511936:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143843.171421:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b5ae7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412032 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.171435:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086e00/0x87925e4cb73b5ae7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412032 expref: 24 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.171883:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086e00, rc 0) 00000100:00100000:1.0:1746143843.171957:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625093632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3656us (4179us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143843.171966:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16788 00000100:00100000:0.0:1746143843.172281:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091086a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627512064:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143843.172299:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189c800/0x87925e4cb73b5aee lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412039 expref: 26 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.172309:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189c800/0x87925e4cb73b5aee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412039 expref: 26 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.172333:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c800, rc 0) 00000100:00100000:0.0:1746143843.172349:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625093760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3625us (4368us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143843.172355:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16789 00000100:00100000:0.0:1746143843.174835:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.175444:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625093888 00000100:00100000:2.0:1746143843.175453:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625093888 00000100:00100000:2.0:1746143843.175617:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16790 00000100:00100000:2.0:1746143843.175624:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2869:x1830963625093888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.175641:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.175658:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412040 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.175687:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.175695:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.175697:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.175700:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.175729:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.175740:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 41 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.175751:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627512192:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.175828:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.178312:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.178374:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094016 00000100:00100000:3.0:1746143843.178382:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094016 00002000:00100000:3.0:1746143843.178422:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (921600->1048575) req@ffff880091086d80 x1830963625094016/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.178433:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091086d80 with x1830963625094016 ext(921600->1048575) 00010000:00010000:3.0:1746143843.178443:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 42 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.178456:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 42 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.178463:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091086d80 00000100:00100000:3.0:1746143843.178480:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2695 00000100:00100000:3.0:1746143843.178487:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625094016:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143843.178642:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627512192:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.178665:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.178677:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad600, rc 0) 00000100:00100000:2.0:1746143843.179144:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2869:x1830963625093888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3518us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.179152:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16790 00000100:00100000:3.0:1746143843.183158:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625094016:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4661us (4844us total) trans 17179874007 rc 0/0 00000100:00100000:3.0:1746143843.183172:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2695 00002000:00100000:3.0:1746143843.183185:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (921600->1048575) req@ffff880091086d80 x1830963625094016/t17179874007(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.183195:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091086d80 with x1830963625094016 ext(921600->1048575) 00010000:00010000:3.0:1746143843.183206:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 44 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.183221:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 44 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.183229:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091086d80 00000100:00100000:0.0:1746143843.185100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.185184:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094144 00000100:00100000:1.0:1746143843.185193:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094144 00010000:00010000:1.0:1746143843.185226:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 44 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.185426:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8200 00000100:00100000:1.0:1746143843.185434:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625094144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.185449:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.185469:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 44 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.185485:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 44 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.185508:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b5a00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 921600->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f91 expref: 44 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.185539:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.185541:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.185548:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.185556:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.185589:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.185600:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627512320:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143843.186153:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.189999:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627512320:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143843.190019:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.190059:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091087100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625094144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4626us (4968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.190071:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8200 00000100:00100000:0.0:1746143843.190439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.190600:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094400 00000100:00100000:3.0:1746143843.190607:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094400 00002000:00100000:3.0:1746143843.190641:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880091087480 x1830963625094400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.190651:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091087480 with x1830963625094400 ext(0->1048575) 00002000:00010000:3.0:1746143843.190655:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091087480 00000100:00100000:3.0:1746143843.190679:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7314 00000100:00100000:3.0:1746143843.190685:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625094400:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.198810:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625094400:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8112us (8359us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.198823:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7314 00002000:00100000:3.0:1746143843.198835:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880091087480 x1830963625094400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.198844:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091087480 with x1830963625094400 ext(0->1048575) 00002000:00010000:3.0:1746143843.198851:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091087480 00000100:00100000:0.0:1746143843.205186:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.205303:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094528 00000100:00100000:2.0:1746143843.205314:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094528 00000100:00100000:2.0:1746143843.205388:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16791 00000100:00100000:2.0:1746143843.205397:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2869:x1830963625094528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.205416:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.205434:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412047 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.205469:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.205476:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.205478:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.205481:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.205514:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 39 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.205532:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 39 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.205543:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627512448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.205637:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.209794:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627512448:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.209829:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.209847:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:2.0:1746143843.209904:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2869:x1830963625094528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4507us (4729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.209944:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16791 00000100:00100000:0.0:1746143843.212154:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.212222:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094656 00000100:00100000:3.0:1746143843.212231:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094656 00002000:00100000:3.0:1746143843.212276:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1142783) req@ffff880091087b80 x1830963625094656/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.212293:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091087b80 with x1830963625094656 ext(1048576->1142783) 00010000:00010000:3.0:1746143843.212302:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 40 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.212327:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 40 pid: 1947 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.212335:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091087b80 00000100:00100000:3.0:1746143843.212365:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2696 00000100:00100000:3.0:1746143843.212372:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625094656:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143843.217294:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625094656:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4911us (5137us total) trans 21474841276 rc 0/0 00000100:00100000:3.0:1746143843.217309:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2696 00002000:00100000:3.0:1746143843.217333:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1142783) req@ffff880091087b80 x1830963625094656/t21474841276(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.217343:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091087b80 with x1830963625094656 ext(1048576->1142783) 00010000:00010000:3.0:1746143843.217355:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.217372:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.217380:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091087b80 00000100:00100000:1.0:1746143843.221074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.221339:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094784 00000100:00100000:3.0:1746143843.221349:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094784 00000100:00100000:3.0:1746143843.221424:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14035 00000100:00100000:3.0:1746143843.221431:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2870:x1830963625094784:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143843.221456:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.221475:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841204e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.221541:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221554:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221564:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221578:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221583:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221589:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221658:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221665:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221670:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143843.221710:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143843.221714:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143843.221729:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221738:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221745:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221751:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221757:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221762:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221767:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8a000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.221771:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221776:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221786:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143843.221788:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.221791:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221796:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221824:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221829:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221834:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221838:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.221840:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221844:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221848:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14d00) 00010000:00010000:3.0:1746143843.221850:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.221851:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221854:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.221878:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.221889:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 7 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.221895:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.221898:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143843.221900:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:3.0:1746143843.221963:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2870:x1830963625094784:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 532us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.221970:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14035 00000100:00080000:0.0:1746143843.222070:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143843.222139:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.222721:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625094912 00000100:00100000:0.0:1746143843.222727:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625094912 00010000:00010000:0.0:1746143843.222750:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.223144:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8201 00000100:00100000:2.0:1746143843.223153:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625094912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.223165:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.223184:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.223194:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.223210:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467800/0x87925e4cb73b5a07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f9f expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.223237:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.223239:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.223246:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.223253:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.223281:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.223292:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627512576:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143843.223360:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.225070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.225109:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.225132:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.225157:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.225171:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.225193:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.225214:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095040 00000100:00100000:0.0:1746143843.225221:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095040 00000100:00100000:0.0:1746143843.225254:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095168 00000100:00100000:0.0:1746143843.225256:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095168 00000100:00100000:0.0:1746143843.225266:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095296 00000100:00100000:0.0:1746143843.225268:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095296 00000100:00100000:0.0:1746143843.225276:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095424 00000100:00100000:0.0:1746143843.225278:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095424 00000100:00100000:0.0:1746143843.225286:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095552 00000100:00100000:0.0:1746143843.225288:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095552 00000100:00100000:0.0:1746143843.225296:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095680 00000100:00100000:0.0:1746143843.225297:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095680 00000100:00100000:0.0:1746143843.225309:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16792 00000100:00100000:0.0:1746143843.225329:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625095040:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.225346:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.225362:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412055 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.225382:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225384:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225391:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225404:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225414:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ce00, rc 0) 00000100:00100000:0.0:1746143843.225454:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625095040:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 132us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.225460:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16792 00000100:00100000:0.0:1746143843.225475:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16793 00000100:00100000:0.0:1746143843.225479:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625095168:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.225486:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.225495:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841205c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.225505:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225506:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225510:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225523:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225534:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ca00, rc 0) 00000100:00100000:0.0:1746143843.225548:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625095168:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 69us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.225552:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16793 00000100:00100000:0.0:1746143843.225560:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16794 00000100:00100000:0.0:1746143843.225564:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625095296:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.225569:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.225574:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412063 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.225582:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225583:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225588:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225596:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225603:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c200, rc 0) 00000100:00100000:0.0:1746143843.225616:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625095296:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.225621:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16794 00000100:00100000:0.0:1746143843.225631:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16795 00000100:00100000:0.0:1746143843.225635:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625095424:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.225640:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.225647:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841206a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.225657:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225658:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225662:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225670:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225677:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d600, rc 0) 00000100:00100000:0.0:1746143843.225691:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625095424:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 56us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.225696:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16795 00000100:00100000:0.0:1746143843.225704:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16796 00000100:00100000:0.0:1746143843.225709:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625095552:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.225715:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.225720:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412071 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.225729:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225730:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.225734:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225742:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.225749:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d400, rc 0) 00000100:00100000:0.0:1746143843.225764:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625095552:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 55us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.225768:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16796 00000100:00100000:0.0:1746143843.225777:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16797 00000100:00100000:0.0:1746143843.225781:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625095680:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.225786:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.225792:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189d200/0x87925e4cb73b5b42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412078 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.225829:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627512704:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143843.225881:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2114480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.227660:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627512576:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.227676:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.228014:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625094912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4860us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.228025:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8201 00002000:00010000:0.0:1746143843.229504:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143842 -> 1746143843 00000100:00100000:0.0:1746143843.229528:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627512704:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143843.229557:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189d200/0x87925e4cb73b5b42 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412078 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.229570:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189d200/0x87925e4cb73b5b42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412078 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.229594:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d200, rc 0) 00000100:00100000:0.0:1746143843.229635:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625095680:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3852us (4440us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143843.229643:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16797 00000100:00100000:0.0:1746143843.231651:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.231740:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.231819:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625095936 00000100:00100000:3.0:1746143843.231829:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625095936 00002000:00100000:3.0:1746143843.231876:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880093f69500 x1830963625095936/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.231886:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69500 with x1830963625095936 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.231892:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f69500 00000100:00100000:3.0:1746143843.231909:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7315 00000100:00100000:3.0:1746143843.231938:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625095936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143843.232967:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625096192 00000100:00100000:2.0:1746143843.232973:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625096192 00000100:00100000:2.0:1746143843.233020:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14036 00000100:00100000:2.0:1746143843.233026:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2870:x1830963625096192:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143843.233039:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.233058:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b5b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841207f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233163:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.233177:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233183:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233189:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233194:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.233225:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233235:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 8 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.233247:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627512832:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.233353:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 15 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233359:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 15 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.233370:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627512960:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.233397:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 265 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.233403:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 265 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.233409:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f78380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627513088:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.233425:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.237709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.237777:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.238140:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627512832:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.238153:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627512960:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.238161:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f78380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627513088:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.238192:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143843.238698:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625096448 00000100:00100000:3.0:1746143843.238707:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625096448 00000100:00100000:0.0:1746143843.238713:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.238732:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625096320 00000100:00100000:0.0:1746143843.238735:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625096320 00010000:00010000:3.0:1746143843.238742:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 266 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.238749:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 16 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.238781:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625096576 00000100:00100000:3.0:1746143843.238784:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625096576 00010000:00010000:3.0:1746143843.238795:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 9 pid: 7244 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.239062:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8202 00000100:00100000:0.0:1746143843.239072:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+266:2008:x1830963625096448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143843.239113:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8203 00000100:00100000:1.0:1746143843.239121:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625096320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.239129:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143843.239132:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8204 00010000:00010000:1.0:1746143843.239136:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 16 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.239139:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625096576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.239145:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 16 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.239148:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.239152:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 9 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.239177:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.239182:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 266 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.239210:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 9 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.239220:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 266 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.239237:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b5b18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841204e expref: 9 pid: 7244 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.239241:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb3800/0x87925e4cb73b5a93 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841200f expref: 266 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.239255:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.239259:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.239269:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.239277:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.239284:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143843.239287:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.239334:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2008:x1830963625096448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 262us (1635us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143843.239350:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd87200/0x87925e4cb73b5abd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841201d expref: 16 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.239360:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143843.239386:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.239388:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143843.239389:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143843.239394:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143843.239431:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625096576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 293us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.239432:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625096320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 313us (1654us total) trans 0 rc 0/0 00000004:00200000:2.0:1746143843.239451:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000100:00100000:0.0:1746143843.239453:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8202 00010000:00010000:2.0:1746143843.239585:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b5b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841207f expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.239602:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841207f expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.239622:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8204 00000100:00100000:1.0:1746143843.239629:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8203 00000100:00100000:3.0:1746143843.239722:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625095936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7785us (8081us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.239730:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7315 00002000:00100000:3.0:1746143843.239738:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880093f69500 x1830963625095936/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.239747:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69500 with x1830963625095936 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.239751:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f69500 00010000:00010000:2.0:1746143843.239811:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.239813:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143843.239815:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:2.0:1746143843.239996:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2870:x1830963625096192:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6969us (8254us total) trans 8589945109 rc 0/0 00000100:00100000:2.0:1746143843.240006:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14036 00000100:00100000:0.0:1746143843.245691:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.245803:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625096832 00000100:00100000:3.0:1746143843.245813:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625096832 00000100:00100000:3.0:1746143843.245860:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14037 00000100:00100000:3.0:1746143843.245867:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2870:x1830963625096832:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143843.245892:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.245896:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143843.246069:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c600/0x87925e4cb73b5b50 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841207f expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.246255:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.246261:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143843.246275:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b5e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412086 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.246397:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.246410:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.246419:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143843.246431:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143843.246536:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b5e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.246550:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.246556:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.246559:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143843.246561:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467800, rc 0) 00000100:00100000:3.0:1746143843.246620:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2870:x1830963625096832:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 750us (935us total) trans 8589945110 rc 0/0 00000100:00100000:3.0:1746143843.246627:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14037 00000100:00100000:0.0:1746143843.253642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.253692:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.253735:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.253768:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625097216 00000100:00100000:2.0:1746143843.253779:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625097216 00000100:00100000:3.0:1746143843.253819:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625096960 00000100:00100000:3.0:1746143843.253823:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625096960 00002000:00100000:2.0:1746143843.253836:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093f6ad80 x1830963625097216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143843.253865:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14038 00000100:00100000:3.0:1746143843.253873:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2870:x1830963625096960:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143843.253895:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.253943:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b5b73 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841208d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.254002:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b5b73 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841208d expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.254016:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b5b73 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841208d expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.254033:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.254036:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143843.254039:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467600, rc 0) 00002000:00100000:2.0:1746143843.254042:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6ad80 with x1830963625097216 ext(2097152->3145727) 00002000:00010000:2.0:1746143843.254048:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f6ad80 00000100:00100000:2.0:1746143843.254073:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625097472 00000100:00100000:2.0:1746143843.254077:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625097472 00000100:00100000:3.0:1746143843.254082:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7316 00000100:00100000:3.0:1746143843.254088:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625097216:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143843.254092:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880093f6b100 x1830963625097472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 504/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.254099:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6b100 with x1830963625097472 ext(2097152->4194303) 00002000:00010000:2.0:1746143843.254102:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6b100 00000100:00100000:2.0:1746143843.254114:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7317 00000100:00100000:2.0:1746143843.254120:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625097472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.254848:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2870:x1830963625096960:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 972us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.254854:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14038 00000100:00100000:2.0:1746143843.262592:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.262721:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625097728 00000100:00100000:3.0:1746143843.262735:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625097728 00000100:00100000:3.0:1746143843.262785:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14039 00000100:00100000:3.0:1746143843.262792:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+265:2873:x1830963625097728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.262816:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.262834:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412094 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.262938:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.262951:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.262961:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.262974:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.262979:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.262984:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263082:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263091:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263096:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143843.263110:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143843.263173:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263180:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263186:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263192:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8aa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.263195:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263201:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263210:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.263213:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143843.263216:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263221:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5b8f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263239:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263244:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263249:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263257:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263261:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.263263:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263268:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263272:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143843.263274:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.263276:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263281:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b600/0x87925e4cb73b5b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263287:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263291:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263295:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263299:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8a000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.263301:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263306:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263315:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14f00) 00010000:00010000:3.0:1746143843.263329:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.263331:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263336:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a000/0x87925e4cb73b5b88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.263367:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412094 expref: 267 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.263374:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412094 expref: 267 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.263381:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:3.0:1746143843.263425:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+266:2873:x1830963625097728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 633us (842us total) trans 8589945111 rc 301/301 00000100:00100000:3.0:1746143843.263431:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14039 00000100:00100000:2.0:1746143843.263620:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.263635:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.263649:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625097856 00000100:00100000:2.0:1746143843.263653:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625097856 00000100:00100000:2.0:1746143843.263674:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625097984 00000100:00100000:2.0:1746143843.263676:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625097984 00000100:00100000:2.0:1746143843.263688:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16798 00000100:00100000:2.0:1746143843.263693:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625097856:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143843.263718:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263731:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263739:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.263745:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.263747:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.263750:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263776:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.263786:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 15 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.263798:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627513216:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.263848:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263860:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 25 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.263867:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627513344:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.263882:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.263900:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16799 00000100:00100000:2.0:1746143843.263906:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625097984:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:2.0:1746143843.263941:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263951:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263959:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.263964:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.263965:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.263967:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.263981:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.263988:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 14 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.263997:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627513472:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.264023:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.264030:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 27 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.264037:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627513600:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.264050:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.264068:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.264095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.264306:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098240 00000100:00100000:1.0:1746143843.264311:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098240 00000100:00100000:1.0:1746143843.264358:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098112 00000100:00100000:1.0:1746143843.264360:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098112 00000100:00100000:1.0:1746143843.264371:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16800 00000100:00100000:1.0:1746143843.264376:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625098240:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143843.264392:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264402:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264415:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 16 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.264422:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 42 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264427:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.264428:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.264430:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264446:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 42 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264453:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 42 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.264460:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627513728:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.264484:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 16 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.264491:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 16 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.264498:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627513856:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.264515:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264522:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.264529:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627513984:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.264540:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.264553:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16801 00000100:00100000:1.0:1746143843.264558:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625098112:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143843.264571:0:13436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264579:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264587:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.264594:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264600:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.264601:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.264603:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264620:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264627:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.264634:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627514112:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.264653:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.264659:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.264666:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800921cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627514240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.264685:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 40 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264692:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 40 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.264699:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627514368:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.264709:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.264731:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.264743:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098496 00000100:00100000:1.0:1746143843.264746:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098496 00000100:00100000:1.0:1746143843.264761:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16802 00000100:00100000:1.0:1746143843.264765:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625098496:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143843.264778:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264787:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264793:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.264794:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.264796:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264809:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.264816:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.264823:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627514496:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.264834:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.264868:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.264936:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098368 00000100:00100000:3.0:1746143843.264939:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098368 00000100:00100000:3.0:1746143843.264957:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16803 00000100:00100000:3.0:1746143843.264961:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963625098368:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143843.264976:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.264985:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.264998:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.265005:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.265010:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.265011:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.265013:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.265027:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.265034:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.265041:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627514624:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.265061:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.265068:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746143843.265075:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627514752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.265090:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.265097:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.265104:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627514880:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.265112:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.265188:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625097216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11100us (11495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.265196:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7316 00002000:00100000:3.0:1746143843.265204:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093f6ad80 x1830963625097216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.265213:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6ad80 with x1830963625097216 ext(2097152->3145727) 00010000:00010000:3.0:1746143843.265218:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 24 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.265227:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 24 pid: 1947 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.265233:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f6ad80 00000100:00100000:2.0:1746143843.268056:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625097472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13925us (14309us total) trans 0 rc 1843200/1843200 00000100:00100000:2.0:1746143843.268068:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7317 00002000:00100000:2.0:1746143843.268080:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880093f6b100 x1830963625097472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 504/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1843200/1843200 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.268089:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6b100 with x1830963625097472 ext(2097152->4194303) 00010000:00010000:2.0:1746143843.268098:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 26 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.268110:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 26 pid: 1945 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746143843.268116:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f6b100 00000100:00100000:0.0:1746143843.268362:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.268385:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.268487:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627513216:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.268495:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627513344:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.268515:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.268549:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627513472:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.268556:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627513600:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.268567:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.268621:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098624 00000100:00100000:1.0:1746143843.268627:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098624 00010000:00010000:1.0:1746143843.268652:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 18 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.268675:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098752 00000100:00100000:1.0:1746143843.268677:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098752 00010000:00010000:1.0:1746143843.268684:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.268697:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8205 00000100:00100000:1.0:1746143843.268702:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2008:x1830963625098624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.268714:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.268732:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 18 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.268742:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 18 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.268762:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189ce00/0x87925e4cb73b5b1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412055 expref: 18 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.268778:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.268797:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2008:x1830963625098624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.268803:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8205 00000100:00100000:1.0:1746143843.268812:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8206 00000100:00100000:1.0:1746143843.268816:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2010:x1830963625098752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.268822:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.268833:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.268840:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.268850:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b5b26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841205c expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.268858:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.268870:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625098752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 53us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.268875:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8206 00000100:00100000:1.0:1746143843.268898:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627513728:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.268905:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627513856:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.269633:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627514112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.269679:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627513984:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.269697:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.272014:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.272045:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.272078:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.272095:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.272111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.272136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.272161:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625098880 00000100:00100000:0.0:1746143843.272168:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625098880 00010000:00010000:0.0:1746143843.272198:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746143843.272221:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099520 00000100:00100000:0.0:1746143843.272223:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099520 00010000:00010000:0.0:1746143843.272230:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 24 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.272237:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099008 00000100:00100000:0.0:1746143843.272239:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099008 00010000:00010000:0.0:1746143843.272247:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 26 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.272260:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099264 00000100:00100000:0.0:1746143843.272261:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099264 00010000:00010000:0.0:1746143843.272267:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 25 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.272274:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099136 00000100:00100000:0.0:1746143843.272276:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099136 00010000:00010000:0.0:1746143843.272283:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 43 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.272293:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8207 00000100:00100000:0.0:1746143843.272299:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2010:x1830963625098880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.272328:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.272348:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 17 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.272430:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8208 00000100:00100000:2.0:1746143843.272439:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625099520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.272447:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.272457:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272467:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272490:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b7a00/0x87925e4cb73b5a1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fad expref: 25 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272512:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.272557:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625099520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 120us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.272564:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8208 00000100:00100000:2.0:1746143843.272579:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8209 00000100:00100000:2.0:1746143843.272590:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625099008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.272599:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.272611:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 26 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272619:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 26 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272635:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b5afc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412047 expref: 26 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.272643:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627514624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.272643:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.272645:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.272649:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.272657:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.272662:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8210 00000100:00100000:3.0:1746143843.272668:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625099264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.272675:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.272684:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143843.272685:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.272692:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.272698:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625099008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 114us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.272703:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8209 00010000:00010000:3.0:1746143843.272704:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b5af5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412040 expref: 23 pid: 13430 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.272712:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8211 00000100:00100000:2.0:1746143843.272716:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625099136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.272723:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.272728:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 43 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272736:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 43 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272746:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551200/0x87925e4cb73b5a23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fb4 expref: 43 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.272758:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.272772:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625099136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (634us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143843.272773:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.272775:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143843.272777:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8211 00010000:00010000:3.0:1746143843.272778:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272784:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272799:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272806:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.272806:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800921cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627514240:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.272814:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627514368:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.272821:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272828:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272835:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.272837:0:13436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272841:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143843.272845:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272852:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.272853:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099648 00000100:00100000:2.0:1746143843.272856:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099648 00010000:00010000:3.0:1746143843.272861:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272866:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b5ba4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143843.272884:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2678784->2932735) req@ffff8800910ec700 x1830963625099648/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.272892:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ec700 with x1830963625099648 ext(2678784->2932735) 00010000:00010000:2.0:1746143843.272897:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 25 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.272904:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625097984:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 8998us (9268us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143843.272906:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 25 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.272927:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16799 00002000:00010000:2.0:1746143843.272928:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910ec700 00000100:00100000:2.0:1746143843.272942:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2697 00000100:00100000:2.0:1746143843.272947:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625099648:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:3.0:1746143843.272953:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143843.272961:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272967:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272978:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272983:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272988:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272992:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e520c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143843.272994:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.272998:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.273010:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.273015:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e520c00/0x87925e4cb73b5b9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.273044:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963625097856:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 9350us (9425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.273049:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16798 00000100:00100000:3.0:1746143843.273069:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625099264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 402us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.273074:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8210 00000100:00100000:1.0:1746143843.273081:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627514496:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.273098:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.274155:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 16 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.274170:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189d600/0x87925e4cb73b5b34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841206a expref: 16 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.274185:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.274186:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.274190:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.274201:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.274287:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.274309:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625098880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2009us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.274326:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8207 00010000:00010000:1.0:1746143843.274405:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274417:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274433:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274439:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274445:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274450:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801368da400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143843.274454:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274460:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274469:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.274474:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801368da400/0x87925e4cb73b5bab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.274503:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625098240:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 10126us (10433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.274510:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16800 00000100:00100000:1.0:1746143843.274548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.274670:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627514752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.274679:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627514880:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.274684:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143843.274699:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.274700:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099392 00000100:00100000:1.0:1746143843.274705:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099392 00010000:00010000:1.0:1746143843.274722:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.274742:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099904 00000100:00100000:1.0:1746143843.274744:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099904 00000100:00100000:0.0:1746143843.274744:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8212 00000100:00100000:0.0:1746143843.274750:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625099392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.274752:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.274761:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143843.274764:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8213 00000100:00100000:1.0:1746143843.274767:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625099904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.274770:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.274772:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.274777:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.274779:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.274786:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.274833:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b5b2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412063 expref: 15 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.274845:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.274859:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625099392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.274865:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8212 00010000:00010000:1.0:1746143843.274983:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084e00/0x87925e4cb73b5a15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fa6 expref: 27 pid: 13430 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.274992:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.275007:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963625099904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 239us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.275012:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8213 00000100:00100000:0.0:1746143843.278732:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.278774:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.278782:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625099776 00000100:00100000:1.0:1746143843.278791:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625099776 00010000:00010000:1.0:1746143843.278827:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 14 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746143843.278835:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100160 00000100:00100000:3.0:1746143843.278838:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100160 00000100:00100000:1.0:1746143843.278855:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8214 00000100:00100000:1.0:1746143843.278862:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625099776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143843.278874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143843.278876:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143843.278878:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14040 00000100:00100000:3.0:1746143843.278883:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2873:x1830963625100160:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143843.278892:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100032 00000100:00100000:0.0:1746143843.278896:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100032 00010000:00010000:1.0:1746143843.278898:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 14 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746143843.278902:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.278909:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 14 pid: 3135 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.278928:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 41 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.278934:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b5bc7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841209b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.278945:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189d400/0x87925e4cb73b5b3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412071 expref: 14 pid: 3135 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746143843.278948:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8215 00000100:00100000:0.0:1746143843.278954:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625100032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.278958:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143843.278963:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.278975:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 41 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.278984:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 41 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.278997:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b5a0e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f98 expref: 41 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.279001:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625099776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.279006:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8214 00010000:00010000:0.0:1746143843.279007:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.279009:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.279014:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.279022:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.279027:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143843.279042:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.279059:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625100032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.279065:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8215 00010000:00010000:2.0:1746143843.279081:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279089:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279106:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279113:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279119:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279126:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143843.279129:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279137:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279147:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.279152:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048600/0x87925e4cb73b5bb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.279372:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.279382:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143843.279408:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143843.279412:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143843.279428:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.279448:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b5bc7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 268 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.279458:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 267 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.279465:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.279468:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143843.279471:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2800, rc 0) 00000100:00100000:3.0:1746143843.279495:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:2873:x1830963625100160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 612us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.279500:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14040 00000100:00100000:2.0:1746143843.279583:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625098112:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 15024us (15486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.279592:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16801 00000100:00100000:0.0:1746143843.280453:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.280491:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.280622:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100288 00000100:00100000:1.0:1746143843.280628:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100288 00010000:00010000:1.0:1746143843.280649:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.281748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.281764:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100544 00000100:00100000:2.0:1746143843.281769:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100544 00000100:00100000:2.0:1746143843.281797:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16804 00000100:00100000:2.0:1746143843.281805:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2869:x1830963625100544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.281818:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.281834:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120a2 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.281859:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.281863:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.281869:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746143843.281874:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.281889:0:13436:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.281900:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.281929:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a8800, rc 0) 00000100:00100000:2.0:1746143843.281962:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2869:x1830963625100544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 158us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.281967:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16804 00000100:00100000:2.0:1746143843.283122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.283137:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100800 00000100:00100000:2.0:1746143843.283142:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100800 00000100:00100000:2.0:1746143843.283178:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16805 00000100:00100000:2.0:1746143843.283183:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625100800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.283194:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.283206:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120b0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143843.283227:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a63, atime: 0x68140a62, ctime: 0x68140a63, blocks: 0x808 00010000:00010000:2.0:1746143843.283239:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.283241:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.283247:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.283261:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 41 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.283269:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb4a00, rc 0) 00000100:00100000:2.0:1746143843.283287:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625100800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 104us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.283295:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16805 00000100:00100000:3.0:1746143843.283848:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100416 00000100:00100000:3.0:1746143843.283855:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100416 00010000:00010000:3.0:1746143843.283881:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 22 pid: 1947 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.283888:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8216 00000100:00100000:0.0:1746143843.283896:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625100288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.283907:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143843.283923:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8217 00000100:00100000:3.0:1746143843.283929:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625100416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.283932:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.283935:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.283942:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.283954:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 22 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.283962:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b5a38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fc9 expref: 42 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.283963:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 22 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.283973:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b5a46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411fd7 expref: 22 pid: 1947 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.283974:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.283976:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.283979:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.283985:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.283994:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143843.284004:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.284012:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625100416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.284016:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625100288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.284018:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8217 00000100:00100000:0.0:1746143843.284024:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8216 00010000:00010000:3.0:1746143843.284038:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.284046:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.284060:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.284066:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143843.284072:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.284079:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.284084:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143843.284086:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd85000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143843.284089:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.284096:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.284105:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.284110:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd85000/0x87925e4cb73b5bc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.284139:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.284143:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625098368:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 19182us (19275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.284150:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16803 00000100:00100000:3.0:1746143843.284161:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625101056 00000100:00100000:3.0:1746143843.284164:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625101056 00000100:00100000:0.0:1746143843.284170:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.284280:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625101312 00000100:00100000:3.0:1746143843.284283:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625101312 00000100:00100000:3.0:1746143843.284297:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100672 00000100:00100000:3.0:1746143843.284299:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100672 00000100:00100000:0.0:1746143843.284306:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.284308:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625100928 00000100:00100000:3.0:1746143843.284309:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625100928 00000100:00100000:3.0:1746143843.284325:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625101184 00000100:00100000:3.0:1746143843.284327:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625101184 00000100:00100000:0.0:1746143843.284333:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16806 00000100:00100000:3.0:1746143843.284338:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16807 00000100:00100000:0.0:1746143843.284338:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625101056:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143843.284342:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625101312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.284347:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.284347:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.284355:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73b5be3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120cc expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.284355:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120be expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143843.284366:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a62, atime: 0x68140a62, ctime: 0x68140a63, blocks: 0x808 00010000:00010000:0.0:1746143843.284373:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.284374:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.284378:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 44 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.284386:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 44 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143843.284388:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627515008:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143843.284392:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3aa00, rc 0) 00000100:00100000:0.0:1746143843.284405:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625101056:12345-192.168.202.3@tcp:101:cat.0 Request processed in 67us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.284410:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16806 00000100:00100000:0.0:1746143843.284422:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16808 00000100:00100000:0.0:1746143843.284427:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625100672:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143843.284432:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746143843.284432:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.284440:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120a9 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.284448:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16809 00002000:00010000:0.0:1746143843.284449:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a63, atime: 0x68140a62, ctime: 0x68140a63, blocks: 0x748 00000100:00100000:3.0:1746143843.284453:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625100928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143843.284456:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.284457:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.284458:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.284461:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 44 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.284464:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120b7 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.284469:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 44 pid: 9586 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143843.284474:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a62, atime: 0x68140a62, ctime: 0x68140a63, blocks: 0x808 00010000:00010000:0.0:1746143843.284474:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3b200, rc 0) 00010000:00010000:3.0:1746143843.284480:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.284481:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.284485:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 44 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143843.284486:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625100672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 59us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.284491:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16808 00010000:00010000:3.0:1746143843.284493:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 44 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143843.284500:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16810 00000100:00100000:0.0:1746143843.284503:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625101184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.284504:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84e00, rc 0) 00010000:00010000:0.0:1746143843.284508:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.284515:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120c5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.284516:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625100928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.284520:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16809 00002000:00010000:0.0:1746143843.284522:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a63, atime: 0x68140a62, ctime: 0x68140a63, blocks: 0x1510 00010000:00010000:0.0:1746143843.284529:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.284531:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.284534:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 44 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.284542:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 44 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.284547:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3be00, rc 0) 00000100:00100000:0.0:1746143843.284560:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625101184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.284564:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16810 00000100:00100000:2.0:1746143843.286367:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963625099648:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13410us (14244us total) trans 21474841277 rc 0/0 00000100:00100000:2.0:1746143843.286377:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2697 00002000:00100000:2.0:1746143843.286387:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2678784->2932735) req@ffff8800910ec700 x1830963625099648/t21474841277(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.286397:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ec700 with x1830963625099648 ext(2678784->2932735) 00010000:00010000:2.0:1746143843.286405:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.286418:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00002000:00010000:2.0:1746143843.286424:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910ec700 00000100:00100000:3.0:1746143843.286572:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627515008:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143843.286599:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73b5be3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120cc expref: 43 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.286611:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800972eca00/0x87925e4cb73b5be3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120cc expref: 43 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.286620:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eca00, rc 0) 00000100:00100000:3.0:1746143843.286639:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625101312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2295us (2553us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143843.286644:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16807 00000100:00100000:2.0:1746143843.291124:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.291291:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625101440 00000100:00100000:0.0:1746143843.291301:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625101440 00010000:00010000:0.0:1746143843.291353:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.291398:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8218 00000100:00100000:0.0:1746143843.291407:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625101440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.291423:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.291443:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.291454:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.291478:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087c00/0x87925e4cb73b5acb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2678784->2932735) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412024 expref: 27 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.291497:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.291499:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.291504:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.291512:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.292651:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.292721:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963625101440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1311us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.292728:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8218 00010000:00010000:1.0:1746143843.293136:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293146:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293167:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293173:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293179:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293186:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143843.293189:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293196:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293208:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.293209:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.293215:0:1945:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293226:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.293258:0:1945:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.293271:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627515136:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143843.294293:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.298104:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.298153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.298174:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.298264:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625101952 00000100:00100000:3.0:1746143843.298275:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625101952 00002000:00100000:3.0:1746143843.298334:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800910ee300 x1830963625101952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.298345:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ee300 with x1830963625101952 ext(0->1048575) 00002000:00010000:3.0:1746143843.298351:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910ee300 00000100:00100000:3.0:1746143843.298385:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7318 00000100:00100000:3.0:1746143843.298394:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625101952:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143843.298448:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625102208 00000100:00100000:2.0:1746143843.298452:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625102208 00002000:00100000:2.0:1746143843.298473:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800910ee680 x1830963625102208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.298480:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ee680 with x1830963625102208 ext(1048576->2097151) 00002000:00010000:2.0:1746143843.298484:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910ee680 00000100:00100000:2.0:1746143843.298497:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7319 00000100:00100000:2.0:1746143843.298501:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625102208:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.299151:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625101696 00000100:00100000:3.0:1746143843.299156:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625101696 00000100:00100000:3.0:1746143843.299182:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14041 00000100:00100000:3.0:1746143843.299186:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+267:2875:x1830963625101696:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143843.299199:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.299218:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73b5c06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120d3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.299299:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299311:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299335:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299348:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299354:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299359:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299454:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299466:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.299477:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.299508:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.299520:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 9 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:3.0:1746143843.299533:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627515264:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.299598:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.310092:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.310122:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.310153:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.310182:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.310215:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627515264:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.310243:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143843.310251:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625102464 00000100:00100000:2.0:1746143843.310259:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625102464 00002000:00100000:2.0:1746143843.310304:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009719f100 x1830963625102464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.310313:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f100 with x1830963625102464 ext(1048576->2097151) 00002000:00010000:2.0:1746143843.310327:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719f100 00000100:00100000:2.0:1746143843.310356:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625102720 00000100:00100000:2.0:1746143843.310359:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625102720 00000100:00100000:3.0:1746143843.310372:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963625101952:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11979us (12216us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746143843.310377:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719c700 x1830963625102720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143843.310380:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7318 00002000:00100000:2.0:1746143843.310384:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c700 with x1830963625102720 ext(1048576->2097151) 00002000:00100000:3.0:1746143843.310387:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800910ee300 x1830963625101952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746143843.310387:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719c700 00002000:00100000:3.0:1746143843.310394:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ee300 with x1830963625101952 ext(0->1048575) 00002000:00010000:3.0:1746143843.310398:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910ee300 00000100:00100000:2.0:1746143843.310398:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625102976 00000100:00100000:2.0:1746143843.310400:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625102976 00002000:00100000:2.0:1746143843.310410:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880091d4d880 x1830963625102976/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.310416:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d880 with x1830963625102976 ext(2097152->3145727) 00000100:00100000:3.0:1746143843.310419:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7320 00002000:00010000:2.0:1746143843.310419:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4d880 00000100:00100000:3.0:1746143843.310426:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625102464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143843.310429:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7321 00000100:00100000:2.0:1746143843.310435:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625102720:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.311160:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7322 00000100:00100000:3.0:1746143843.311167:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625102976:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.311241:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625103104 00000100:00100000:0.0:1746143843.311247:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625103104 00010000:00010000:0.0:1746143843.311268:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 10 pid: 6587 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.311289:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8219 00000100:00100000:0.0:1746143843.311295:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625103104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.311304:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.311309:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 10 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.311332:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 10 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.311355:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b5b65 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412086 expref: 10 pid: 6587 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.311372:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143843.311377:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311387:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311393:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311411:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.311430:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625103104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 135us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.311435:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8219 00010000:00010000:0.0:1746143843.311459:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311465:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:0.0:1746143843.311479:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143843.311582:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311589:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311594:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311601:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143843.311605:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311611:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311619:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143843.311621:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143843.311624:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311628:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466a00/0x87925e4cb73b5c1b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311646:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311651:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311655:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311660:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311664:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5ad600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143843.311667:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.311671:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143843.311864:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627515136:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.311880:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.311888:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5bb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.311946:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625098496:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 47179us (47213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.311954:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16802 00010000:00010000:0.0:1746143843.313370:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143843.313375:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143843.313379:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313386:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5ad600/0x87925e4cb73b5c0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313400:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313404:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313409:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313412:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143843.313414:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313419:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313425:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14f00) 00010000:00010000:0.0:1746143843.313427:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143843.313429:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313433:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b5c14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143843.313483:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73b5c06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120d3 expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.313492:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800972eda00/0x87925e4cb73b5c06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120d3 expref: 269 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.313500:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eda00, rc 0) 00000100:00100000:0.0:1746143843.313525:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:2875:x1830963625101696:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14338us (15432us total) trans 8589945112 rc 301/301 00000100:00100000:0.0:1746143843.313532:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14041 00000100:00100000:0.0:1746143843.314047:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625102208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15544us (15870us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143843.314056:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7319 00002000:00100000:0.0:1746143843.314065:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800910ee680 x1830963625102208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143843.314074:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ee680 with x1830963625102208 ext(1048576->2097151) 00002000:00010000:0.0:1746143843.314078:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910ee680 00000100:00100000:1.0:1746143843.320398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.320854:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625103360 00000100:00100000:0.0:1746143843.320865:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625103360 00000100:00100000:0.0:1746143843.320945:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14042 00000100:00100000:0.0:1746143843.320953:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2870:x1830963625103360:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:1.0:1746143843.321208:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.321236:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b5b73 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841208d expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.321272:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143843.321277:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.321365:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2870:x1830963625103360:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 412us (976us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746143843.321371:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14042 00000100:00100000:3.0:1746143843.323372:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625102464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12937us (13281us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.323384:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7320 00002000:00100000:3.0:1746143843.323396:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009719f100 x1830963625102464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.323405:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f100 with x1830963625102464 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.323411:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719f100 00000100:00100000:3.0:1746143843.324117:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625102976:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12948us (13961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.324123:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7322 00002000:00100000:3.0:1746143843.324129:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880091d4d880 x1830963625102976/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.324136:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d880 with x1830963625102976 ext(2097152->3145727) 00002000:00010000:3.0:1746143843.324140:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4d880 00000100:00100000:0.0:1746143843.324269:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.324413:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625103616 00000100:00100000:3.0:1746143843.324422:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625103616 00000100:00100000:3.0:1746143843.324466:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5451 00000100:00100000:3.0:1746143843.324474:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2870:x1830963625103616:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143843.324669:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2870:x1830963625103616:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 195us (400us total) trans 8589945113 rc 0/0 00000100:00100000:3.0:1746143843.324675:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5451 00000100:00100000:2.0:1746143843.326874:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625102720:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16428us (16741us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143843.326886:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7321 00002000:00100000:2.0:1746143843.326897:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719c700 x1830963625102720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.326906:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c700 with x1830963625102720 ext(1048576->2097151) 00002000:00010000:2.0:1746143843.327103:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719c700 00000100:00100000:0.0:1746143843.328501:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.328580:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625103872 00000100:00100000:2.0:1746143843.328589:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625103872 00000100:00100000:2.0:1746143843.329087:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5452 00000100:00100000:2.0:1746143843.329097:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2870:x1830963625103872:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143843.329422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.329464:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625104000 00000100:00100000:3.0:1746143843.329469:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625104000 00000100:00100000:3.0:1746143843.329495:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16811 00000100:00100000:3.0:1746143843.329499:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2869:x1830963625104000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.329509:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.329528:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120da expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.329534:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2870:x1830963625103872:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 440us (1039us total) trans 8589945114 rc 0/0 00000100:00100000:2.0:1746143843.329540:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5452 00010000:00010000:3.0:1746143843.329549:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.329550:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.329558:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.329578:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 22 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.329590:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b600, rc 0) 00000100:00100000:3.0:1746143843.329606:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2869:x1830963625104000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.329612:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16811 00000100:00100000:0.0:1746143843.332753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.332829:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625104256 00000100:00100000:2.0:1746143843.332837:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625104256 00002000:00100000:2.0:1746143843.332877:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800910ef480 x1830963625104256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.332885:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ef480 with x1830963625104256 ext(2097152->3145727) 00002000:00010000:2.0:1746143843.332890:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910ef480 00000100:00100000:2.0:1746143843.332943:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7323 00000100:00100000:2.0:1746143843.332950:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625104256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143843.336462:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.336558:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625104512 00000100:00100000:3.0:1746143843.336572:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625104512 00002000:00100000:3.0:1746143843.336617:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009eb86680 x1830963625104512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.336627:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb86680 with x1830963625104512 ext(3145728->4194303) 00002000:00010000:3.0:1746143843.336632:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb86680 00000100:00100000:3.0:1746143843.336677:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7324 00000100:00100000:3.0:1746143843.336685:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625104512:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.339613:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.339751:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625104768 00000100:00100000:2.0:1746143843.339761:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625104768 00002000:00100000:2.0:1746143843.339807:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800910ef800 x1830963625104768/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.339817:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ef800 with x1830963625104768 ext(3145728->4194303) 00002000:00010000:2.0:1746143843.339822:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910ef800 00000100:00100000:2.0:1746143843.339856:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7325 00000100:00100000:2.0:1746143843.339864:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625104768:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.340482:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625104256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7530us (7734us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.340490:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7323 00002000:00100000:3.0:1746143843.340497:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800910ef480 x1830963625104256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.340504:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ef480 with x1830963625104256 ext(2097152->3145727) 00002000:00010000:3.0:1746143843.340723:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910ef480 00000100:00100000:3.0:1746143843.343350:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625104512:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6656us (6891us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.343363:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7324 00002000:00100000:3.0:1746143843.343374:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009eb86680 x1830963625104512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.343384:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb86680 with x1830963625104512 ext(3145728->4194303) 00002000:00010000:3.0:1746143843.343389:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb86680 00000100:00100000:0.0:1746143843.347962:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.348177:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625104896 00000100:00100000:3.0:1746143843.348269:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625104896 00000100:00100000:3.0:1746143843.348355:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16812 00000100:00100000:3.0:1746143843.348363:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+42:2873:x1830963625104896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.348477:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.348501:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120e1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.348528:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.348530:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.348538:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 43 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.348563:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 43 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.348573:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8aa00, rc 0) 00000100:00100000:3.0:1746143843.348621:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+43:2873:x1830963625104896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 258us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.348627:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16812 00000100:00100000:2.0:1746143843.352677:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625104768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12801us (13061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143843.352691:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7325 00002000:00100000:2.0:1746143843.352704:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800910ef800 x1830963625104768/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.352714:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910ef800 with x1830963625104768 ext(3145728->4194303) 00002000:00010000:2.0:1746143843.352720:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910ef800 00000100:00100000:0.0:1746143843.364839:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.364882:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.364942:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.364987:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.365032:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625105024 00000100:00100000:2.0:1746143843.365044:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625105024 00000100:00100000:2.0:1746143843.365100:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625105280 00000100:00100000:2.0:1746143843.365103:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625105280 00000100:00100000:2.0:1746143843.365115:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625105152 00000100:00100000:2.0:1746143843.365117:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625105152 00000100:00100000:2.0:1746143843.365133:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625105408 00000100:00100000:2.0:1746143843.365135:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625105408 00000100:00100000:2.0:1746143843.365148:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16813 00000100:00100000:2.0:1746143843.365162:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625105024:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143843.365175:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16814 00010000:00010000:2.0:1746143843.365182:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143843.365182:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625105280:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.365190:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.365204:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120f6 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.365205:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120e8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.365225:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.365226:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.365227:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.365227:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.365233:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 28 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.365234:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.365245:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 28 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.365246:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.365253:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717a00, rc 0) 00010000:00010000:2.0:1746143843.365260:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ee00, rc 0) 00000100:00100000:1.0:1746143843.365299:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625105280:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.365304:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16814 00000100:00100000:2.0:1746143843.365333:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625105024:12345-192.168.202.3@tcp:101:cat.0 Request processed in 171us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.365339:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16813 00000100:00100000:1.0:1746143843.365345:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16815 00000100:00100000:2.0:1746143843.365350:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16816 00000100:00100000:1.0:1746143843.365351:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625105152:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143843.365355:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625105408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.365357:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.365363:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120ef expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.365366:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.365372:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.365374:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484120fd expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.365374:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.365377:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 28 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.365385:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 28 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.365393:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717600, rc 0) 00000100:00100000:1.0:1746143843.365408:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625105152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 57us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.365412:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16815 00010000:00010000:2.0:1746143843.365474:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.365476:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.365481:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.365495:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.365509:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76600, rc 0) 00000100:00100000:2.0:1746143843.365523:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2011:x1830963625105408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 168us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.365528:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16816 00000100:00100000:1.0:1746143843.365904:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.365980:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.366030:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625105664 00000100:00100000:3.0:1746143843.366036:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625105664 00000100:00100000:2.0:1746143843.366049:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625105920 00000100:00100000:2.0:1746143843.366053:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625105920 00002000:00100000:3.0:1746143843.366064:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009eb84380 x1830963625105664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.366073:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84380 with x1830963625105664 ext(2097152->4194303) 00002000:00100000:2.0:1746143843.366073:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009eb85180 x1830963625105920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143843.366076:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb84380 00000100:00100000:3.0:1746143843.366090:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7326 00002000:00100000:2.0:1746143843.366095:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85180 with x1830963625105920 ext(3145728->4194303) 00000100:00100000:3.0:1746143843.366096:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625105664:12345-192.168.202.3@tcp:3:cat.0 00002000:00010000:2.0:1746143843.366098:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85180 00000100:00100000:2.0:1746143843.366110:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7327 00000100:00100000:2.0:1746143843.366115:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625105920:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.372757:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.372863:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625106176 00000100:00100000:1.0:1746143843.372874:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625106176 00002000:00100000:1.0:1746143843.372949:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f68e00 x1830963625106176/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.372958:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68e00 with x1830963625106176 ext(4194304->4853759) 00002000:00010000:1.0:1746143843.372963:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f68e00 00000100:00100000:1.0:1746143843.372997:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7328 00000100:00100000:1.0:1746143843.373006:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625106176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.373972:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.374093:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625106432 00000100:00100000:2.0:1746143843.374099:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625106432 00000100:00100000:2.0:1746143843.374143:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14043 00000100:00100000:2.0:1746143843.374150:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b71c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2878:x1830963625106432:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.374166:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.374184:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b5c53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412104 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.374254:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374268:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374279:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374292:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374297:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374302:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374406:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374415:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374421:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143843.374428:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143843.374500:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374505:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374510:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374515:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374522:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b6000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.374526:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374531:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374540:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143843.374542:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.374545:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374549:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374565:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374570:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374574:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374577:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b7a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.374578:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374582:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374586:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b0a500) 00010000:00010000:2.0:1746143843.374588:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.374590:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374594:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b5c61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143843.374622:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b5c53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.374631:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 17 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.374636:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.374638:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143843.374640:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6600, rc 0) 00000100:00100000:2.0:1746143843.374668:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b71c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2878:x1830963625106432:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 519us (697us total) trans 8589945115 rc 0/0 00000100:00100000:2.0:1746143843.374674:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14043 00000100:00100000:3.0:1746143843.383425:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625105920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17296us (17432us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.383437:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7327 00002000:00100000:3.0:1746143843.383450:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009eb85180 x1830963625105920/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.383459:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85180 with x1830963625105920 ext(3145728->4194303) 00002000:00010000:3.0:1746143843.383465:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85180 00000100:00100000:3.0:1746143843.390604:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625105664:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24494us (24687us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143843.390619:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7326 00002000:00100000:3.0:1746143843.390632:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009eb84380 x1830963625105664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.390641:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84380 with x1830963625105664 ext(2097152->4194303) 00002000:00010000:3.0:1746143843.390646:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb84380 00000100:00100000:1.0:1746143843.390852:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625106176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17846us (18105us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143843.390860:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7328 00002000:00100000:1.0:1746143843.390865:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f68e00 x1830963625106176/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.390872:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68e00 with x1830963625106176 ext(4194304->4853759) 00002000:00010000:1.0:1746143843.390875:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f68e00 00000100:00100000:0.0:1746143843.404100:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.404180:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625106688 00000100:00100000:1.0:1746143843.404190:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625106688 00002000:00100000:1.0:1746143843.404240:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f69180 x1830963625106688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.404249:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69180 with x1830963625106688 ext(4194304->4853759) 00002000:00010000:1.0:1746143843.404256:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69180 00000100:00100000:1.0:1746143843.404288:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7329 00000100:00100000:1.0:1746143843.404295:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625106688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143843.413212:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625106688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8903us (9113us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143843.413226:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7329 00002000:00100000:1.0:1746143843.413238:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f69180 x1830963625106688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.413248:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69180 with x1830963625106688 ext(4194304->4853759) 00002000:00010000:1.0:1746143843.413255:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69180 00000100:00100000:0.0:1746143843.420849:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.421076:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625106944 00000100:00100000:2.0:1746143843.421086:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625106944 00000100:00100000:2.0:1746143843.421148:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5453 00000100:00100000:2.0:1746143843.421156:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+268:2873:x1830963625106944:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143843.421956:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+269:2873:x1830963625106944:12345-192.168.202.3@tcp:35:cat.0 Request processed in 795us (1111us total) trans 8589945116 rc 0/0 00000100:00100000:2.0:1746143843.421965:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5453 00000001:00080000:2.0:1746143843.506837:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841277 is committed 00000001:00080000:2.0:1746143843.506854:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841276 is committed 00000001:00080000:2.0:1746143843.506863:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841274 is committed 00000001:00080000:2.0:1746143843.506895:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841258 is committed 00000001:00080000:0.0:1746143843.507394:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874007 is committed 00000001:00080000:0.0:1746143843.507403:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874006 is committed 00000001:00080000:0.0:1746143843.507408:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874005 is committed 00000001:00080000:0.0:1746143843.507441:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873987 is committed 00000100:00100000:1.0:1746143843.507743:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.508426:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625107072 00000100:00100000:0.0:1746143843.508436:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625107072 00000100:00100000:0.0:1746143843.508501:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16817 00000100:00100000:0.0:1746143843.508510:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+23:2875:x1830963625107072:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143843.508529:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.508547:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841210b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.508576:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.508584:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.508589:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.508591:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.508594:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.508625:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.508636:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.508649:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627515392:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143843.508751:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.508759:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 7 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.508766:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627515520:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143843.508785:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.509707:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.509742:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625107200 00000100:00100000:2.0:1746143843.509747:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625107200 00000100:00100000:2.0:1746143843.509779:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16818 00000100:00100000:2.0:1746143843.509786:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2878:x1830963625107200:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.509796:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.509809:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412112 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.509840:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.509847:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.509852:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.509853:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.509855:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1331200->2097151] (req 1331200->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.509874:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 9 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.509883:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 9 pid: 3134 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.509891:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627515648:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.509970:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 24 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.509980:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 24 pid: 13436 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.509988:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627515776:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.510008:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.511798:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.511898:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627515648:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.511978:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627515392:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.511986:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f6a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627515520:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.512013:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2490368->3145727] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.512029:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381200, rc 0) 00000100:00100000:2.0:1746143843.512967:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2875:x1830963625107072:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4453us (5224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.512976:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16817 00000100:00100000:2.0:1746143843.513526:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625107328 00000100:00100000:2.0:1746143843.513534:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625107328 00010000:00010000:2.0:1746143843.513647:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 10 pid: 3134 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.513671:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8220 00000100:00100000:2.0:1746143843.513678:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625107328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.513693:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.513713:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 10 pid: 3134 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746143843.513724:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 10 pid: 3134 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746143843.513746:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b5c45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120ef expref: 10 pid: 3134 timeout: 1002 lvb_type: 1 00010000:00010000:2.0:1746143843.514213:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.514555:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625107328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 875us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.514562:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8220 00000100:00100000:1.0:1746143843.514628:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.514814:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625107456 00000100:00100000:2.0:1746143843.514818:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625107456 00010000:00010000:2.0:1746143843.514832:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.514845:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8221 00000100:00100000:2.0:1746143843.514849:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625107456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.514857:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.514866:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.514875:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.514888:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b5c30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e1 expref: 24 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.514897:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.514937:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625107456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.514943:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8221 00000100:00100000:1.0:1746143843.515168:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627515776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.515194:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1331200->2097151] (req 1331200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 8 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.515204:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6000, rc 0) 00000100:00100000:1.0:1746143843.515220:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2878:x1830963625107200:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5435us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.515227:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16818 00000100:00100000:1.0:1746143843.515406:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.515575:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.515705:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625107712 00000100:00100000:0.0:1746143843.515709:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625107712 00010000:00010000:0.0:1746143843.515723:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 23 pid: 13436 timeout: 1002 lvb_type: 1 00000100:00100000:0.0:1746143843.515747:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625107584 00000100:00100000:0.0:1746143843.515749:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625107584 00010000:00010000:0.0:1746143843.515757:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 8 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.515782:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8222 00000100:00100000:0.0:1746143843.515787:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625107712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.515794:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.515803:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 23 pid: 13436 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.515810:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 23 pid: 13436 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.515821:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b5bdc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b0 expref: 23 pid: 13436 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.515833:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.515835:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.515842:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 8 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.515850:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 8 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.515874:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 8 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.515885:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627515904:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143843.515947:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e78be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.516150:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8223 00000100:00100000:3.0:1746143843.516158:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625107584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.516165:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.516174:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 8 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.516183:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 8 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.516195:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5bd5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a2 expref: 8 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.516207:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.516208:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.516212:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.516219:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.516239:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.516247:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627516032:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143843.516266:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.518028:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627515904:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143843.518046:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.518213:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129c37450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963625107712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2423us (2805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.518222:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8222 00000100:00100000:3.0:1746143843.519903:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627516032:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143843.519946:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.519982:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625107584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3824us (4405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.519991:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8223 00000100:00100000:0.0:1746143843.520833:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.521148:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108096 00000100:00100000:1.0:1746143843.521155:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108096 00002000:00100000:1.0:1746143843.521195:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2490368->2494463) req@ffff880093f69f80 x1830963625108096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.521205:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69f80 with x1830963625108096 ext(2490368->2494463) 00002000:00010000:1.0:1746143843.521209:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f69f80 00000100:00100000:0.0:1746143843.521388:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.521899:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108224 00000100:00100000:1.0:1746143843.521904:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108224 00002000:00100000:1.0:1746143843.521935:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1331200->1335295) req@ffff880093f6b480 x1830963625108224/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.521943:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6b480 with x1830963625108224 ext(1331200->1335295) 00002000:00010000:1.0:1746143843.521947:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6b480 00000100:00100000:1.0:1746143843.521961:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7330 00000100:00100000:1.0:1746143843.521969:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963625108096:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143843.522093:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963625108096:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 125us (1263us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143843.522098:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7330 00002000:00100000:1.0:1746143843.522103:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2490368->2494463) req@ffff880093f69f80 x1830963625108096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.522109:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69f80 with x1830963625108096 ext(2490368->2494463) 00002000:00010000:1.0:1746143843.522112:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f69f80 00000100:00100000:1.0:1746143843.522122:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7331 00000100:00100000:1.0:1746143843.522126:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625108224:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143843.522163:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625108224:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 36us (776us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143843.522167:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7331 00002000:00100000:1.0:1746143843.522170:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1331200->1335295) req@ffff880093f6b480 x1830963625108224/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.522176:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6b480 with x1830963625108224 ext(1331200->1335295) 00002000:00010000:1.0:1746143843.522179:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6b480 00000100:00100000:0.0:1746143843.527197:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627516160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143843.527279:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143843.527434:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627516160 00000100:00100000:2.0:1746143843.527442:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627516160 00000100:00100000:2.0:1746143843.527492:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1746143843.527499:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627516160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746143843.527521:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1168366784 pending 0 free 3910172672 avail 3671678976 00000100:00100000:2.0:1746143843.527558:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627516160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.527564:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:2.0:1746143843.527592:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143843.528015:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627516160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143843.529866:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.529992:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.530310:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108352 00000100:00100000:1.0:1746143843.530328:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108352 00000100:00100000:1.0:1746143843.530376:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108480 00000100:00100000:1.0:1746143843.530378:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108480 00000100:00100000:1.0:1746143843.530396:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16819 00000100:00100000:1.0:1746143843.530403:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:2875:x1830963625108352:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143843.530419:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.530437:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412119 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.530467:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.530476:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.530483:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.530484:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.530488:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.530521:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 7 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.530533:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 7 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.530546:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627516288:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.530626:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.530634:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.530643:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627516416:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.530661:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.530827:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16820 00000100:00100000:3.0:1746143843.530835:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2878:x1830963625108480:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143843.530843:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.530855:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412120 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.530873:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 21 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.530880:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.530886:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.530887:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.530890:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 8 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.530906:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.530935:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746143843.530943:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627516544:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.530980:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 21 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.530988:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 21 pid: 12328 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746143843.530996:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627516672:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.531012:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.534981:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627516288:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.539180:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627516544:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.539193:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627516672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.539222:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 8 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.539241:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8bc00, rc 0) 00000100:00100000:3.0:1746143843.539429:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2878:x1830963625108480:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8594us (9436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.539441:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16820 00000100:00100000:0.0:1746143843.539659:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.539686:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.539706:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108608 00000100:00100000:0.0:1746143843.539712:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108608 00010000:00010000:0.0:1746143843.539788:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 8 pid: 1945 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.539808:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108864 00000100:00100000:0.0:1746143843.539810:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108864 00010000:00010000:0.0:1746143843.539818:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 22 pid: 12328 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.540169:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627516416:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.540189:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.540201:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049000, rc 0) 00000100:00100000:1.0:1746143843.540221:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2875:x1830963625108352:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9819us (10362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.540230:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16819 00000100:00100000:0.0:1746143843.540347:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8224 00000100:00100000:0.0:1746143843.540354:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625108608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.540366:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.540388:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 8 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.540397:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 8 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.540417:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b600/0x87925e4cb73b5c29 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120da expref: 8 pid: 1945 timeout: 1002 lvb_type: 0 00010000:00010000:0.0:1746143843.540431:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.540453:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625108608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.540461:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8224 00000100:00100000:0.0:1746143843.540471:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8225 00000100:00100000:0.0:1746143843.540477:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963625108864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.540485:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.540495:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 22 pid: 12328 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.540502:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 22 pid: 12328 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.540512:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b5bf8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120b7 expref: 22 pid: 12328 timeout: 1002 lvb_type: 1 00010000:00010000:0.0:1746143843.540520:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143843.540529:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963625108864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.540534:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8225 00000100:00100000:3.0:1746143843.540757:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.540792:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.540861:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625108736 00000100:00100000:3.0:1746143843.540865:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625108736 00010000:00010000:3.0:1746143843.540879:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 1002 lvb_type: 1 00000100:00100000:3.0:1746143843.540894:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8226 00000100:00100000:3.0:1746143843.540898:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625108736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.540904:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.540932:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746143843.540942:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746143843.540960:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717a00/0x87925e4cb73b5c3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120f6 expref: 8 pid: 3134 timeout: 1002 lvb_type: 1 00010000:00010000:3.0:1746143843.540976:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.540981:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.540989:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 7 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.540997:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 7 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.541035:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 7 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.541052:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627516800:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143843.541096:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.541291:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625109120 00000100:00100000:3.0:1746143843.541295:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625109120 00000100:00100000:0.0:1746143843.542048:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.542124:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14044 00000100:00100000:3.0:1746143843.542131:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:2883:x1830963625109120:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.542151:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.542165:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b5c92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412127 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.542235:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.542246:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.542254:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.542266:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.542271:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143843.542631:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625109248 00000100:00100000:1.0:1746143843.542636:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625109248 00010000:00010000:1.0:1746143843.542654:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 1002 lvb_type: 1 00000100:00100000:1.0:1746143843.542673:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8227 00000100:00100000:1.0:1746143843.542677:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963625109248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.542685:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.542698:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.542706:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 1002 lvb_type: 1 00010000:00010000:1.0:1746143843.542719:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b5bff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120c5 expref: 25 pid: 9586 timeout: 1002 lvb_type: 1 00000100:00100000:2.0:1746143843.542831:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627516800:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.542845:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143843.543226:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.543330:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73b5ca7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.543340:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73b5ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.543347:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73b5ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143843.543355:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143843.544654:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.544658:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.544668:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.544676:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.544712:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.544725:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627516928:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143843.544883:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544889:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544895:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544900:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544906:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.544909:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544928:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544939:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143843.544942:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.544946:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544954:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b5c99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544967:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544971:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544975:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544978:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e522e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.544980:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544984:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544989:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ea14500) 00010000:00010000:3.0:1746143843.544991:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.544993:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.544996:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e522e00/0x87925e4cb73b5ca0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.545039:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b5c92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412127 expref: 272 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.545050:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73b5ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412127 expref: 271 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.545060:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.545063:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143843.545065:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523200, rc 0) 00000100:00100000:2.0:1746143843.545370:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625108736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4467us (4608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.545381:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8226 00000100:00100000:1.0:1746143843.545448:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.545841:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+271:2883:x1830963625109120:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3709us (5046us total) trans 8589945117 rc 0/0 00000100:00100000:3.0:1746143843.545847:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14044 00000100:00100000:0.0:1746143843.546025:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.546469:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625109504 00000100:00100000:3.0:1746143843.546477:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625109504 00002000:00100000:3.0:1746143843.546515:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1114112->1118207) req@ffff880093f6aa00 x1830963625109504/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.546524:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6aa00 with x1830963625109504 ext(1114112->1118207) 00002000:00010000:3.0:1746143843.546528:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6aa00 00000100:00100000:3.0:1746143843.546542:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7332 00000100:00100000:3.0:1746143843.546547:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963625109504:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143843.546649:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963625109504:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 102us (625us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143843.546654:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7332 00002000:00100000:3.0:1746143843.546658:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1114112->1118207) req@ffff880093f6aa00 x1830963625109504/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.546665:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6aa00 with x1830963625109504 ext(1114112->1118207) 00002000:00010000:3.0:1746143843.546667:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6aa00 00000100:00100000:0.0:1746143843.550288:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.550334:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627516928:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143843.550347:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143843.550355:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.550402:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963625109248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7723us (8354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.550412:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8227 00000100:00100000:1.0:1746143843.550439:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625109632 00000100:00100000:1.0:1746143843.550445:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625109632 00000100:00100000:1.0:1746143843.550489:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1000 00000100:00100000:1.0:1746143843.550495:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+271:2008:x1830963625109632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.550507:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.550531:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e523200/0x87925e4cb73b5ca7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412127 expref: 271 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.550545:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143843.550548:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.550560:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+270:2008:x1830963625109632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.550564:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1000 00000100:00100000:3.0:1746143843.550960:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625109888 00000100:00100000:3.0:1746143843.550966:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625109888 00000100:00100000:3.0:1746143843.550990:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5454 00000100:00100000:3.0:1746143843.550996:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2878:x1830963625109888:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143843.551185:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2878:x1830963625109888:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 188us (836us total) trans 8589945118 rc 0/0 00000100:00100000:3.0:1746143843.551191:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5454 00000100:00100000:0.0:1746143843.551826:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.553438:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625110144 00000100:00100000:2.0:1746143843.553448:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625110144 00002000:00100000:2.0:1746143843.553492:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3461120->3465215) req@ffff8800921cca80 x1830963625110144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.553502:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cca80 with x1830963625110144 ext(3461120->3465215) 00002000:00010000:2.0:1746143843.553507:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cca80 00000100:00100000:2.0:1746143843.553745:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7333 00000100:00100000:2.0:1746143843.553753:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625110144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143843.553903:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625110144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 150us (2078us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143843.553923:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7333 00002000:00100000:2.0:1746143843.553929:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3461120->3465215) req@ffff8800921cca80 x1830963625110144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.553936:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cca80 with x1830963625110144 ext(3461120->3465215) 00002000:00010000:2.0:1746143843.553940:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cca80 00000100:00100000:0.0:1746143843.558539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.558578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.558614:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.558768:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625110400 00000100:00100000:3.0:1746143843.558779:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625110400 00000100:00100000:3.0:1746143843.558825:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5455 00000100:00100000:3.0:1746143843.558833:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+270:2875:x1830963625110400:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143843.559075:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+271:2875:x1830963625110400:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 242us (545us total) trans 8589945119 rc 0/0 00000100:00100000:3.0:1746143843.559082:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5455 00000100:00100000:1.0:1746143843.559266:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625110528 00000100:00100000:1.0:1746143843.559270:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625110528 00000100:00100000:1.0:1746143843.559295:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625110656 00000100:00100000:1.0:1746143843.559298:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625110656 00000100:00100000:1.0:1746143843.559310:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16821 00000100:00100000:1.0:1746143843.559332:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+22:2009:x1830963625110528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.559343:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.559360:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5cb5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841212e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.559410:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627517056:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143843.559469:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.559620:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16822 00000100:00100000:2.0:1746143843.559637:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963625110656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.559644:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.559652:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412135 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.559677:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627517184:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143843.559705:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2840 going to sleep for 11 seconds 00002000:00010000:2.0:1746143843.561711:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143842 -> 1746143843 00002000:00010000:2.0:1746143843.561719:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143842 -> 1746143843 00000100:00100000:2.0:1746143843.561740:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627517184:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.561768:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cbc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412135 expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.561781:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412135 expref: 24 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.561813:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:2.0:1746143843.561857:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963625110656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2228us (3240us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.561864:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16822 00002000:00010000:1.0:1746143843.562052:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143842 -> 1746143843 00000100:00100000:1.0:1746143843.562062:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627517056:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143843.562077:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5cb5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841212e expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.562086:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5cb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841212e expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.562111:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049e00, rc 0) 00000100:00100000:1.0:1746143843.562130:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+21:2009:x1830963625110528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2799us (3551us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143843.562136:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16821 00000100:00100000:2.0:1746143843.572184:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.572359:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625110784 00000100:00100000:1.0:1746143843.572373:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625110784 00000100:00100000:1.0:1746143843.572420:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16823 00000100:00100000:1.0:1746143843.572429:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+21:2883:x1830963625110784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.572451:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.572472:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841213c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.572516:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 6 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.572523:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.572525:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.572528:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.572560:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 6 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.572573:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 6 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.572585:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627517312:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.572672:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.575733:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627517312:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.575767:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.575784:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049800, rc 0) 00000100:00100000:1.0:1746143843.575843:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+22:2883:x1830963625110784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3414us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.575852:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16823 00000100:00100000:0.0:1746143843.576551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.576639:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625110912 00000100:00100000:3.0:1746143843.576647:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625110912 00002000:00100000:3.0:1746143843.576689:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1331200->2097151) req@ffff880091085f80 x1830963625110912/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.576699:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091085f80 with x1830963625110912 ext(1331200->2097151) 00010000:00010000:3.0:1746143843.576705:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 7 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.576718:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 7 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.576724:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091085f80 00000100:00100000:3.0:1746143843.576749:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2698 00000100:00100000:3.0:1746143843.576757:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963625110912:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143843.591844:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625110912:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 15079us (15285us total) trans 21474841278 rc 0/0 00000100:00100000:3.0:1746143843.591857:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2698 00002000:00100000:3.0:1746143843.591868:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1331200->2097151) req@ffff880091085f80 x1830963625110912/t21474841278(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.591876:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091085f80 with x1830963625110912 ext(1331200->2097151) 00010000:00010000:3.0:1746143843.591887:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.591901:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.591908:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091085f80 00000100:00100000:0.0:1746143843.595492:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.595785:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111040 00000100:00100000:2.0:1746143843.595794:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111040 00010000:00010000:2.0:1746143843.595826:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.595862:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8228 00000100:00100000:2.0:1746143843.595868:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625111040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.595880:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.595897:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.595907:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.595949:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6000/0x87925e4cb73b5c7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1331200->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412112 expref: 9 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.595964:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.595966:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.595971:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.595983:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.596009:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.596018:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627517440:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143843.596214:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.598462:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627517440:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.598479:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.598523:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625111040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2653us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.598534:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8228 00000100:00100000:0.0:1746143843.603354:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.603551:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111296 00000100:00100000:3.0:1746143843.603564:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111296 00002000:00100000:3.0:1746143843.603610:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880091085180 x1830963625111296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.603619:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091085180 with x1830963625111296 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.603625:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091085180 00000100:00100000:3.0:1746143843.604549:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7334 00000100:00100000:3.0:1746143843.604851:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963625111296:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.617340:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963625111296:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12771us (13986us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.617354:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7334 00002000:00100000:3.0:1746143843.617367:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880091085180 x1830963625111296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.617377:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091085180 with x1830963625111296 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.617383:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091085180 00000100:00100000:0.0:1746143843.621841:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.623326:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111424 00000100:00100000:1.0:1746143843.623341:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111424 00000100:00100000:1.0:1746143843.623407:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16824 00000100:00100000:1.0:1746143843.623416:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+22:2883:x1830963625111424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143843.623438:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.623458:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412143 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.623491:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 7 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.623499:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.623501:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143843.623505:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.623537:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 7 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.623550:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 7 pid: 9585 timeout: 1002 lvb_type: 0 00000100:00100000:1.0:1746143843.623564:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627517568:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143843.623663:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.624126:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.624150:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.624211:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111552 00000100:00100000:2.0:1746143843.624215:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111552 00000100:00100000:2.0:1746143843.624237:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111680 00000100:00100000:2.0:1746143843.624239:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111680 00000100:00100000:2.0:1746143843.624252:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16825 00000100:00100000:2.0:1746143843.624257:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625111552:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.624264:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.624272:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841214a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.624288:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.624289:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.624297:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.624322:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.624332:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:2.0:1746143843.624485:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625111552:12345-192.168.202.3@tcp:101:cat.0 Request processed in 227us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.624491:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16825 00000100:00100000:3.0:1746143843.624509:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16826 00000100:00100000:3.0:1746143843.624518:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625111680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.624526:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.624535:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d85200/0x87925e4cb73b5cd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412151 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.624567:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627517696:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143843.624595:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.624627:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.624987:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111808 00000100:00100000:3.0:1746143843.624992:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111808 00000100:00100000:3.0:1746143843.625383:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16827 00000100:00100000:3.0:1746143843.625389:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625111808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.625396:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.625404:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b5cdf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412158 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.625430:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627517824:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143843.625467:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.626474:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627517568:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143843.626500:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.626519:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049400, rc 0) 00000100:00100000:1.0:1746143843.626605:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:2883:x1830963625111424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3189us (4776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.626612:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16824 00002000:00010000:3.0:1746143843.627826:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143842 -> 1746143844 00000100:00100000:3.0:1746143843.627848:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627517696:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143843.627873:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d85200/0x87925e4cb73b5cd8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412151 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.627886:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d85200/0x87925e4cb73b5cd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412151 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.627908:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d85200, rc 0) 00000100:00100000:3.0:1746143843.627947:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625111680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3431us (3795us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143843.627953:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16826 00002000:00010000:2.0:1746143843.628144:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143843 -> 1746143844 00000100:00100000:2.0:1746143843.628157:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627517824:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.628172:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b5cdf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412158 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.628181:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52a00/0x87925e4cb73b5cdf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412158 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.628201:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52a00, rc 0) 00000100:00100000:2.0:1746143843.628461:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625111808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3071us (3834us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.628467:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16827 00000100:00100000:0.0:1746143843.628694:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.628756:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625111936 00000100:00100000:3.0:1746143843.628763:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625111936 00002000:00100000:3.0:1746143843.628794:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1118207) req@ffff880091084000 x1830963625111936/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.628803:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091084000 with x1830963625111936 ext(1048576->1118207) 00010000:00010000:3.0:1746143843.628810:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 9 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.628821:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 9 pid: 9585 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.628827:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091084000 00000100:00100000:3.0:1746143843.628981:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2699 00000100:00100000:3.0:1746143843.628988:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625111936:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143843.633638:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625111936:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4639us (4933us total) trans 21474841279 rc 0/0 00000100:00100000:3.0:1746143843.633652:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2699 00002000:00100000:3.0:1746143843.633665:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1118207) req@ffff880091084000 x1830963625111936/t21474841279(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.633675:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091084000 with x1830963625111936 ext(1048576->1118207) 00010000:00010000:3.0:1746143843.633685:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 11 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.633700:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 11 pid: 9585 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.633706:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091084000 00000100:00100000:0.0:1746143843.636042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.636494:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625112064 00000100:00100000:2.0:1746143843.636505:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625112064 00010000:00010000:2.0:1746143843.636545:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 11 pid: 9585 timeout: 1002 lvb_type: 0 00000100:00100000:0.0:1746143843.636565:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.636738:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.637125:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625112320 00000100:00100000:3.0:1746143843.637129:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625112320 00000100:00100000:2.0:1746143843.637287:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625112576 00000100:00100000:2.0:1746143843.637291:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625112576 00002000:00100000:2.0:1746143843.637328:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094197b80 x1830963625112576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.637337:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963625112576 ext(1048576->2097151) 00002000:00010000:2.0:1746143843.637341:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:2.0:1746143843.637364:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7335 00000100:00100000:2.0:1746143843.637372:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625112576:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143843.637556:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880091087100 x1830963625112320/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.637564:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091087100 with x1830963625112320 ext(0->1048575) 00002000:00010000:3.0:1746143843.637567:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091087100 00000100:00100000:3.0:1746143843.637595:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7336 00000100:00100000:3.0:1746143843.637601:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625112320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143843.637863:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8229 00000100:00100000:1.0:1746143843.637872:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625112064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.637885:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.637906:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.637935:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.637961:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb8bc00/0x87925e4cb73b5c8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412120 expref: 13 pid: 9585 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.637988:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.637990:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.637999:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.638008:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.638055:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.638073:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627517952:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143843.640058:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.647715:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627517952:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143843.647741:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.647808:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091085500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625112064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9935us (11773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.647821:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8229 00000100:00100000:1.0:1746143843.653107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.653272:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625112832 00000100:00100000:3.0:1746143843.653282:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625112832 00000100:00100000:2.0:1746143843.653331:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625112576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15958us (16590us total) trans 0 rc 1048576/1048576 00002000:00100000:3.0:1746143843.653336:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009eb84700 x1830963625112832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143843.653341:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7335 00002000:00100000:3.0:1746143843.653346:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84700 with x1830963625112832 ext(1048576->2097151) 00002000:00100000:2.0:1746143843.653347:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094197b80 x1830963625112576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143843.653352:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb84700 00002000:00100000:2.0:1746143843.653353:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963625112576 ext(1048576->2097151) 00002000:00010000:2.0:1746143843.653355:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:3.0:1746143843.653380:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7337 00000100:00100000:3.0:1746143843.653387:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625112832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143843.653949:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091087100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625112320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16347us (17382us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143843.653956:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7336 00002000:00100000:2.0:1746143843.653961:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880091087100 x1830963625112320/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.653968:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091087100 with x1830963625112320 ext(0->1048575) 00002000:00010000:2.0:1746143843.653971:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091087100 00000100:00100000:3.0:1746143843.664536:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625112832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11137us (11429us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.664550:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7337 00002000:00100000:3.0:1746143843.664563:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009eb84700 x1830963625112832/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.664573:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84700 with x1830963625112832 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.664579:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb84700 00000100:00100000:0.0:1746143843.671335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.671425:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625112960 00000100:00100000:3.0:1746143843.671435:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625112960 00000100:00100000:3.0:1746143843.671492:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16828 00000100:00100000:3.0:1746143843.671501:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2888:x1830963625112960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.671521:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.671541:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841215f expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.671568:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.671570:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143843.671579:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.671596:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.671607:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52c00, rc 0) 00000100:00100000:3.0:1746143843.671674:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2888:x1830963625112960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 174us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.671681:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16828 00000100:00100000:0.0:1746143843.685360:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.688157:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625113216 00000100:00100000:3.0:1746143843.688172:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625113216 00002000:00100000:3.0:1746143843.688227:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094196a00 x1830963625113216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.688238:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196a00 with x1830963625113216 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.688244:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196a00 00000100:00100000:3.0:1746143843.688278:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7338 00000100:00100000:3.0:1746143843.688286:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625113216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143843.692381:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.692421:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.692495:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625113472 00000100:00100000:2.0:1746143843.692506:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625113472 00000100:00100000:1.0:1746143843.692514:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143843.692554:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009eb84e00 x1830963625113472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.692564:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84e00 with x1830963625113472 ext(1048576->2097151) 00002000:00010000:2.0:1746143843.692569:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb84e00 00000100:00100000:2.0:1746143843.692948:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625113856 00000100:00100000:2.0:1746143843.692951:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625113856 00002000:00100000:2.0:1746143843.692965:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009eb85c00 x1830963625113856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 504/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143843.692972:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85c00 with x1830963625113856 ext(2097152->4194303) 00002000:00010000:2.0:1746143843.692976:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85c00 00000100:00100000:3.0:1746143843.692990:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625113984 00000100:00100000:2.0:1746143843.692994:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7339 00000100:00100000:3.0:1746143843.692995:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625113984 00000100:00100000:2.0:1746143843.693000:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625113472:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143843.693016:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009b54c850 x1830963625113984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 504/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.693024:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b54c850 with x1830963625113984 ext(2097152->4194303) 00002000:00010000:3.0:1746143843.693028:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b54c850 00000100:00100000:3.0:1746143843.693049:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7340 00000100:00100000:3.0:1746143843.693055:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625113856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.694485:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7341 00000100:00100000:0.0:1746143843.694496:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625113984:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.701888:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625113216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13590us (16527us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.701901:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7338 00002000:00100000:3.0:1746143843.701943:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094196a00 x1830963625113216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.701953:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196a00 with x1830963625113216 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.701959:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196a00 00000100:00100000:3.0:1746143843.711128:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625113472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18113us (18742us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.711142:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7339 00002000:00100000:3.0:1746143843.711154:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009eb84e00 x1830963625113472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.711163:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84e00 with x1830963625113472 ext(1048576->2097151) 00002000:00010000:3.0:1746143843.711169:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb84e00 00000100:00100000:3.0:1746143843.718972:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625113856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25904us (26536us total) trans 0 rc 1777664/1777664 00000100:00100000:3.0:1746143843.718986:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7340 00002000:00100000:3.0:1746143843.718999:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009eb85c00 x1830963625113856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 504/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1777664/1777664 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.719008:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85c00 with x1830963625113856 ext(2097152->4194303) 00002000:00010000:3.0:1746143843.719014:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85c00 00000100:00100000:0.0:1746143843.722115:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.722602:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625114112 00000100:00100000:2.0:1746143843.722614:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625114112 00000100:00100000:2.0:1746143843.722676:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16829 00000100:00100000:2.0:1746143843.722684:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625114112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.722699:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.722714:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73b5ced lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412166 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.722759:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627518080:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143843.722846:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.724900:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625113984:12345-192.168.202.3@tcp:3:cat.0 Request processed in 30397us (32376us total) trans 0 rc 1441792/1441792 00000100:00100000:1.0:1746143843.724924:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7341 00002000:00100000:1.0:1746143843.724936:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009b54c850 x1830963625113984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 504/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1441792/1441792 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.724945:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b54c850 with x1830963625113984 ext(2097152->4194303) 00002000:00010000:1.0:1746143843.724951:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b54c850 00000100:00100000:0.0:1746143843.727121:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.727199:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625114240 00000100:00100000:3.0:1746143843.727209:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625114240 00000100:00100000:3.0:1746143843.727255:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16830 00000100:00100000:3.0:1746143843.727261:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2010:x1830963625114240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143843.727279:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.727297:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b5cf4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841216d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.727366:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627518208:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143843.727433:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.728563:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627518208:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143843.728587:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b5cf4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841216d expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.728598:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52600/0x87925e4cb73b5cf4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841216d expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143843.728612:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52600, rc 0) 00000100:00100000:3.0:1746143843.728637:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2010:x1830963625114240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1376us (1525us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143843.728643:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16830 00000100:00100000:2.0:1746143843.728776:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627518080:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.728797:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73b5ced lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412166 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.728805:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25000/0x87925e4cb73b5ced lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412166 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.728816:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25000, rc 0) 00000100:00100000:2.0:1746143843.728834:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625114112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6151us (6731us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.728838:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16829 00000100:00100000:0.0:1746143843.732831:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.733155:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625114368 00000100:00100000:2.0:1746143843.733165:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625114368 00000100:00100000:2.0:1746143843.733229:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16831 00000100:00100000:2.0:1746143843.733238:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2888:x1830963625114368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.733259:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.733278:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412174 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.733324:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.733332:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.733334:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.733338:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 8 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.733371:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.733385:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 23 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.733398:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627518336:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.733487:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.741588:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627518336:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.741623:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 8 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.741642:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82400, rc 0) 00000100:00100000:2.0:1746143843.741692:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2888:x1830963625114368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8455us (8873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.741701:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16831 00000100:00100000:2.0:1746143843.743310:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.743374:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625114624 00000100:00100000:1.0:1746143843.743387:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625114624 00002000:00100000:1.0:1746143843.743439:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880091d4f480 x1830963625114624/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.743450:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f480 with x1830963625114624 ext(4194304->4853759) 00010000:00010000:1.0:1746143843.743459:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 24 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.743473:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 24 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:1.0:1746143843.743480:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4f480 00000100:00100000:1.0:1746143843.743514:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2700 00000100:00100000:1.0:1746143843.743522:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625114624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.744456:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.744503:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625114752 00000100:00100000:3.0:1746143843.744509:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625114752 00002000:00100000:3.0:1746143843.744533:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3465215) req@ffff880094195500 x1830963625114752/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.744541:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963625114752 ext(3145728->3465215) 00010000:00010000:3.0:1746143843.744547:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.744558:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.744564:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195500 00000100:00100000:3.0:1746143843.744595:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2701 00000100:00100000:3.0:1746143843.744602:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625114752:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143843.748241:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625114624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4707us (4924us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143843.748255:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2700 00002000:00100000:1.0:1746143843.748269:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880091d4f480 x1830963625114624/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.748278:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4f480 with x1830963625114624 ext(4194304->4853759) 00010000:00010000:1.0:1746143843.748289:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:1.0:1746143843.748304:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:1.0:1746143843.748323:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091d4f480 00000100:00100000:3.0:1746143843.750271:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625114752:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5661us (5809us total) trans 17179874008 rc 0/0 00000100:00100000:3.0:1746143843.750282:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2701 00002000:00100000:3.0:1746143843.750291:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3465215) req@ffff880094195500 x1830963625114752/t17179874008(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.750300:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094195500 with x1830963625114752 ext(3145728->3465215) 00010000:00010000:3.0:1746143843.750308:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:3.0:1746143843.750332:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00002000:00010000:3.0:1746143843.750338:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094195500 00000100:00100000:0.0:1746143843.752670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.752762:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625114880 00000100:00100000:2.0:1746143843.752772:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625114880 00000100:00100000:2.0:1746143843.752824:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16832 00000100:00100000:2.0:1746143843.752831:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625114880:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.752848:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.752863:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b5d02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841217b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.752940:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627518464:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143843.753013:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.755721:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.755787:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115008 00000100:00100000:3.0:1746143843.755797:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115008 00000100:00100000:3.0:1746143843.755859:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14045 00000100:00100000:3.0:1746143843.755868:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2890:x1830963625115008:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143843.755892:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.755954:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412182 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.756022:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756035:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756046:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756063:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756068:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756073:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756145:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756154:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756159:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143843.756195:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143843.756199:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143843.756214:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756222:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756230:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756235:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756240:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756248:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756253:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.756256:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756262:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756271:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143843.756273:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.756277:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756281:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756302:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756306:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756311:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756329:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.756331:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756336:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756346:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b11700) 00010000:00010000:3.0:1746143843.756348:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143843.756350:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756354:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.756384:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.756396:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.756401:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.756403:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143843.756405:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849e00, rc 0) 00000100:00100000:3.0:1746143843.756468:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2890:x1830963625115008:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 601us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.756475:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14045 00000100:00100000:0.0:1746143843.756765:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.757006:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627518464:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.757033:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b5d02 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841217b expref: 27 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.757047:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b5d02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841217b expref: 27 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.757059:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107c00, rc 0) 00000100:00100000:2.0:1746143843.757083:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625114880:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4252us (4423us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.757090:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16832 00000100:00100000:2.0:1746143843.757183:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115136 00000100:00100000:2.0:1746143843.757187:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115136 00010000:00010000:2.0:1746143843.757212:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00000100:00100000:2.0:1746143843.757229:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8230 00000100:00100000:2.0:1746143843.757235:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625115136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.757246:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.757255:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.757265:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.757280:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082049000/0x87925e4cb73b5c84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412119 expref: 26 pid: 13436 timeout: 1002 lvb_type: 0 00010000:00010000:2.0:1746143843.757294:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.757296:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.757303:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.757321:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.757349:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 7 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.757361:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627518592:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143843.757410:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.759895:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627518592:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.759946:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.760427:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625115136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3189us (3661us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.760440:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8230 00000100:00100000:2.0:1746143843.762270:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.762386:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625116160 00000100:00100000:3.0:1746143843.762396:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625116160 00002000:00100000:3.0:1746143843.762458:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880091d4ea00 x1830963625116160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.762467:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ea00 with x1830963625116160 ext(2097152->3145727) 00002000:00010000:3.0:1746143843.762472:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4ea00 00000100:00100000:0.0:1746143843.762523:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.762580:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7342 00000100:00100000:2.0:1746143843.762581:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625116288 00000100:00100000:2.0:1746143843.762584:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625116288 00000100:00100000:3.0:1746143843.762588:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625116160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143843.762608:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16833 00000100:00100000:2.0:1746143843.762613:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2883:x1830963625116288:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.762624:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.762642:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121b3 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.762665:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.762667:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.762876:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143843.762892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143843.762893:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.762904:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133566200, rc 0) 00000100:00100000:1.0:1746143843.762907:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.762938:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.762960:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115264 00000100:00100000:1.0:1746143843.762961:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.762963:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115264 00000100:00100000:1.0:1746143843.762980:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.762991:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115520 00000100:00100000:2.0:1746143843.762993:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115520 00000100:00100000:1.0:1746143843.762999:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115776 00000100:00100000:1.0:1746143843.763002:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115776 00000100:00100000:2.0:1746143843.763006:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115392 00000100:00100000:2.0:1746143843.763007:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115392 00000100:00100000:1.0:1746143843.763019:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115648 00000100:00100000:1.0:1746143843.763021:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115648 00000100:00100000:2.0:1746143843.763024:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16834 00000100:00100000:2.0:1746143843.763029:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115264:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143843.763035:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143843.763035:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16835 00000100:00100000:1.0:1746143843.763040:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625115520:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143843.763043:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412189 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.763047:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143843.763057:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412197 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.763062:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.763064:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.763069:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.763069:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.763070:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.763075:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.763078:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.763085:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.763090:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee77000, rc 0) 00010000:00010000:1.0:1746143843.763092:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048800, rc 0) 00000100:00100000:2.0:1746143843.763115:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625115264:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.763115:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115520:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.763120:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16835 00000100:00100000:2.0:1746143843.763123:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16834 00000100:00100000:2.0:1746143843.763135:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16836 00000100:00100000:2.0:1746143843.763139:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115776:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:1.0:1746143843.763172:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16837 00000100:00100000:1.0:1746143843.763178:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625115392:12345-192.168.202.3@tcp:101:mirror_io.0 00000100:00100000:0.0:1746143843.763180:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16838 00010000:00010000:1.0:1746143843.763183:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143843.763187:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115648:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143843.763190:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412190 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.763194:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.763200:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841219e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143843.763204:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.763205:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143843.763209:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.763209:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.763210:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.763215:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.763217:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 9 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143843.763223:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049e00, rc 0) 00010000:00010000:0.0:1746143843.763225:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.763231:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c800, rc 0) 00000100:00100000:1.0:1746143843.763238:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115392:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 60us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.763243:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16837 00000100:00100000:0.0:1746143843.763246:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625115648:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 60us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143843.763251:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16838 00000100:00100000:1.0:1746143843.763279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.763293:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625115904 00000100:00100000:0.0:1746143843.763295:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625115904 00000100:00100000:0.0:1746143843.763328:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16839 00000100:00100000:0.0:1746143843.763332:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115904:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143843.763339:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.763345:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b5d48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121ac expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.763382:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094196300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627518720:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.763460:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.763466:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121a5 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.763474:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.763476:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.763479:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.763487:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.763493:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76400, rc 0) 00000100:00100000:0.0:1746143843.763540:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.763616:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625115776:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 477us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.763621:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16836 00000100:00100000:2.0:1746143843.763635:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2883:x1830963625116288:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1023us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.763639:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16833 00000100:00100000:3.0:1746143843.769292:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625116160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6694us (7017us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143843.769310:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7342 00002000:00100000:3.0:1746143843.769333:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880091d4ea00 x1830963625116160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.769343:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ea00 with x1830963625116160 ext(2097152->3145727) 00002000:00010000:3.0:1746143843.769349:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091d4ea00 00000100:00100000:0.0:1746143843.771608:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.771721:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094196300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627518720:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143843.771755:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b5d48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ac expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.771769:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b5d48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ac expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.771780:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c600, rc 0) 00000100:00100000:2.0:1746143843.771827:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625115904:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 8493us (8546us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143843.771836:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16839 00000100:00100000:3.0:1746143843.772192:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625116544 00000100:00100000:3.0:1746143843.772200:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625116544 00002000:00100000:3.0:1746143843.772236:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880094194000 x1830963625116544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.772245:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194000 with x1830963625116544 ext(4849664->4853759) 00002000:00010000:3.0:1746143843.772250:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194000 00000100:00100000:3.0:1746143843.772272:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7343 00000100:00100000:3.0:1746143843.772592:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625116544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.772710:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625116544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 433us (1112us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143843.772716:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7343 00002000:00100000:3.0:1746143843.772720:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880094194000 x1830963625116544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.772727:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194000 with x1830963625116544 ext(4849664->4853759) 00002000:00010000:3.0:1746143843.772730:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094194000 00000100:00100000:0.0:1746143843.775606:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.775687:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625116800 00000100:00100000:3.0:1746143843.775697:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625116800 00000100:00100000:3.0:1746143843.776079:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14046 00000100:00100000:3.0:1746143843.776087:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2892:x1830963625116800:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143843.776110:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.776128:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121ba expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.776358:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.776404:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625117184 00000100:00100000:2.0:1746143843.776408:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625117184 00000100:00100000:2.0:1746143843.776505:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14047 00000100:00100000:2.0:1746143843.776511:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2890:x1830963625117184:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143843.776519:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.776526:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73b5d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121c8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776589:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.776603:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 270 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776610:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776620:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776626:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.776657:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776668:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 12 pid: 6587 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.776679:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627518848:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.776759:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776767:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 19 pid: 6587 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.776775:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627518976:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.776799:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 270 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.776807:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 270 pid: 7244 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.776814:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627519104:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.776830:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746143843.777162:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.777212:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.777219:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:1.0:1746143843.777283:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.777534:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625116928 00000100:00100000:2.0:1746143843.777538:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625116928 00000100:00100000:2.0:1746143843.778037:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16840 00000100:00100000:2.0:1746143843.778045:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2888:x1830963625116928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143843.778057:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.778069:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121c1 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.778089:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.778095:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.778097:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143843.778099:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.778118:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.778127:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 22 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.778135:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627519232:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.778782:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.785119:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.785208:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.785291:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625117440 00000100:00100000:2.0:1746143843.785302:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625117440 00000100:00100000:2.0:1746143843.785361:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5456 00000100:00100000:2.0:1746143843.785369:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:2883:x1830963625117440:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143843.785600:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:2883:x1830963625117440:12345-192.168.202.3@tcp:35:cat.0 Request processed in 231us (491us total) trans 8589945120 rc 0/0 00000100:00100000:2.0:1746143843.785607:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5456 00000100:00100000:2.0:1746143843.785633:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625117696 00000100:00100000:2.0:1746143843.785636:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625117696 00010000:00010000:2.0:1746143843.785654:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 272 pid: 7244 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.785675:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8231 00000100:00100000:2.0:1746143843.785680:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+272:2010:x1830963625117696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.785689:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.785695:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 272 pid: 7244 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.785705:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 272 pid: 7244 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.785730:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.785734:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.785743:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.785749:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.785764:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+272:2010:x1830963625117696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.785771:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8231 00000100:00100000:3.0:1746143843.785894:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627518848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143843.785904:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627518976:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.785939:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2800/0x87925e4cb73b5bce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841209b expref: 271 pid: 7244 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143843.785955:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627519104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.785978:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143843.786293:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.786307:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.786360:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.786651:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625117952 00000100:00100000:3.0:1746143843.786655:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625117952 00002000:00100000:3.0:1746143843.786688:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2490368->3145727) req@ffff880095c33800 x1830963625117952/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.786703:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963625117952 ext(2490368->3145727) 00010000:00010000:3.0:1746143843.786711:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 23 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.786720:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 23 pid: 3135 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143843.786726:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c33800 00000100:00100000:3.0:1746143843.786752:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2702 00000100:00100000:3.0:1746143843.786757:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625117952:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143843.786992:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627519232:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143843.787008:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.787021:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c600, rc 0) 00000100:00100000:2.0:1746143843.787138:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625117824 00000100:00100000:2.0:1746143843.787142:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625117824 00010000:00010000:2.0:1746143843.787158:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 20 pid: 6587 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143843.787384:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2888:x1830963625116928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9338us (10100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.787391:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16840 00000100:00100000:2.0:1746143843.787442:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625117568 00000100:00100000:2.0:1746143843.787445:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625117568 00010000:00010000:2.0:1746143843.787458:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 13 pid: 6587 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.787471:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8232 00000100:00100000:2.0:1746143843.787476:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625117824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.787485:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.787489:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 20 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.787498:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 20 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.787514:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b5c68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412104 expref: 20 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.787524:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.787528:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.787535:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.787540:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.787561:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625117824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.787562:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8233 00000100:00100000:2.0:1746143843.787566:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8232 00000100:00100000:1.0:1746143843.787569:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625117568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.787576:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.787581:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 13 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143843.787588:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 13 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143843.787600:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d1e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412182 expref: 13 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143843.787617:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143843.787620:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143843.787627:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143843.787633:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143843.787640:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143843.787644:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143843.787649:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143843.787674:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.787689:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625117568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.787694:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8233 00010000:00010000:3.0:1746143843.787848:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.787855:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143843.787874:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143843.788004:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73b5d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c8 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.788016:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c8 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.788021:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.788023:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143843.788024:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad34000, rc 0) 00000100:00100000:3.0:1746143843.788043:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2890:x1830963625117184:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 11533us (11686us total) trans 8589945121 rc 0/0 00000100:00100000:3.0:1746143843.788049:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14047 00010000:00010000:3.0:1746143843.788069:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143843.788074:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143843.788084:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143843.788123:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b5d56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 20 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.788132:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 19 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.788137:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.788138:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143843.788140:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848000, rc 0) 00000100:00100000:3.0:1746143843.788155:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2892:x1830963625116800:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12069us (12558us total) trans 8589945122 rc 0/0 00000100:00100000:3.0:1746143843.788163:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14046 00000100:00100000:1.0:1746143843.798858:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.799092:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.799176:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625118208 00000100:00100000:2.0:1746143843.799186:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625118208 00000100:00100000:2.0:1746143843.799233:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625118464 00000100:00100000:2.0:1746143843.799236:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625118464 00000100:00100000:2.0:1746143843.799261:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14048 00000100:00100000:2.0:1746143843.799270:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2890:x1830963625118208:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143843.799295:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.799298:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143843.799353:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad34000/0x87925e4cb73b5d64 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c8 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.799369:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.799372:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143843.799384:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b5d87 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121cf expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.799401:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14049 00000100:00100000:3.0:1746143843.799409:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:2894:x1830963625118464:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143843.799417:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143843.799426:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121d6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.799463:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.799475:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.799477:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.799485:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.799489:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.799495:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 4/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.799496:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.799501:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143843.799505:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.799529:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 18 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.799540:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 18 pid: 6587 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.799552:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627519360:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.799637:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143843.802681:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625117952:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15912us (16309us total) trans 21474841280 rc 0/0 00000100:00100000:3.0:1746143843.802695:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2702 00002000:00100000:3.0:1746143843.802708:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2490368->3145727) req@ffff880095c33800 x1830963625117952/t21474841280(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/448 e 0 to 0 dl 1746143854 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.802724:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c33800 with x1830963625117952 ext(2490368->3145727) 00010000:00010000:3.0:1746143843.802736:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 25 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.802748:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 25 pid: 3135 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143843.802753:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c33800 00000100:00100000:0.0:1746143843.803325:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.803411:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627519360:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.803436:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143843.803511:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625118592 00000100:00100000:1.0:1746143843.803519:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625118592 00010000:00010000:1.0:1746143843.803546:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 19 pid: 6587 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143843.803568:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8234 00000100:00100000:1.0:1746143843.803574:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625118592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143843.803588:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143843.803593:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 19 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143843.803602:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 19 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143843.803622:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5d6b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121ba expref: 19 pid: 6587 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143843.803648:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143843.803653:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143843.803662:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143843.803669:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143843.803691:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143843.803710:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625118592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 137us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143843.803716:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8234 00010000:00010000:3.0:1746143843.804404:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.804412:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805056:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805063:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805068:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805074:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143843.805078:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805084:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805097:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143843.805100:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143843.805103:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805106:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5d9c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143843.805151:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b5d87 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121cf expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.805158:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d600/0x87925e4cb73b5d87 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121cf expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143843.805165:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00010000:00010000:2.0:1746143843.805378:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805390:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805398:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143843.805410:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143843.805522:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805527:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805531:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805539:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805543:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.805546:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805550:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805558:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143843.805559:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.805562:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805566:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5d95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805576:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805580:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805584:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805588:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880124578200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143843.805590:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805594:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805603:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092b11100) 00010000:00010000:2.0:1746143843.805604:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143843.805606:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805610:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880124578200/0x87925e4cb73b5da3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143843.805646:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5d8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143843.805750:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2890:x1830963625118208:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 6481us (6903us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143843.805758:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14048 00010000:00010000:2.0:1746143843.806257:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 273 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.806264:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143843.806266:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143843.806268:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d800, rc 0) 00000100:00100000:2.0:1746143843.806471:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:2894:x1830963625118464:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7062us (7378us total) trans 8589945123 rc 0/0 00000100:00100000:2.0:1746143843.806476:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14049 00000100:00100000:2.0:1746143843.808179:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.808525:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625118848 00000100:00100000:0.0:1746143843.808534:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625118848 00000100:00100000:0.0:1746143843.808574:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5457 00000100:00100000:0.0:1746143843.808581:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2890:x1830963625118848:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:0.0:1746143843.810439:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2890:x1830963625118848:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 1848us (2254us total) trans 8589945124 rc 0/0 00000100:00100000:0.0:1746143843.810450:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5457 00000100:00100000:0.0:1746143843.810587:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.810614:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625118976 00000100:00100000:0.0:1746143843.810620:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625118976 00010000:00010000:0.0:1746143843.810647:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 25 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143843.810678:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8235 00000100:00100000:0.0:1746143843.810684:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625118976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.810695:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.810714:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 25 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143843.810725:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 25 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143843.810752:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091381200/0x87925e4cb73b5c76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2490368->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841210b expref: 25 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143843.810771:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.810773:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.810781:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.810788:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.810819:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.810832:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627519488:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143843.810901:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.820360:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627519488:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.820390:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.820478:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625118976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9790us (9886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.820686:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8235 00000100:00100000:0.0:1746143843.828687:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.828768:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625119360 00000100:00100000:3.0:1746143843.828781:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625119360 00002000:00100000:3.0:1746143843.828834:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c31180 x1830963625119360/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.828845:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31180 with x1830963625119360 ext(2097152->4194303) 00002000:00010000:3.0:1746143843.828851:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31180 00000100:00100000:3.0:1746143843.828891:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7344 00000100:00100000:3.0:1746143843.828900:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625119360:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.835334:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.838581:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625119488 00000100:00100000:1.0:1746143843.838593:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625119488 00002000:00100000:1.0:1746143843.838632:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095c30a80 x1830963625119488/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.838639:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963625119488 ext(3145728->4194303) 00002000:00010000:1.0:1746143843.838646:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c30a80 00000100:00100000:1.0:1746143843.838679:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7345 00000100:00100000:1.0:1746143843.838686:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625119488:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.845806:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625119360:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16895us (17113us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143843.845818:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7344 00002000:00100000:3.0:1746143843.845832:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c31180 x1830963625119360/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.845842:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c31180 with x1830963625119360 ext(2097152->4194303) 00002000:00010000:3.0:1746143843.845847:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c31180 00000100:00100000:1.0:1746143843.860577:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625119488:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21882us (25240us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143843.860589:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7345 00002000:00100000:1.0:1746143843.860599:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095c30a80 x1830963625119488/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.860608:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30a80 with x1830963625119488 ext(3145728->4194303) 00002000:00010000:1.0:1746143843.860613:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c30a80 00000100:00100000:0.0:1746143843.867521:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.867663:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625119744 00000100:00100000:1.0:1746143843.867673:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625119744 00002000:00100000:1.0:1746143843.867722:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095c32a00 x1830963625119744/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.867732:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32a00 with x1830963625119744 ext(4194304->4853759) 00002000:00010000:1.0:1746143843.867738:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32a00 00000100:00100000:1.0:1746143843.869749:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7346 00000100:00100000:1.0:1746143843.869767:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625119744:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143843.870247:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.870363:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625119872 00000100:00100000:2.0:1746143843.870371:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625119872 00000100:00100000:2.0:1746143843.870420:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16841 00000100:00100000:2.0:1746143843.870427:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2892:x1830963625119872:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.870439:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.870459:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121dd expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.870485:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.870493:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.870500:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.870506:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.870509:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.870512:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [405504->1048575] (req 405504->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.870541:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.870552:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 11 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.870564:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627519616:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.870838:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.870846:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 9 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.870854:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627519744:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.870882:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 25 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.870889:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 25 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.870896:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627519872:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.870928:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143843.881968:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625119744:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12197us (14446us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143843.881981:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7346 00002000:00100000:1.0:1746143843.881992:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095c32a00 x1830963625119744/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/440 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.882001:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32a00 with x1830963625119744 ext(4194304->4853759) 00002000:00010000:1.0:1746143843.882009:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c32a00 00000100:00100000:0.0:1746143843.885289:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.885335:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627519616:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.885346:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627519744:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.885353:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627519872:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.885384:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [405504->1048575] (req 405504->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.885405:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c400, rc 0) 00000100:00100000:2.0:1746143843.885471:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2892:x1830963625119872:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 15043us (15223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.885483:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16841 00000100:00100000:0.0:1746143843.886045:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.886074:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.886112:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120128 00000100:00100000:1.0:1746143843.886122:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120128 00000100:00100000:2.0:1746143843.886144:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120000 00000100:00100000:2.0:1746143843.886149:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120000 00010000:00010000:1.0:1746143843.886158:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 10 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.886168:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 9 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746143843.886198:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120256 00000100:00100000:1.0:1746143843.886201:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120256 00010000:00010000:1.0:1746143843.886212:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.887237:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8236 00000100:00100000:2.0:1746143843.887247:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625120128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.887264:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.887286:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 10 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887297:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 10 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887330:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ee77000/0x87925e4cb73b5d2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412189 expref: 10 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887354:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.887396:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625120128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 152us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.887403:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8236 00000100:00100000:2.0:1746143843.887420:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8237 00000100:00100000:2.0:1746143843.887425:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625120000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.887432:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.887439:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 9 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887449:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 9 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887459:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408ee00/0x87925e4cb73b5c37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120e8 expref: 9 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887467:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.887479:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625120000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.887484:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8237 00000100:00100000:2.0:1746143843.887496:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8238 00000100:00100000:2.0:1746143843.887500:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625120256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.887507:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.887513:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887520:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887531:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b5bf1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120a9 expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.887540:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.887542:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.887549:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 7 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.887557:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 7 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.889504:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 7 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.889520:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627520000:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143843.889597:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.889895:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.889984:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120384 00000100:00100000:0.0:1746143843.889992:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120384 00000100:00100000:0.0:1746143843.890061:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16842 00000100:00100000:0.0:1746143843.890070:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963625120384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143843.890087:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143843.890104:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b5dbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121e4 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.890151:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627520128:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143843.890224:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00002000:00010000:0.0:1746143843.895564:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime: 1746143843 -> 1746143844 00002000:00010000:0.0:1746143843.895572:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143842 -> 1746143844 00002000:00010000:0.0:1746143843.895574:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime: 1746143843 -> 1746143844 00000100:00100000:0.0:1746143843.895600:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627520128:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143843.895637:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b5dbf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121e4 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.895655:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b5dbf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121e4 expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143843.895682:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107c00, rc 0) 00000100:00100000:0.0:1746143843.895743:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963625120384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5671us (5845us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143843.895754:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16842 00000100:00100000:2.0:1746143843.896748:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627520000:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.896766:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.896796:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625120256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9293us (10719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.896806:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8238 00000100:00100000:3.0:1746143843.897024:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143843.897151:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120640 00000100:00100000:1.0:1746143843.897160:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120640 00002000:00100000:1.0:1746143843.897205:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (405504->409599) req@ffff88007f648a80 x1830963625120640/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.897215:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648a80 with x1830963625120640 ext(405504->409599) 00002000:00010000:1.0:1746143843.897220:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648a80 00000100:00100000:1.0:1746143843.897989:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7347 00000100:00100000:1.0:1746143843.897998:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963625120640:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143843.898126:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963625120640:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 129us (1105us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143843.898132:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7347 00002000:00100000:1.0:1746143843.898137:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (405504->409599) req@ffff88007f648a80 x1830963625120640/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.898144:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648a80 with x1830963625120640 ext(405504->409599) 00002000:00010000:1.0:1746143843.898147:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648a80 00000100:00100000:0.0:1746143843.912707:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.912825:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120768 00000100:00100000:2.0:1746143843.912836:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120768 00000100:00100000:2.0:1746143843.912896:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16843 00000100:00100000:2.0:1746143843.912905:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2892:x1830963625120768:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.912980:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.913003:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121eb expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.913040:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.913054:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.913061:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.913068:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.913070:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.913074:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1048576->1081343] (req 1048576->1081343) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.913112:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.913125:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.913138:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520256:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.913270:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.913281:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 8 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.913290:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520384:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.913339:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.913349:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 23 pid: 13436 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.913358:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520512:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.913387:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.916614:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.916658:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.916744:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625120896 00000100:00100000:3.0:1746143843.916753:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625120896 00010000:00010000:3.0:1746143843.916880:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 9 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143843.916945:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625121024 00000100:00100000:3.0:1746143843.916948:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625121024 00010000:00010000:3.0:1746143843.916961:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143843.916979:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8239 00000100:00100000:3.0:1746143843.916986:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625120896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.916999:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.917020:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 9 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.917031:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 9 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.917054:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.917091:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625120896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.917101:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8239 00000100:00100000:3.0:1746143843.917117:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8240 00000100:00100000:3.0:1746143843.917122:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963625121024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.917128:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.917133:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.917142:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.917152:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.917166:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963625121024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 44us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.917171:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8240 00000100:00100000:2.0:1746143843.919248:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520256:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.919264:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049e00/0x87925e4cb73b5d3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412190 expref: 8 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.919846:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520384:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.919861:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049800/0x87925e4cb73b5cc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841213c expref: 23 pid: 13436 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.919870:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520512:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.919898:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->1081343] (req 1048576->1081343) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.919925:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7de00, rc 0) 00000100:00100000:2.0:1746143843.920486:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2892:x1830963625120768:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7580us (7794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.920496:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16843 00000100:00100000:1.0:1746143843.921239:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.921330:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625121152 00000100:00100000:0.0:1746143843.921337:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625121152 00010000:00010000:0.0:1746143843.921365:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:0.0:1746143843.921397:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8241 00000100:00100000:0.0:1746143843.921404:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625121152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143843.921416:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143843.921437:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143843.921447:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143843.921468:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ea00/0x87925e4cb73b5cd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841214a expref: 13 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:0.0:1746143843.921542:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.921545:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143843.921552:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.921561:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143843.921592:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143843.921604:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627520640:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143843.922274:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.924250:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627520640:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.924271:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.924325:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625121152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2920us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.924335:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8241 00000100:00100000:0.0:1746143843.924673:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143843.924751:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625121408 00000100:00100000:3.0:1746143843.924757:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625121408 00002000:00100000:3.0:1746143843.924864:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1077248->1081343) req@ffff880093414e00 x1830963625121408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.924874:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963625121408 ext(1077248->1081343) 00002000:00010000:3.0:1746143843.924878:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:3.0:1746143843.924903:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7348 00000100:00100000:3.0:1746143843.924930:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625121408:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143843.925104:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625121408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 192us (430us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143843.925115:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7348 00002000:00100000:3.0:1746143843.925122:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1077248->1081343) req@ffff880093414e00 x1830963625121408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143843.925129:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414e00 with x1830963625121408 ext(1077248->1081343) 00002000:00010000:3.0:1746143843.925132:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093414e00 00000100:00100000:0.0:1746143843.930220:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.930439:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625121664 00000100:00100000:2.0:1746143843.930451:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625121664 00000100:00100000:2.0:1746143843.930501:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5458 00000100:00100000:2.0:1746143843.930520:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2892:x1830963625121664:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143843.930795:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2892:x1830963625121664:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 284us (583us total) trans 8589945125 rc 0/0 00000100:00100000:2.0:1746143843.930801:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5458 00000100:00100000:0.0:1746143843.967704:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.967781:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625121792 00000100:00100000:2.0:1746143843.967790:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625121792 00000100:00100000:2.0:1746143843.967829:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16844 00000100:00100000:2.0:1746143843.967835:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+23:2894:x1830963625121792:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.967851:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.967866:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121f2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.967894:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.967900:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.967908:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.967928:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.967929:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.967931:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1269760->2097151] (req 1269760->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.967957:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 11 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.967966:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 11 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.967974:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520768:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.968050:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 7 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.968057:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 7 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.968065:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520896:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.968093:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.968105:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.969212:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627521024:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.969252:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143843.972463:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.972884:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520768:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.972897:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627520896:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.972904:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627521024:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.972964:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1269760->2097151] (req 1269760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.972981:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c800, rc 0) 00000100:00100000:2.0:1746143843.973038:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+24:2894:x1830963625121792:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5202us (5346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.973048:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16844 00000100:00100000:3.0:1746143843.973188:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122048 00000100:00100000:3.0:1746143843.973195:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122048 00010000:00010000:3.0:1746143843.973222:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 8 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143843.973249:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8242 00000100:00100000:3.0:1746143843.973256:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625122048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.973269:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.973290:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 8 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.973300:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 8 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.973331:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048800/0x87925e4cb73b5d33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412197 expref: 8 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.973351:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.973367:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5221050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963625122048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.973376:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8242 00000100:00100000:0.0:1746143843.973970:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.974027:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625121920 00000100:00100000:2.0:1746143843.974032:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625121920 00010000:00010000:2.0:1746143843.974047:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 12 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143843.974204:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8243 00000100:00100000:3.0:1746143843.974211:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625121920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.974219:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.974227:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 12 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.974235:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 12 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.974247:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a52c00/0x87925e4cb73b5ce6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841215f expref: 12 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143843.974257:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.974286:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625121920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143843.974291:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8243 00000100:00100000:0.0:1746143843.975168:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.975374:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122176 00000100:00100000:2.0:1746143843.975379:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122176 00010000:00010000:2.0:1746143843.975397:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143843.975430:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8244 00000100:00100000:2.0:1746143843.975436:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625122176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.975444:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.975455:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.975464:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.975477:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082049400/0x87925e4cb73b5cca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412143 expref: 24 pid: 13436 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143843.975492:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.975494:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.975636:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.975644:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.975675:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 23 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.975687:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627521152:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143843.975755:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143843.979133:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143843.979504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.979682:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627521152:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.979703:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.979750:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963625122176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4313us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.979761:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8244 00000100:00100000:1.0:1746143843.979847:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122432 00000100:00100000:1.0:1746143843.979855:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122432 00002000:00100000:1.0:1746143843.979896:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1269760->1273855) req@ffff880093416a00 x1830963625122432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/0 e 0 to 0 dl 1746143854 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.979905:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416a00 with x1830963625122432 ext(1269760->1273855) 00002000:00010000:1.0:1746143843.979926:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416a00 00000100:00100000:1.0:1746143843.979944:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7349 00000100:00100000:1.0:1746143843.979951:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625122432:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143843.980066:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2008:x1830963625122432:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 115us (569us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143843.980071:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7349 00002000:00100000:1.0:1746143843.980076:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1269760->1273855) req@ffff880093416a00 x1830963625122432/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:239/0 lens 488/4536 e 0 to 0 dl 1746143854 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143843.980083:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416a00 with x1830963625122432 ext(1269760->1273855) 00002000:00010000:1.0:1746143843.980085:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093416a00 00000100:00100000:1.0:1746143843.992087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.992186:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122560 00000100:00100000:2.0:1746143843.992196:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122560 00000100:00100000:2.0:1746143843.992284:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16845 00000100:00100000:2.0:1746143843.992294:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:2894:x1830963625122560:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143843.992323:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143843.992343:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484121f9 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.992376:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.992384:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.992391:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.992397:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.992399:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.992402:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.992438:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.992450:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 7 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.992462:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627521280:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.992639:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.992649:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 8 pid: 13436 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.992656:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627521408:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.992685:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143843.992692:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.992700:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627521536:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.992720:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.993992:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627521280:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.994004:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627521408:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143843.994011:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627521536:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143843.994035:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.994050:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47a200, rc 0) 00000100:00100000:2.0:1746143843.994079:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2894:x1830963625122560:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1787us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.994086:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16845 00000100:00100000:0.0:1746143843.996040:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143843.996067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143843.996394:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122816 00000100:00100000:2.0:1746143843.996403:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122816 00000100:00100000:0.0:1746143843.996409:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143843.996440:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143843.996509:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122688 00000100:00100000:2.0:1746143843.996509:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625122944 00000100:00100000:3.0:1746143843.996512:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122688 00000100:00100000:2.0:1746143843.996512:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625122944 00010000:00010000:2.0:1746143843.996522:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.996524:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 9 pid: 13436 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143843.996550:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8245 00000100:00100000:3.0:1746143843.996557:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8246 00000100:00100000:3.0:1746143843.996563:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625122944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143843.996565:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8247 00000100:00100000:2.0:1746143843.996569:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625122688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143843.996576:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.996576:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143843.996595:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.996596:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 9 pid: 13436 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.996606:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.996613:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 9 pid: 13436 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.996631:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76600/0x87925e4cb73b5c4c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120fd expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.996634:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b5d41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841219e expref: 9 pid: 13436 timeout: 1003 lvb_type: 1 00010000:00010000:3.0:1746143843.996649:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143843.996649:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143843.996681:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963625122944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.996681:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625122688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.996686:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8247 00000100:00100000:3.0:1746143843.996689:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8246 00000100:00100000:2.0:1746143843.996715:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625122816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143843.996721:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143843.996728:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.996748:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.996760:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3aa00/0x87925e4cb73b5bea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484120be expref: 26 pid: 9586 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143843.996769:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.996771:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143843.996778:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.996790:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143843.996820:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143843.996833:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627521664:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143843.996887:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143843.999867:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627521664:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143843.999890:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143843.999963:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625122816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3403us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143843.999974:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8245 00000100:00100000:0.0:1746143844.000098:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.001282:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625123200 00000100:00100000:3.0:1746143844.001292:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625123200 00002000:00100000:3.0:1746143844.001345:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1167360->1171455) req@ffff880093414380 x1830963625123200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.001354:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414380 with x1830963625123200 ext(1167360->1171455) 00002000:00010000:3.0:1746143844.001359:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414380 00000100:00100000:3.0:1746143844.001390:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7350 00000100:00100000:3.0:1746143844.001397:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963625123200:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143844.001533:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963625123200:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 136us (1434us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143844.001538:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7350 00002000:00100000:3.0:1746143844.001543:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1167360->1171455) req@ffff880093414380 x1830963625123200/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.001555:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093414380 with x1830963625123200 ext(1167360->1171455) 00002000:00010000:3.0:1746143844.001558:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093414380 00000100:00100000:0.0:1746143844.005096:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.006384:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625123456 00000100:00100000:2.0:1746143844.006397:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625123456 00000100:00100000:2.0:1746143844.006603:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5459 00000100:00100000:2.0:1746143844.006612:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:2894:x1830963625123456:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143844.007613:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:2894:x1830963625123456:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 996us (2522us total) trans 8589945126 rc 0/0 00000100:00100000:2.0:1746143844.007621:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5459 00000100:00100000:0.0:1746143844.010071:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.011193:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625123712 00000100:00100000:2.0:1746143844.011204:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625123712 00000100:00100000:2.0:1746143844.011267:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14050 00000100:00100000:2.0:1746143844.011276:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:2901:x1830963625123712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143844.011296:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.011327:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73b5ddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412200 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.011431:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.011445:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.011454:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143844.011464:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143844.011556:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73b5ddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.011569:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.011577:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.011579:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143844.011582:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d200, rc 0) 00000100:00100000:2.0:1746143844.011644:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:2901:x1830963625123712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 370us (1581us total) trans 8589945127 rc 0/0 00000100:00100000:2.0:1746143844.011650:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14050 00000100:00100000:0.0:1746143844.013631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.013668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.013740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.013786:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625123840 00000100:00100000:2.0:1746143844.013794:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625123840 00000100:00100000:1.0:1746143844.013818:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625123968 00000100:00100000:1.0:1746143844.013822:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625123968 00000100:00100000:2.0:1746143844.013837:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124096 00000100:00100000:2.0:1746143844.013839:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124096 00000100:00100000:1.0:1746143844.013850:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16846 00000100:00100000:3.0:1746143844.013857:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16847 00000100:00100000:1.0:1746143844.013858:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625123840:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143844.013865:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16848 00000100:00100000:3.0:1746143844.013866:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625123968:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143844.013870:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625124096:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.013875:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.013875:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.013875:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.013889:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b5dfe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841220e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.013889:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412215 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.013889:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73b5df0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412207 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.013908:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.013931:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.013939:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.013951:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 26 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143844.013953:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627521920:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143844.013953:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627521792:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143844.013960:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b47aa00, rc 0) 00000100:00100000:2.0:1746143844.014003:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625124096:12345-192.168.202.3@tcp:101:cat.0 Request processed in 132us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.014009:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16848 00000100:00100000:3.0:1746143844.014014:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.014151:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746143844.016305:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143843 -> 1746143844 00002000:00010000:3.0:1746143844.016325:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143843 -> 1746143844 00002000:00010000:3.0:1746143844.016326:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143843 -> 1746143844 00000100:00100000:3.0:1746143844.016348:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627521920:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143844.016380:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b5dfe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841220e expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.016393:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b5dfe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841220e expref: 25 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.016418:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849400, rc 0) 00000100:00100000:3.0:1746143844.016463:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625123968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2598us (2794us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143844.016470:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16847 00000100:00100000:1.0:1746143844.017551:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627521792:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143844.017572:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73b5df0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412207 expref: 26 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.017581:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84e000/0x87925e4cb73b5df0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412207 expref: 26 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.018132:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e000, rc 0) 00000100:00100000:1.0:1746143844.018251:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625123840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4392us (4626us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143844.018258:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16846 00000100:00100000:0.0:1746143844.023537:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.023761:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124224 00000100:00100000:1.0:1746143844.023772:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124224 00000100:00100000:1.0:1746143844.023830:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16849 00000100:00100000:1.0:1746143844.023838:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2901:x1830963625124224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.023858:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.023876:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841221c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.023941:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 6 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.023949:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.023951:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.023954:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.023985:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 6 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.023996:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 6 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143844.024007:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627522048:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.024104:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.028493:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627522048:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.028528:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.028546:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ea00, rc 0) 00000100:00100000:1.0:1746143844.028601:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2901:x1830963625124224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4761us (5072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.028609:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16849 00000100:00100000:0.0:1746143844.029989:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.030098:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124352 00000100:00100000:1.0:1746143844.030106:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124352 00002000:00100000:1.0:1746143844.030169:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (405504->1048575) req@ffff88009c4d4380 x1830963625124352/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.030178:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963625124352 ext(405504->1048575) 00010000:00010000:1.0:1746143844.030186:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 7 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.030204:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 7 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143844.030211:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d4380 00000100:00100000:1.0:1746143844.030238:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2703 00000100:00100000:1.0:1746143844.030245:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2009:x1830963625124352:12345-192.168.202.3@tcp:4:cat.0 00000100:00080000:2.0:1746143844.030262:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143844.040601:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625124352:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10345us (10606us total) trans 17179874009 rc 0/0 00000100:00100000:1.0:1746143844.040615:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2703 00002000:00100000:1.0:1746143844.040627:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (405504->1048575) req@ffff88009c4d4380 x1830963625124352/t17179874009(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.040637:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4380 with x1830963625124352 ext(405504->1048575) 00010000:00010000:1.0:1746143844.040648:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.040666:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143844.040673:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d4380 00000100:00100000:0.0:1746143844.045439:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.045590:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124480 00000100:00100000:2.0:1746143844.045603:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124480 00010000:00010000:2.0:1746143844.045648:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.045692:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8248 00000100:00100000:2.0:1746143844.045700:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625124480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.045715:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.046308:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.046329:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.046353:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b5db8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 405504->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121dd expref: 9 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.046376:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.046378:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.046384:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.046391:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.046427:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.046439:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627522176:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.046541:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.051247:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627522176:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.051274:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.051424:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625124480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5723us (5992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.051435:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8248 00000100:00100000:1.0:1746143844.051534:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.051692:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124736 00000100:00100000:0.0:1746143844.051700:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124736 00002000:00100000:0.0:1746143844.051735:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009eb84e00 x1830963625124736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.051744:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84e00 with x1830963625124736 ext(0->1048575) 00002000:00010000:0.0:1746143844.051748:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb84e00 00000100:00100000:0.0:1746143844.051778:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7351 00000100:00100000:0.0:1746143844.051785:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625124736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143844.066571:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625124736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14773us (15033us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143844.066585:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7351 00002000:00100000:2.0:1746143844.066600:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009eb84e00 x1830963625124736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.066610:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84e00 with x1830963625124736 ext(0->1048575) 00002000:00010000:2.0:1746143844.066617:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb84e00 00000100:00100000:0.0:1746143844.078660:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.078771:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124864 00000100:00100000:1.0:1746143844.078781:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124864 00000100:00100000:1.0:1746143844.078841:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16850 00000100:00100000:1.0:1746143844.078849:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+24:2901:x1830963625124864:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.078869:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.078886:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412223 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.078948:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.078955:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.078957:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.078961:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.078992:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 10 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.079003:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 10 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143844.079015:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627522304:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.079108:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.080475:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627522304:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.080503:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 25 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.080517:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fe00, rc 0) 00000100:00100000:1.0:1746143844.080557:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+25:2901:x1830963625124864:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1708us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.080566:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16850 00000100:00100000:0.0:1746143844.081470:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.081545:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625124992 00000100:00100000:2.0:1746143844.081553:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625124992 00002000:00100000:2.0:1746143844.081607:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1081343) req@ffff88009c4d7100 x1830963625124992/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.081617:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963625124992 ext(1048576->1081343) 00010000:00010000:2.0:1746143844.081625:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 11 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.081638:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 11 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.081645:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d7100 00000100:00100000:2.0:1746143844.081672:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2704 00000100:00100000:2.0:1746143844.081680:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625124992:12345-192.168.202.3@tcp:4:cat.0 00000100:00080000:0.0:1746143844.081803:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143844.084295:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625124992:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2606us (2817us total) trans 21474841281 rc 0/0 00000100:00100000:2.0:1746143844.084648:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2704 00002000:00100000:2.0:1746143844.084659:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1081343) req@ffff88009c4d7100 x1830963625124992/t21474841281(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.084668:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7100 with x1830963625124992 ext(1048576->1081343) 00010000:00010000:2.0:1746143844.084678:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.084691:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.084697:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d7100 00000100:00100000:0.0:1746143844.087410:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.088578:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625125120 00000100:00100000:2.0:1746143844.088587:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625125120 00010000:00010000:2.0:1746143844.088620:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.088656:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8249 00000100:00100000:2.0:1746143844.088663:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625125120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.088675:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.088693:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.088703:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.088720:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b5dc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121eb expref: 13 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.088746:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.088748:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.088753:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.088760:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.088785:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 24 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.088795:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627522432:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.088868:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.091667:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627522432:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.091690:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.092032:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625125120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3367us (4634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.092044:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8249 00000100:00100000:0.0:1746143844.098489:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.098525:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.098820:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625125504 00000100:00100000:2.0:1746143844.098834:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625125504 00000100:00100000:0.0:1746143844.098869:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143844.098890:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1171456->2097151) req@ffff88009c4d6680 x1830963625125504/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.098899:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6680 with x1830963625125504 ext(1171456->2097151) 00002000:00010000:2.0:1746143844.098904:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d6680 00000100:00100000:2.0:1746143844.098978:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625125632 00000100:00100000:2.0:1746143844.098981:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625125632 00002000:00100000:2.0:1746143844.098997:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d4000 x1830963625125632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.099008:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4000 with x1830963625125632 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.099012:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4000 00000100:00100000:2.0:1746143844.099024:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625125760 00000100:00100000:2.0:1746143844.099026:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625125760 00002000:00100000:2.0:1746143844.099035:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1269759) req@ffff88009c4d6d80 x1830963625125760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.099042:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6d80 with x1830963625125760 ext(1048576->1269759) 00002000:00010000:2.0:1746143844.099045:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d6d80 00000100:00100000:2.0:1746143844.099057:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7352 00000100:00100000:2.0:1746143844.099064:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625125504:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143844.099141:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7353 00000100:00100000:3.0:1746143844.099154:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625125632:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143844.099429:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7354 00000100:00100000:0.0:1746143844.099436:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625125760:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143844.107819:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625125760:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8369us (8935us total) trans 0 rc 221184/221184 00000100:00100000:1.0:1746143844.107833:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7354 00002000:00100000:1.0:1746143844.107847:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1269759) req@ffff88009c4d6d80 x1830963625125760/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 221184/221184 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.107858:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6d80 with x1830963625125760 ext(1048576->1269759) 00002000:00010000:1.0:1746143844.107864:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d6d80 00000100:00100000:2.0:1746143844.107880:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625125504:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8814us (9397us total) trans 0 rc 925696/925696 00000100:00100000:2.0:1746143844.107888:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7352 00002000:00100000:2.0:1746143844.107894:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1171456->2097151) req@ffff88009c4d6680 x1830963625125504/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 925696/925696 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.107901:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6680 with x1830963625125504 ext(1171456->2097151) 00002000:00010000:2.0:1746143844.107929:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d6680 00000100:00100000:3.0:1746143844.112966:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625125632:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13802us (14426us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143844.112992:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7353 00002000:00100000:3.0:1746143844.113005:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d4000 x1830963625125632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.113015:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4000 with x1830963625125632 ext(1048576->2097151) 00002000:00010000:3.0:1746143844.113021:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d4000 00000100:00100000:0.0:1746143844.129336:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.129635:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.129683:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.129731:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625126272 00000100:00100000:1.0:1746143844.129740:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625126272 00002000:00100000:1.0:1746143844.129782:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009eb85c00 x1830963625126272/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.129792:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85c00 with x1830963625126272 ext(2097152->4194303) 00002000:00010000:1.0:1746143844.129798:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85c00 00000100:00100000:1.0:1746143844.129816:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625126400 00000100:00100000:1.0:1746143844.129818:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625126400 00002000:00100000:1.0:1746143844.129829:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009eb85f80 x1830963625126400/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.129836:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85f80 with x1830963625126400 ext(2097152->4194303) 00002000:00010000:1.0:1746143844.129840:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb85f80 00000100:00100000:1.0:1746143844.129852:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7355 00000100:00100000:1.0:1746143844.129859:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625126272:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143844.130690:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625126656 00000100:00100000:3.0:1746143844.130697:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625126656 00000100:00100000:3.0:1746143844.130732:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14051 00000100:00100000:0.0:1746143844.130733:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7356 00000100:00100000:3.0:1746143844.130738:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2905:x1830963625126656:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143844.130742:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625126400:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143844.130753:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.130778:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5e13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841222a expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.130848:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.130861:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.130871:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.130883:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.130892:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.130897:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131018:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131026:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131032:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143844.131040:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143844.131420:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131430:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131435:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131441:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131446:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.131450:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131456:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131468:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143844.131471:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.131475:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131480:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848600/0x87925e4cb73b5e1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131503:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131508:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131513:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131517:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.131519:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131524:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131530:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ed00) 00010000:00010000:3.0:1746143844.131532:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.131534:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131538:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b5e21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143844.131576:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5e13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 22 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.131588:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 21 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.131595:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.131597:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143844.131599:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849e00, rc 0) 00000100:00100000:3.0:1746143844.131656:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2905:x1830963625126656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 917us (2350us total) trans 8589945128 rc 0/0 00000100:00100000:3.0:1746143844.131663:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14051 00000100:00100000:0.0:1746143844.140659:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.142158:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625126912 00000100:00100000:2.0:1746143844.142170:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625126912 00000100:00100000:2.0:1746143844.142229:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5460 00000100:00100000:2.0:1746143844.142238:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2905:x1830963625126912:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143844.142493:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2905:x1830963625126912:12345-192.168.202.3@tcp:35:cat.0 Request processed in 256us (1845us total) trans 8589945129 rc 0/0 00000100:00100000:2.0:1746143844.142503:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5460 00000100:00100000:3.0:1746143844.147439:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625126400:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16685us (17741us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143844.147454:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7356 00002000:00100000:3.0:1746143844.147468:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009eb85f80 x1830963625126400/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.147478:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85f80 with x1830963625126400 ext(2097152->4194303) 00002000:00010000:3.0:1746143844.147485:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009eb85f80 00000100:00100000:0.0:1746143844.159733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.159763:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.159787:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.159812:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625127040 00000100:00100000:0.0:1746143844.159821:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625127040 00000100:00100000:0.0:1746143844.159861:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625127296 00000100:00100000:0.0:1746143844.159864:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625127296 00000100:00100000:0.0:1746143844.159875:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625127168 00000100:00100000:0.0:1746143844.159876:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625127168 00000100:00100000:0.0:1746143844.159889:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16851 00000100:00100000:0.0:1746143844.159896:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2011:x1830963625127040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143844.159946:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.159965:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412231 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.159988:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.159990:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.159998:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.160013:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.160023:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:0.0:1746143844.160065:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f452050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625127040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 170us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.160070:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16851 00000100:00100000:0.0:1746143844.160232:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16852 00000100:00100000:0.0:1746143844.160238:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625127296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143844.160248:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.160257:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73b5e3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841223f expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.160294:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627522560:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143844.160364:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.160401:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.160488:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625127424 00000100:00100000:0.0:1746143844.160491:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625127424 00000100:00100000:0.0:1746143844.160509:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16853 00000100:00100000:0.0:1746143844.160513:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625127168:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143844.160519:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.160526:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412238 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.160536:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.160538:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.160543:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 15 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.160553:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 15 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.160559:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32400, rc 0) 00000100:00100000:0.0:1746143844.160577:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625127168:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.160582:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16853 00000100:00100000:0.0:1746143844.160593:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16854 00000100:00100000:0.0:1746143844.160597:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625127424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143844.160602:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.160607:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73b5e4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412246 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.160626:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627522688:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143844.160642:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.160890:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625126272:12345-192.168.202.3@tcp:3:cat.0 Request processed in 31030us (31254us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143844.160899:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7355 00002000:00100000:1.0:1746143844.160907:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009eb85c00 x1830963625126272/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.160936:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85c00 with x1830963625126272 ext(2097152->4194303) 00002000:00010000:1.0:1746143844.160941:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85c00 00002000:00010000:0.0:1746143844.166373:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143842 -> 1746143844 00002000:00010000:0.0:1746143844.166380:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143842 -> 1746143844 00002000:00010000:0.0:1746143844.166382:0:1947:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143843 -> 1746143844 00000100:00100000:0.0:1746143844.166404:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627522688:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143844.166435:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73b5e4b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412246 expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.166450:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32000/0x87925e4cb73b5e4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412246 expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.166476:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32000, rc 0) 00000100:00100000:0.0:1746143844.166520:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625127424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5921us (6118us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143844.166529:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16854 00002000:00010000:2.0:1746143844.167109:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143843 -> 1746143844 00002000:00010000:2.0:1746143844.167113:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143843 -> 1746143844 00002000:00010000:2.0:1746143844.167115:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143843 -> 1746143844 00000100:00100000:2.0:1746143844.167128:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627522560:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143844.167146:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73b5e3d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841223f expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.167156:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e000/0x87925e4cb73b5e3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841223f expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.167736:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e000, rc 0) 00000100:00100000:2.0:1746143844.168139:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625127296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7898us (8371us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143844.168148:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16852 00000100:00100000:0.0:1746143844.173405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.174046:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625127680 00000100:00100000:3.0:1746143844.174055:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625127680 00000100:00100000:3.0:1746143844.174103:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14052 00000100:00100000:3.0:1746143844.174111:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2907:x1830963625127680:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.174138:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.174154:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323be00/0x87925e4cb73b5e52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841224d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.174237:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.174250:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.174256:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.174262:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.174285:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 23 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.174295:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 23 pid: 10936 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.174304:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627522816:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.174406:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.174413:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 275 pid: 7244 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.174421:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627522944:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.174438:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.182644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.182681:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.183495:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627522816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.183506:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627522944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.183531:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143844.184449:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128064 00000100:00100000:1.0:1746143844.184461:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128064 00000100:00100000:3.0:1746143844.184493:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128192 00000100:00100000:3.0:1746143844.184501:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128192 00002000:00100000:1.0:1746143844.184517:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009c4d5880 x1830963625128064/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.184528:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5880 with x1830963625128064 ext(0->1048575) 00002000:00100000:3.0:1746143844.184534:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d7800 x1830963625128192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746143844.184534:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d5880 00002000:00100000:3.0:1746143844.184547:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7800 with x1830963625128192 ext(1048576->2097151) 00002000:00010000:3.0:1746143844.184552:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d7800 00000100:00100000:0.0:1746143844.184866:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.185210:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7357 00000100:00100000:1.0:1746143844.185220:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625128064:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143844.185226:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.185254:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128448 00000100:00100000:1.0:1746143844.185257:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128448 00010000:00010000:1.0:1746143844.185279:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 276 pid: 7244 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143844.185317:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128320 00000100:00100000:1.0:1746143844.185319:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128320 00010000:00010000:1.0:1746143844.185329:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 24 pid: 10936 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143844.185329:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8250 00000100:00100000:0.0:1746143844.185337:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:2008:x1830963625128448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143844.185346:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8251 00010000:00010000:0.0:1746143844.185348:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143844.185352:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625128320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143844.185355:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 276 pid: 7244 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.185360:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.185365:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 24 pid: 10936 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143844.185365:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 276 pid: 7244 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.185375:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 24 pid: 10936 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.185982:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7358 00000100:00100000:3.0:1746143844.185990:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625128192:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:0.0:1746143844.186773:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d800/0x87925e4cb73b5daa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121d6 expref: 276 pid: 7244 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143844.186800:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143844.186804:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.186811:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.186816:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143844.186841:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2008:x1830963625128448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1505us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.186849:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8250 00010000:00010000:1.0:1746143844.187280:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5e28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841222a expref: 24 pid: 10936 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.187317:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143844.187321:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.187330:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.187336:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.187358:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.187395:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625128320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2041us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.187403:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8251 00010000:00010000:3.0:1746143844.187622:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.187630:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143844.187648:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143844.187754:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323be00/0x87925e4cb73b5e52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.187781:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.187788:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.187790:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143844.187792:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323ac00, rc 0) 00000100:00100000:3.0:1746143844.187813:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2907:x1830963625127680:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13703us (14416us total) trans 8589945130 rc 0/0 00000100:00100000:3.0:1746143844.187819:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14052 00000100:00100000:0.0:1746143844.198763:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.198831:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128704 00000100:00100000:2.0:1746143844.198839:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128704 00002000:00100000:2.0:1746143844.198874:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88009610ca80 x1830963625128704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.198882:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610ca80 with x1830963625128704 ext(4194304->4849663) 00002000:00010000:2.0:1746143844.198887:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610ca80 00000100:00100000:2.0:1746143844.199713:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7359 00000100:00100000:2.0:1746143844.199723:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625128704:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143844.200139:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625128192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14149us (17455us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143844.200146:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7358 00002000:00100000:0.0:1746143844.200153:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d7800 x1830963625128192/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.200159:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7800 with x1830963625128192 ext(1048576->2097151) 00002000:00010000:0.0:1746143844.200164:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d7800 00000100:00100000:2.0:1746143844.204967:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625128064:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19740us (22373us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143844.204978:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7357 00002000:00100000:2.0:1746143844.204988:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009c4d5880 x1830963625128064/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.204996:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5880 with x1830963625128064 ext(0->1048575) 00002000:00010000:2.0:1746143844.205001:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d5880 00000100:00100000:2.0:1746143844.206937:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625128704:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7210us (8175us total) trans 0 rc 655360/655360 00000100:00100000:2.0:1746143844.206946:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7359 00002000:00100000:2.0:1746143844.206955:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4849663) req@ffff88009610ca80 x1830963625128704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 655360/655360 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.206963:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610ca80 with x1830963625128704 ext(4194304->4849663) 00002000:00010000:2.0:1746143844.206967:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610ca80 00000100:00100000:0.0:1746143844.226851:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.227201:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.227245:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128832 00000100:00100000:2.0:1746143844.227253:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128832 00000100:00100000:2.0:1746143844.227320:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16855 00000100:00100000:2.0:1746143844.227328:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2907:x1830963625128832:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143844.227349:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.227367:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412254 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.227403:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 14 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.227414:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.227422:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.227424:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.227427:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3174400->3502079] (req 3174400->3502079) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.227460:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 24 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.227474:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 24 pid: 1947 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143844.227489:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627523072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.227590:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 14 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.227601:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 14 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.227612:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627523200:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.227641:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.227837:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625128960 00000100:00100000:1.0:1746143844.227841:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625128960 00000100:00100000:1.0:1746143844.227860:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16856 00000100:00100000:1.0:1746143844.227865:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2905:x1830963625128960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.227874:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.227881:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841225b expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.227894:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.227899:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.227900:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.227902:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.227933:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.227940:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 24 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143844.227948:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627523328:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.228039:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.230175:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627523072:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.230185:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627523200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.230211:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3174400->3502079] (req 3174400->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 16 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.230224:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323bc00, rc 0) 00000100:00100000:2.0:1746143844.230260:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2907:x1830963625128832:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2932us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.230269:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16855 00000100:00100000:1.0:1746143844.231597:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627523328:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.231619:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.231632:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086c00, rc 0) 00000100:00100000:1.0:1746143844.231659:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2905:x1830963625128960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3792us (4461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.231667:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16856 00000100:00100000:0.0:1746143844.240771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.240813:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.240857:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.240873:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625129216 00000100:00100000:2.0:1746143844.240881:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625129216 00010000:00010000:2.0:1746143844.240944:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 25 pid: 1947 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143844.240966:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625129344 00000100:00100000:2.0:1746143844.240968:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625129344 00000100:00100000:3.0:1746143844.240978:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8252 00010000:00010000:2.0:1746143844.240978:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 15 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.240986:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625129216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.240997:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143844.240997:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8253 00000100:00100000:2.0:1746143844.241001:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625129344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.241006:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.241014:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 25 pid: 1947 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.241014:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 15 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.241023:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 25 pid: 1947 timeout: 1003 lvb_type: 1 00000100:00100000:1.0:1746143844.241138:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625129088 00000100:00100000:1.0:1746143844.241142:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625129088 00002000:00100000:1.0:1746143844.241166:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1269760->2097151) req@ffff880092145c00 x1830963625129088/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.241174:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145c00 with x1830963625129088 ext(1269760->2097151) 00010000:00010000:1.0:1746143844.241179:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.241187:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143844.241192:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092145c00 00000100:00100000:1.0:1746143844.241205:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2705 00000100:00100000:1.0:1746143844.241210:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625129088:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:2.0:1746143844.241389:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 15 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.241604:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b47aa00/0x87925e4cb73b5df7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412215 expref: 27 pid: 1947 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.241609:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b5d72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121c1 expref: 15 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.241622:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.241624:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.241629:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.241637:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.241644:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143844.241663:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.241664:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625129344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 662us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.241669:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8253 00000100:00100000:3.0:1746143844.241672:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627523456:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.241716:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.248804:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.249083:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625129600 00000100:00100000:3.0:1746143844.249091:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625129600 00000100:00100000:3.0:1746143844.249366:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14053 00000100:00100000:3.0:1746143844.249375:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2910:x1830963625129600:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.249393:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.249406:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412262 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.249463:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249474:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249483:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249493:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249498:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249503:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249572:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249579:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249585:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143844.249592:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143844.249635:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249640:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249646:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249651:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249655:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b8a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.249660:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249665:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249673:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143844.249675:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.249678:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249683:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b5e7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249707:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249711:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249715:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249718:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b9200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.249720:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249729:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249734:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ed00) 00010000:00010000:3.0:1746143844.249736:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.249738:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249742:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b5e83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.249769:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b5e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 278 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.249778:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.249783:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.249785:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143844.249787:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9c00, rc 0) 00000100:00100000:3.0:1746143844.250060:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:2910:x1830963625129600:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 685us (1261us total) trans 8589945131 rc 0/0 00000100:00100000:3.0:1746143844.250065:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14053 00000100:00100000:0.0:1746143844.250789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.251066:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625129856 00000100:00100000:1.0:1746143844.251071:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625129856 00002000:00100000:1.0:1746143844.251099:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3174400->3178495) req@ffff880092144380 x1830963625129856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.251107:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144380 with x1830963625129856 ext(3174400->3178495) 00002000:00010000:1.0:1746143844.251111:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092144380 00000100:00100000:1.0:1746143844.251125:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7360 00000100:00100000:1.0:1746143844.251130:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625129856:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143844.251690:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625129856:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 557us (900us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143844.251697:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7360 00002000:00100000:1.0:1746143844.251702:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3174400->3178495) req@ffff880092144380 x1830963625129856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.251708:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144380 with x1830963625129856 ext(3174400->3178495) 00002000:00010000:1.0:1746143844.251711:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092144380 00000100:00100000:3.0:1746143844.251899:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627523456:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143844.251930:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.251951:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625129216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10967us (11188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.251958:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8252 00000100:00100000:1.0:1746143844.254407:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625129088:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13190us (13542us total) trans 21474841282 rc 0/0 00000100:00100000:1.0:1746143844.254418:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2705 00002000:00100000:1.0:1746143844.254426:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1269760->2097151) req@ffff880092145c00 x1830963625129088/t21474841282(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.254434:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145c00 with x1830963625129088 ext(1269760->2097151) 00010000:00010000:1.0:1746143844.254443:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.254455:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:1.0:1746143844.254461:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092145c00 00000100:00100000:0.0:1746143844.258250:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.262587:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625129984 00000100:00100000:3.0:1746143844.262598:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625129984 00010000:00010000:3.0:1746143844.262634:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:0.0:1746143844.266143:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.266230:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625130240 00000100:00100000:1.0:1746143844.266239:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625130240 00002000:00100000:1.0:1746143844.266276:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (3497984->3502079) req@ffff880092145500 x1830963625130240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.266284:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145500 with x1830963625130240 ext(3497984->3502079) 00002000:00010000:1.0:1746143844.266289:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092145500 00000100:00100000:1.0:1746143844.266317:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7361 00000100:00100000:1.0:1746143844.266324:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625130240:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143844.266434:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625130240:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 110us (298us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143844.266440:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7361 00002000:00100000:1.0:1746143844.266445:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (3497984->3502079) req@ffff880092145500 x1830963625130240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.266452:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092145500 with x1830963625130240 ext(3497984->3502079) 00002000:00010000:1.0:1746143844.266454:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092145500 00000100:00100000:3.0:1746143844.266690:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8254 00000100:00100000:3.0:1746143844.266699:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625129984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.266709:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.266722:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.266733:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.266750:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c800/0x87925e4cb73b5dcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1269760->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f2 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.266776:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.266778:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.266783:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.266789:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.266814:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.266828:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627523584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.266892:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.271905:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627523584:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143844.271954:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.271997:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963625129984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5298us (13753us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.272006:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8254 00000100:00100000:0.0:1746143844.272423:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.273003:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625130496 00000100:00100000:2.0:1746143844.273010:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625130496 00002000:00100000:2.0:1746143844.273038:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092147b80 x1830963625130496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.273046:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147b80 with x1830963625130496 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.273049:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147b80 00000100:00100000:2.0:1746143844.273461:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7362 00000100:00100000:2.0:1746143844.273469:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625130496:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143844.286497:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625130496:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13022us (14067us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143844.286506:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7362 00002000:00100000:2.0:1746143844.286516:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092147b80 x1830963625130496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.286529:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092147b80 with x1830963625130496 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.286535:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092147b80 00000100:00100000:0.0:1746143844.292480:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.292956:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625130624 00000100:00100000:1.0:1746143844.292966:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625130624 00000100:00100000:1.0:1746143844.293019:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16857 00000100:00100000:1.0:1746143844.293027:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2910:x1830963625130624:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143844.293042:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.293063:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412269 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.293088:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.293095:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.293097:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.293099:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1122304->1490943] (req 1122304->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 26 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.293126:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 13 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.293137:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 13 pid: 1947 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143844.293146:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627523712:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.293229:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.296653:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.296710:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627523712:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.296740:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1122304->1490943] (req 1122304->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 26 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.296760:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087000, rc 0) 00000100:00100000:1.0:1746143844.296809:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2910:x1830963625130624:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3782us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.296818:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16857 00000100:00100000:1.0:1746143844.296845:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625130752 00000100:00100000:1.0:1746143844.296850:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625130752 00000100:00100000:1.0:1746143844.296887:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16858 00000100:00100000:1.0:1746143844.296893:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2905:x1830963625130752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.296947:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.296963:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412270 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.296987:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.297004:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.297006:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.297009:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 10 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.297035:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.297160:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 25 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:1.0:1746143844.297174:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627523840:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.297317:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.299458:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.300658:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.300835:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627523840:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.300865:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 10 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.300888:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082086200, rc 0) 00000100:00100000:1.0:1746143844.300951:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2905:x1830963625130752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4058us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.300959:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16858 00000100:00100000:3.0:1746143844.301122:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625130880 00000100:00100000:3.0:1746143844.301129:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625130880 00010000:00010000:3.0:1746143844.301158:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 14 pid: 1947 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.301193:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8255 00000100:00100000:3.0:1746143844.301767:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625130880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.301783:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.301804:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 14 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.301814:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 14 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.301835:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086c00/0x87925e4cb73b5e6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841225b expref: 14 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.301855:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.301857:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.301864:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.301873:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.301902:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 25 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.301930:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627523968:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.301993:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.302157:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625131008 00000100:00100000:2.0:1746143844.302162:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625131008 00002000:00100000:2.0:1746143844.302321:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1171455) req@ffff880092146300 x1830963625131008/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.302330:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146300 with x1830963625131008 ext(1048576->1171455) 00010000:00010000:2.0:1746143844.302337:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.302347:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 26 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.302352:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092146300 00000100:00100000:2.0:1746143844.302379:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2706 00000100:00100000:2.0:1746143844.302385:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625131008:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143844.305174:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627523968:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.305199:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.305254:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625130880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4053us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.305265:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8255 00000100:00100000:0.0:1746143844.306755:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.307815:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625131264 00000100:00100000:1.0:1746143844.307827:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625131264 00002000:00100000:1.0:1746143844.307872:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1122304->1126399) req@ffff880092146d80 x1830963625131264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.307887:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146d80 with x1830963625131264 ext(1122304->1126399) 00002000:00010000:1.0:1746143844.307891:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092146d80 00000100:00100000:1.0:1746143844.307938:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7363 00000100:00100000:1.0:1746143844.307947:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625131264:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143844.307948:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625131008:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5561us (7292us total) trans 17179874010 rc 0/0 00000100:00100000:2.0:1746143844.307961:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2706 00002000:00100000:2.0:1746143844.307968:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1171455) req@ffff880092146300 x1830963625131008/t17179874010(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.307976:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146300 with x1830963625131008 ext(1048576->1171455) 00010000:00010000:2.0:1746143844.307984:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 28 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.307998:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 28 pid: 12327 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.308005:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092146300 00000100:00100000:1.0:1746143844.308069:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625131264:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 123us (1319us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143844.308075:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7363 00002000:00100000:1.0:1746143844.308080:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1122304->1126399) req@ffff880092146d80 x1830963625131264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.308086:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092146d80 with x1830963625131264 ext(1122304->1126399) 00002000:00010000:1.0:1746143844.308090:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092146d80 00000100:00100000:0.0:1746143844.312390:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.313704:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625131392 00000100:00100000:2.0:1746143844.313713:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625131392 00010000:00010000:2.0:1746143844.313746:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 28 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.313955:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8256 00000100:00100000:2.0:1746143844.313962:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625131392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.313975:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.313992:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 28 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.314001:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 28 pid: 12327 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.314019:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b47a200/0x87925e4cb73b5dd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121f9 expref: 28 pid: 12327 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.314325:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143844.314373:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.314375:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.314381:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 9 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.314389:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 9 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.314417:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 9 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.314427:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627524096:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.314482:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.314794:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625131648 00000100:00100000:0.0:1746143844.314798:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625131648 00002000:00100000:0.0:1746143844.314824:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1486848->1490943) req@ffff88007f64b100 x1830963625131648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.314832:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b100 with x1830963625131648 ext(1486848->1490943) 00002000:00010000:0.0:1746143844.314835:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f64b100 00000100:00100000:0.0:1746143844.314859:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7364 00000100:00100000:0.0:1746143844.314866:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625131648:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143844.314974:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625131648:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (649us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143844.314980:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7364 00002000:00100000:0.0:1746143844.314985:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1486848->1490943) req@ffff88007f64b100 x1830963625131648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.314991:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b100 with x1830963625131648 ext(1486848->1490943) 00002000:00010000:0.0:1746143844.314994:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f64b100 00000100:00100000:0.0:1746143844.319855:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.319974:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.320169:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627524096:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.320195:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.320237:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625131392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6274us (7858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.320246:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8256 00000100:00100000:2.0:1746143844.320321:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625132160 00000100:00100000:2.0:1746143844.320327:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625132160 00002000:00100000:2.0:1746143844.320355:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d840700 x1830963625132160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.320364:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840700 with x1830963625132160 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.320368:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840700 00000100:00100000:2.0:1746143844.320382:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7365 00000100:00100000:2.0:1746143844.320388:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625132160:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143844.321033:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625131904 00000100:00100000:1.0:1746143844.321037:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625131904 00000100:00100000:1.0:1746143844.321064:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5461 00000100:00100000:1.0:1746143844.321069:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+277:2910:x1830963625131904:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143844.321187:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+278:2910:x1830963625131904:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 118us (1350us total) trans 8589945132 rc 0/0 00000100:00100000:1.0:1746143844.321192:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5461 00000100:00100000:0.0:1746143844.331004:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625132160:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10607us (11021us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143844.331017:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7365 00002000:00100000:0.0:1746143844.331028:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d840700 x1830963625132160/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.331036:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840700 with x1830963625132160 ext(1048576->2097151) 00002000:00010000:0.0:1746143844.331041:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d840700 00000100:00100000:0.0:1746143844.342847:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.343226:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625132416 00000100:00100000:2.0:1746143844.343233:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625132416 00002000:00100000:2.0:1746143844.343268:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012d842a00 x1830963625132416/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 504/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.343277:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963625132416 ext(2097152->4194303) 00002000:00010000:2.0:1746143844.343282:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d842a00 00000100:00100000:2.0:1746143844.343299:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7366 00000100:00100000:2.0:1746143844.343316:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625132416:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143844.345443:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.345539:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625132672 00000100:00100000:2.0:1746143844.345545:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625132672 00000100:00100000:2.0:1746143844.345694:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14054 00000100:00100000:2.0:1746143844.345702:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:2915:x1830963625132672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143844.345721:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.345735:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73b5ea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412277 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.345794:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345804:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345813:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345824:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345832:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345837:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345925:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73b5ebb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345933:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73b5ebb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.345938:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73b5ebb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143844.345946:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143844.346006:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346012:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346017:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346022:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346026:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143844.346030:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346035:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346048:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143844.346051:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143844.346054:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346058:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b5ead lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346072:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346076:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346080:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346083:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143844.346085:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346089:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346094:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5b9dc00) 00010000:00010000:2.0:1746143844.346096:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143844.346098:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346102:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5eb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.346134:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73b5ea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412277 expref: 281 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.346144:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73b5ebb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412277 expref: 280 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.346149:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.346151:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143844.346153:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085200, rc 0) 00000100:00100000:2.0:1746143844.346177:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:2915:x1830963625132672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 476us (738us total) trans 8589945133 rc 0/0 00000100:00100000:2.0:1746143844.346183:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14054 00000100:00100000:0.0:1746143844.361156:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.361220:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625133056 00000100:00100000:3.0:1746143844.361228:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625133056 00000100:00100000:0.0:1746143844.361237:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.361271:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5462 00000100:00100000:3.0:1746143844.361277:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:2915:x1830963625133056:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143844.361437:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:2915:x1830963625133056:12345-192.168.202.3@tcp:35:cat.0 Request processed in 160us (288us total) trans 8589945134 rc 0/0 00000100:00100000:3.0:1746143844.361443:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5462 00000100:00100000:2.0:1746143844.362589:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625132416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19281us (19745us total) trans 0 rc 1769472/1769472 00000100:00100000:2.0:1746143844.362597:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7366 00002000:00100000:2.0:1746143844.362605:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012d842a00 x1830963625132416/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 504/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1769472/1769472 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.362614:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842a00 with x1830963625132416 ext(2097152->4194303) 00002000:00010000:2.0:1746143844.362619:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d842a00 00000100:00100000:2.0:1746143844.364582:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625132800 00000100:00100000:2.0:1746143844.364591:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625132800 00000100:00100000:2.0:1746143844.364731:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1001 00000100:00100000:2.0:1746143844.364743:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+281:2008:x1830963625132800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.364755:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.364776:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085200/0x87925e4cb73b5ebb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412277 expref: 281 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.364802:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.364806:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.364835:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+280:2008:x1830963625132800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.364840:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1001 00000100:00100000:3.0:1746143844.365349:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.365369:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625133184 00000100:00100000:1.0:1746143844.365374:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625133184 00000100:00100000:1.0:1746143844.365403:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16859 00000100:00100000:3.0:1746143844.365405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.365408:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625133184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.365419:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143844.365426:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625133312 00000100:00100000:3.0:1746143844.365429:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625133312 00010000:00010000:1.0:1746143844.365430:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841227e expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.365445:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.365447:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143844.365449:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16860 00010000:00010000:1.0:1746143844.365453:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 28 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143844.365454:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625133312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.365462:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.365464:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 28 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.365471:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5ed0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412285 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.365472:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d7fa00, rc 0) 00000100:00100000:1.0:1746143844.365495:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625133184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.365500:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16859 00000100:00100000:3.0:1746143844.365504:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627524224:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143844.365560:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00002000:00010000:3.0:1746143844.369539:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143843 -> 1746143844 00002000:00010000:3.0:1746143844.369545:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143843 -> 1746143844 00000100:00100000:3.0:1746143844.369562:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627524224:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143844.369590:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5ed0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412285 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.369601:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5ed0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412285 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.370274:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3a00, rc 0) 00000100:00100000:3.0:1746143844.370339:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625133312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4883us (4932us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143844.370348:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16860 00000100:00100000:0.0:1746143844.375108:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.375691:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625133440 00000100:00100000:3.0:1746143844.375700:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625133440 00000100:00100000:3.0:1746143844.376353:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16861 00000100:00100000:3.0:1746143844.376361:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625133440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.376378:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.376393:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5ed7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841228c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.376436:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627524352:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143844.376509:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.378855:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627524352:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143844.378882:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5ed7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841228c expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.378895:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5ed7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841228c expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.378906:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3000, rc 0) 00000100:00100000:3.0:1746143844.378965:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625133440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2605us (3864us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143844.378972:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16861 00000100:00100000:0.0:1746143844.382486:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.382762:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625133568 00000100:00100000:3.0:1746143844.382770:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625133568 00000100:00100000:3.0:1746143844.383134:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16862 00000100:00100000:3.0:1746143844.383142:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625133568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.383157:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.383171:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5ede lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412293 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.383216:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627524480:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143844.383797:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.388427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.388462:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.391038:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625133824 00000100:00100000:2.0:1746143844.391050:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625133824 00002000:00100000:2.0:1746143844.391095:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88012d843800 x1830963625133824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 504/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.391104:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843800 with x1830963625133824 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.391108:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843800 00000100:00100000:2.0:1746143844.391129:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625134080 00000100:00100000:2.0:1746143844.391131:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625134080 00002000:00100000:2.0:1746143844.391142:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d842d80 x1830963625134080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143844.391179:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7367 00000100:00100000:3.0:1746143844.391189:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625133824:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143844.391819:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842d80 with x1830963625134080 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.391823:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d842d80 00000100:00100000:2.0:1746143844.391846:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7368 00000100:00100000:2.0:1746143844.391852:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625134080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143844.392452:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627524480:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143844.392478:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5ede lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412293 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.392489:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5ede lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412293 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.392514:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:2.0:1746143844.392540:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625133568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9399us (10061us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143844.392546:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16862 00000100:00100000:2.0:1746143844.402946:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625134080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11086us (14474us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143844.402957:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7368 00002000:00100000:2.0:1746143844.402967:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012d842d80 x1830963625134080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.402976:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d842d80 with x1830963625134080 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.402982:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d842d80 00000100:00100000:0.0:1746143844.405264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.406253:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625134208 00000100:00100000:2.0:1746143844.406261:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625134208 00000100:00100000:2.0:1746143844.406303:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16863 00000100:00100000:2.0:1746143844.406319:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625134208:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143844.406334:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.406348:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73b5ee5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841229a expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.406392:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627524608:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143844.406459:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.406852:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625133824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15663us (18431us total) trans 0 rc 679936/679936 00000100:00100000:3.0:1746143844.406861:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7367 00002000:00100000:3.0:1746143844.406869:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88012d843800 x1830963625133824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 504/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 679936/679936 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.406877:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d843800 with x1830963625133824 ext(1048576->2097151) 00002000:00010000:3.0:1746143844.406881:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d843800 00000100:00100000:2.0:1746143844.409859:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627524608:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143844.409887:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73b5ee5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841229a expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.409899:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082085200/0x87925e4cb73b5ee5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841229a expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.410073:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085200, rc 0) 00000100:00100000:2.0:1746143844.410118:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625134208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3799us (4858us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143844.410126:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16863 00000100:00100000:0.0:1746143844.421027:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.421122:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625134336 00000100:00100000:2.0:1746143844.421130:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625134336 00000100:00100000:2.0:1746143844.421172:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16864 00000100:00100000:2.0:1746143844.421178:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+26:2915:x1830963625134336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143844.421194:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.421209:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122a1 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.421235:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.421242:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143844.421243:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143844.421247:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.421270:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.421285:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.421296:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627524736:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.421972:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.425739:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627524736:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.425777:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.425799:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00000100:00100000:2.0:1746143844.425859:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2915:x1830963625134336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4679us (4838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.425868:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16864 00000100:00100000:0.0:1746143844.426492:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.426661:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625134464 00000100:00100000:3.0:1746143844.426673:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625134464 00002000:00100000:3.0:1746143844.426719:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3174400->3502079) req@ffff88012d841f80 x1830963625134464/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.426728:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841f80 with x1830963625134464 ext(3174400->3502079) 00010000:00010000:3.0:1746143844.426736:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 13 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.426749:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 13 pid: 13430 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143844.426756:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d841f80 00000100:00100000:3.0:1746143844.427375:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2707 00000100:00100000:3.0:1746143844.427383:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625134464:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143844.433738:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625134464:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6348us (7240us total) trans 21474841283 rc 0/0 00000100:00100000:3.0:1746143844.433753:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2707 00002000:00100000:3.0:1746143844.433767:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3174400->3502079) req@ffff88012d841f80 x1830963625134464/t21474841283(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.433775:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d841f80 with x1830963625134464 ext(3174400->3502079) 00010000:00010000:3.0:1746143844.433784:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 15 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.433798:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 15 pid: 13430 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143844.433804:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d841f80 00000100:00100000:0.0:1746143844.442051:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.442190:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625134592 00000100:00100000:2.0:1746143844.442198:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625134592 00010000:00010000:2.0:1746143844.442230:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 15 pid: 13430 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.442263:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8257 00000100:00100000:2.0:1746143844.442270:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625134592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.442282:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.442297:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 15 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.442324:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 15 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.442345:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012323bc00/0x87925e4cb73b5e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3174400->3502079) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412254 expref: 15 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.442374:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.442376:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.442382:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.442390:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.442417:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.442427:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627524864:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.442499:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.445502:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627524864:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.445519:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.445551:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625134592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3280us (3508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.445559:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8257 00000100:00100000:0.0:1746143844.448362:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.448612:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625134848 00000100:00100000:3.0:1746143844.448623:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625134848 00002000:00100000:3.0:1746143844.448679:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012d840e00 x1830963625134848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.448690:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840e00 with x1830963625134848 ext(2097152->4194303) 00002000:00010000:3.0:1746143844.448694:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d840e00 00000100:00100000:3.0:1746143844.448726:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7369 00000100:00100000:3.0:1746143844.448734:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625134848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143844.461818:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625134848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13073us (13455us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143844.461832:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7369 00002000:00100000:3.0:1746143844.461845:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012d840e00 x1830963625134848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.461861:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840e00 with x1830963625134848 ext(2097152->4194303) 00002000:00010000:3.0:1746143844.461867:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d840e00 00000100:00100000:0.0:1746143844.507434:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.507548:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625135104 00000100:00100000:2.0:1746143844.507561:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625135104 00000100:00100000:2.0:1746143844.507626:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14055 00000100:00100000:2.0:1746143844.507634:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2919:x1830963625135104:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143844.507661:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.507683:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73b5ef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122a8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.507764:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507776:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507787:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507799:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507804:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507809:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507906:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.507994:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508000:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143844.508012:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143844.508080:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508086:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508091:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508097:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508102:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143844.508106:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508111:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508121:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143844.508123:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143844.508127:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.508131:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b5efa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509430:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509440:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509449:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509453:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143844.509456:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509461:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509470:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5b9df00) 00010000:00010000:2.0:1746143844.509472:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143844.509474:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509479:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085400/0x87925e4cb73b5f01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143844.509531:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73b5ef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.509542:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 25 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.509548:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.509549:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143844.509551:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084200, rc 0) 00000100:00100000:2.0:1746143844.509628:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2919:x1830963625135104:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1993us (2204us total) trans 8589945135 rc 0/0 00000100:00100000:2.0:1746143844.509636:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14055 00000100:00100000:0.0:1746143844.516026:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.516570:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625135360 00000100:00100000:3.0:1746143844.516581:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625135360 00000100:00100000:3.0:1746143844.516637:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5463 00000100:00100000:3.0:1746143844.516645:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2919:x1830963625135360:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143844.517505:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2919:x1830963625135360:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 858us (1486us total) trans 8589945136 rc 0/0 00000100:00100000:3.0:1746143844.517513:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5463 00000100:00100000:1.0:1746143844.522252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.522649:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625135488 00000100:00100000:2.0:1746143844.522661:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625135488 00000100:00100000:2.0:1746143844.522720:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16865 00000100:00100000:2.0:1746143844.522728:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2919:x1830963625135488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143844.522749:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.522769:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122af expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.522800:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 11 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.522809:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 27 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.522815:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.522816:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.522819:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.522852:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 27 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.522863:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 27 pid: 1947 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143844.522875:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627524992:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.523012:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 11 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.523021:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 11 pid: 1947 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.523028:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525120:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.523048:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.526107:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.526405:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625135616 00000100:00100000:3.0:1746143844.526416:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625135616 00000100:00100000:2.0:1746143844.526455:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.526457:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 12 pid: 1947 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.526498:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8258 00000100:00100000:3.0:1746143844.526506:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625135616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.526519:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.526540:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 12 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.526550:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 12 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.526571:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082086200/0x87925e4cb73b5e9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412270 expref: 12 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.526607:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.526649:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625135616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 144us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.526656:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8258 00000100:00100000:2.0:1746143844.526837:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627524992:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.526863:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [2056192->2097151] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.526874:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:2.0:1746143844.526896:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2919:x1830963625135488:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4169us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.526903:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16865 00000100:00100000:0.0:1746143844.528368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.528517:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625135744 00000100:00100000:2.0:1746143844.528524:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625135744 00010000:00010000:2.0:1746143844.528550:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 28 pid: 1947 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143844.528610:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8259 00000100:00100000:2.0:1746143844.528617:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625135744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.528629:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.528648:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 28 pid: 1947 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.528659:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 28 pid: 1947 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.528677:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b5ec9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841227e expref: 28 pid: 1947 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.528835:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.528838:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.528845:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.528854:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.528882:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.528894:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627525248:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.529144:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.531539:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627525248:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143844.532198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.532316:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625135872 00010000:00010000:2.0:1746143844.532319:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.532325:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625135872 00000100:00100000:2.0:1746143844.532370:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625135744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3751us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.532375:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16866 00000100:00100000:2.0:1746143844.532381:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8259 00000100:00100000:3.0:1746143844.532382:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2919:x1830963625135872:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.532398:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.532417:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122b6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.532444:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.532451:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.532457:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.532462:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.532463:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.532466:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->2154495] (req 2097152->2154495) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.532497:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.532506:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 26 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.532517:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525376:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.532572:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.532579:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 7 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:3.0:1746143844.532586:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.532606:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.532613:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.532619:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525632:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.532633:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.539523:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.539540:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525504:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.539743:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.540215:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625136000 00000100:00100000:2.0:1746143844.540224:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625136000 00010000:00010000:2.0:1746143844.540271:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00000100:00100000:2.0:1746143844.540320:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8260 00000100:00100000:2.0:1746143844.540328:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625136000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.540344:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1746143844.540349:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143844.540366:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.540376:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.540400:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ee76400/0x87925e4cb73b5d4f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121a5 expref: 8 pid: 9585 timeout: 1003 lvb_type: 1 00010000:00010000:2.0:1746143844.540420:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.540450:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627525632:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.540486:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2154495] (req 2097152->2154495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.540498:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:2.0:1746143844.541138:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963625136000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 808us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.541145:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8260 00000100:00100000:3.0:1746143844.541358:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2919:x1830963625135872:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8833us (9019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.541367:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16866 00000100:00100000:2.0:1746143844.547673:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.547673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.547721:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.547764:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.548038:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625136256 00000100:00100000:3.0:1746143844.548048:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625136256 00000100:00100000:3.0:1746143844.548094:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625136768 00000100:00100000:3.0:1746143844.548096:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625136768 00000100:00100000:3.0:1746143844.548303:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14056 00000100:00100000:0.0:1746143844.548333:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14057 00000100:00100000:2.0:1746143844.548342:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625136384 00000100:00100000:0.0:1746143844.548343:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+280:2922:x1830963625136768:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:2.0:1746143844.548345:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625136384 00010000:00010000:0.0:1746143844.548364:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.548369:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143844.548382:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b5f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122c4 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.548387:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625136512 00000100:00100000:2.0:1746143844.548389:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625136512 00010000:00010000:2.0:1746143844.548398:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 27 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.548409:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8261 00000100:00100000:2.0:1746143844.548413:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2010:x1830963625136384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.548421:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.548440:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.548449:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143844.548454:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548465:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.548467:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b5cfb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412174 expref: 11 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:0.0:1746143844.548474:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.548484:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143844.548486:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548494:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548498:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143844.548523:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2010:x1830963625136384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.548528:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8261 00000100:00100000:1.0:1746143844.548545:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8262 00000100:00100000:1.0:1746143844.548553:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137108850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625136512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143844.548561:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2924:x1830963625136256:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.548561:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.548570:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.548571:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 27 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.548576:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b5f39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122bd expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.548581:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 27 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:1.0:1746143844.548593:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133566200/0x87925e4cb73b5d25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484121b3 expref: 27 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.548602:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548605:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b5f47 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548609:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.548613:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.548613:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b5f47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548615:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.548615:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.548618:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b5f47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548621:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.548621:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.548626:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746143844.548626:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143844.548627:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.548631:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143844.548655:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.548660:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b5f5c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.548666:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b5f5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143844.548666:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627525760:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143844.548670:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b5f5c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143844.548676:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143844.548698:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548698:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548703:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.548709:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.548713:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548714:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548719:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548723:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143844.548726:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbee40 going to sleep for 11 seconds 00010000:00010000:3.0:1746143844.548727:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143844.548727:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.548730:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548730:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548736:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548736:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548744:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143844.548747:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143844.548750:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548751:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143844.548753:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.548754:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548755:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b5f2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548758:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548769:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548773:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548777:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548777:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548781:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.548785:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548787:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.548788:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.548790:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548790:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548794:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548794:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.548799:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013553d600) 00010000:00010000:3.0:1746143844.548801:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.548803:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548804:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013553d600) 00010000:00010000:0.0:1746143844.548805:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.548807:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143844.548807:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548811:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b5f32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.548840:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b5f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122c4 expref: 283 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.548850:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b5f47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122c4 expref: 282 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.548858:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143844.548860:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143844.548862:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33400, rc 0) 00000100:00100000:1.0:1746143844.548897:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+282:2922:x1830963625136768:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 557us (1133us total) trans 8589945137 rc 0/0 00000100:00100000:1.0:1746143844.548902:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14057 00010000:00010000:3.0:1746143844.549081:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2e00/0x87925e4cb73b5f39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122bd expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.549092:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b5f5c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122bd expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.549097:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.549099:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143844.549101:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3400, rc 0) 00000100:00100000:3.0:1746143844.549128:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2924:x1830963625136256:12345-192.168.202.3@tcp:101:cat.0 Request processed in 567us (1465us total) trans 8589945138 rc 0/0 00000100:00100000:3.0:1746143844.549133:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14056 00000100:00100000:1.0:1746143844.550643:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627525760:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143844.550662:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.551377:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137108850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625136512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2822us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.551387:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8262 00000100:00100000:0.0:1746143844.553499:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.553801:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.553861:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625137152 00000100:00100000:3.0:1746143844.553869:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625137152 00002000:00100000:3.0:1746143844.553935:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2150400->2154495) req@ffff880093cf9c00 x1830963625137152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.553945:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9c00 with x1830963625137152 ext(2150400->2154495) 00002000:00010000:3.0:1746143844.553949:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf9c00 00000100:00100000:3.0:1746143844.553977:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7370 00000100:00100000:3.0:1746143844.553984:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625137152:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143844.554109:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625137152:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 126us (618us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143844.554115:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7370 00002000:00100000:3.0:1746143844.554120:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2150400->2154495) req@ffff880093cf9c00 x1830963625137152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.554125:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9c00 with x1830963625137152 ext(2150400->2154495) 00002000:00010000:3.0:1746143844.554127:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf9c00 00000100:00100000:2.0:1746143844.554263:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.554291:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.554314:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625136896 00000100:00100000:2.0:1746143844.554317:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625136896 00000100:00100000:2.0:1746143844.554340:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625137280 00000100:00100000:2.0:1746143844.554342:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625137280 00000100:00100000:2.0:1746143844.554554:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1002 00000100:00100000:2.0:1746143844.554560:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:2009:x1830963625136896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.554570:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.554593:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33400/0x87925e4cb73b5f47 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122c4 expref: 282 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.554608:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.554613:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.554630:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:2009:x1830963625136896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.554634:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1002 00000100:00100000:2.0:1746143844.554643:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1003 00000100:00100000:2.0:1746143844.554647:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625137280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.554652:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.554661:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b5f5c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122bd expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.554668:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.554670:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.554679:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625137280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.554683:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1003 00000100:00100000:3.0:1746143844.555026:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625137536 00000100:00100000:3.0:1746143844.555031:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625137536 00000100:00100000:3.0:1746143844.555332:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5464 00000100:00100000:3.0:1746143844.555337:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2924:x1830963625137536:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143844.555479:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2924:x1830963625137536:12345-192.168.202.3@tcp:35:cat.0 Request processed in 142us (1217us total) trans 8589945139 rc 0/0 00000100:00100000:3.0:1746143844.555485:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5464 00000100:00100000:0.0:1746143844.558808:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.558857:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.558936:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625137664 00000100:00100000:3.0:1746143844.558945:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625137664 00000100:00100000:3.0:1746143844.559058:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625137792 00000100:00100000:3.0:1746143844.559061:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625137792 00000100:00100000:1.0:1746143844.559109:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16867 00000100:00100000:1.0:1746143844.559118:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625137664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.559135:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.559152:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b5f6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122cb expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.559208:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627525888:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143844.559289:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.559703:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16868 00000100:00100000:2.0:1746143844.559713:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625137792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143844.559727:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.559736:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122d2 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.559752:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.559754:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.559763:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.559777:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.559787:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084c00, rc 0) 00000100:00100000:2.0:1746143844.559826:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625137792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 115us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.559832:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16868 00000100:00100000:0.0:1746143844.561520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.561790:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625137920 00000100:00100000:2.0:1746143844.561799:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625137920 00000100:00100000:2.0:1746143844.561842:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16869 00000100:00100000:2.0:1746143844.561850:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+26:2922:x1830963625137920:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143844.561864:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.561877:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122d9 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.561994:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627525888:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143844.562217:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b5f6a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122cb expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.562229:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3800/0x87925e4cb73b5f6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122cb expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.562252:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3800, rc 0) 00000100:00100000:1.0:1746143844.562292:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625137664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3175us (3493us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143844.562297:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16867 00010000:00010000:3.0:1746143844.562704:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.562713:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.562715:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.562718:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2289664->2527231] (req 2289664->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.562748:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.562761:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 9 pid: 13430 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.562774:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627526016:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.563127:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.565685:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627526016:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.565721:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2289664->2527231] (req 2289664->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.565742:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085200, rc 0) 00000100:00100000:3.0:1746143844.565789:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2922:x1830963625137920:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3939us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.565798:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16869 00000100:00100000:0.0:1746143844.567060:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.567167:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625138048 00000100:00100000:2.0:1746143844.567177:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625138048 00002000:00100000:2.0:1746143844.567251:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2154495) req@ffff880093cf8380 x1830963625138048/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.567262:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8380 with x1830963625138048 ext(2097152->2154495) 00010000:00010000:2.0:1746143844.567270:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 10 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.567285:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 10 pid: 13430 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.567292:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cf8380 00000100:00100000:2.0:1746143844.567331:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2708 00000100:00100000:2.0:1746143844.567339:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625138048:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143844.568332:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.568768:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625138176 00000100:00100000:3.0:1746143844.568775:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625138176 00000100:00100000:3.0:1746143844.568863:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16870 00000100:00100000:3.0:1746143844.568870:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2924:x1830963625138176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.568883:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.568899:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122e0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.568949:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 26 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.568957:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.568958:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.568962:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 16 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.568991:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 26 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.569002:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 26 pid: 1947 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.569016:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627526144:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.569079:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.569876:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625138048:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 2532us (2816us total) trans 17179874011 rc 0/0 00000100:00100000:2.0:1746143844.569886:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2708 00002000:00100000:2.0:1746143844.569896:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2154495) req@ffff880093cf8380 x1830963625138048/t17179874011(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.569904:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8380 with x1830963625138048 ext(2097152->2154495) 00010000:00010000:2.0:1746143844.569941:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.569952:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.569958:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cf8380 00000100:00100000:3.0:1746143844.570684:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627526144:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.570707:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 16 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.570721:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3a00, rc 0) 00000100:00100000:3.0:1746143844.570744:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2924:x1830963625138176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1875us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.570750:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16870 00000100:00100000:0.0:1746143844.571763:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.571823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.571884:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625138304 00000100:00100000:2.0:1746143844.571893:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625138304 00002000:00100000:2.0:1746143844.571949:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1122304->1490943) req@ffff880093cfad80 x1830963625138304/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.571957:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfad80 with x1830963625138304 ext(1122304->1490943) 00010000:00010000:2.0:1746143844.571965:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 27 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.571979:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 27 pid: 1947 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.571985:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cfad80 00000100:00100000:2.0:1746143844.572003:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2709 00000100:00100000:2.0:1746143844.572011:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625138304:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143844.572186:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625138432 00000100:00100000:3.0:1746143844.572190:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625138432 00010000:00010000:3.0:1746143844.572211:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.572243:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8263 00000100:00100000:3.0:1746143844.572249:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625138432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.572259:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143844.572345:0:7230:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143843 -> 1746143844 00002000:00010000:3.0:1746143844.572348:0:7230:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143843 -> 1746143844 00010000:00010000:3.0:1746143844.572355:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.572364:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.572386:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2600/0x87925e4cb73b5f1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2154495) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122b6 expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.572463:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.572465:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.572473:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.572481:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.572511:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.572522:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627526272:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.572852:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.575971:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.575998:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625138688 00000100:00100000:0.0:1746143844.576006:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625138688 00002000:00100000:0.0:1746143844.576045:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2289664->2293759) req@ffff880093cf8700 x1830963625138688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.576054:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8700 with x1830963625138688 ext(2289664->2293759) 00002000:00010000:0.0:1746143844.576058:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8700 00000100:00100000:3.0:1746143844.576060:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627526272:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143844.576088:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7371 00000100:00100000:0.0:1746143844.576096:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625138688:12345-192.168.202.3@tcp:3:multiop.0 00010000:00010000:3.0:1746143844.576130:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.576170:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625138432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3921us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.576180:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8263 00000100:00100000:0.0:1746143844.576181:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625138688:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 86us (221us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143844.576216:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7371 00002000:00100000:0.0:1746143844.576220:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2289664->2293759) req@ffff880093cf8700 x1830963625138688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.576227:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8700 with x1830963625138688 ext(2289664->2293759) 00002000:00010000:0.0:1746143844.576230:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8700 00000100:00100000:2.0:1746143844.577152:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625138304:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5138us (5388us total) trans 21474841284 rc 0/0 00000100:00100000:2.0:1746143844.577163:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2709 00002000:00100000:2.0:1746143844.577170:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1122304->1490943) req@ffff880093cfad80 x1830963625138304/t21474841284(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.577178:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfad80 with x1830963625138304 ext(1122304->1490943) 00010000:00010000:2.0:1746143844.577186:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 29 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.577200:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 29 pid: 1947 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.577206:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cfad80 00000100:00100000:0.0:1746143844.581364:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.581422:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.581506:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625139072 00000100:00100000:2.0:1746143844.581516:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625139072 00002000:00100000:2.0:1746143844.581560:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2523136->2527231) req@ffff880093cf9880 x1830963625139072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.581575:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9880 with x1830963625139072 ext(2523136->2527231) 00002000:00010000:2.0:1746143844.581580:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf9880 00000100:00100000:2.0:1746143844.581597:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7372 00000100:00100000:2.0:1746143844.581603:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625139072:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143844.581744:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625138816 00000100:00100000:3.0:1746143844.581748:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625138816 00000100:00100000:2.0:1746143844.581751:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625139072:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 148us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143844.581757:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7372 00002000:00100000:2.0:1746143844.581762:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2523136->2527231) req@ffff880093cf9880 x1830963625139072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746143844.581769:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 29 pid: 1947 timeout: 1003 lvb_type: 0 00002000:00100000:2.0:1746143844.581769:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9880 with x1830963625139072 ext(2523136->2527231) 00002000:00010000:2.0:1746143844.581771:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf9880 00000100:00100000:3.0:1746143844.581793:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8264 00000100:00100000:3.0:1746143844.581798:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625138816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.581806:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.581826:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 29 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.581836:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 29 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.581859:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082087000/0x87925e4cb73b5e98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1122304->1490943) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412269 expref: 29 pid: 1947 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.581877:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.581879:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.582125:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.582135:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.582165:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.582177:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627526400:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.584483:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.585647:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.585799:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625139328 00000100:00100000:1.0:1746143844.585810:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625139328 00000100:00100000:1.0:1746143844.585871:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5465 00000100:00100000:1.0:1746143844.585880:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e249050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+281:2922:x1830963625139328:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143844.586136:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e249050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+282:2922:x1830963625139328:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 257us (496us total) trans 8589945140 rc 0/0 00000100:00100000:1.0:1746143844.586142:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5465 00000100:00100000:3.0:1746143844.587724:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627526400:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143844.587747:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.587786:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625138816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5986us (6362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.587795:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8264 00000100:00100000:0.0:1746143844.591627:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.591707:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.592297:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625139584 00000100:00100000:3.0:1746143844.592365:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625139840 00000100:00100000:3.0:1746143844.592372:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625139840 00002000:00100000:3.0:1746143844.592415:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2056191) req@ffff88011e30bb80 x1830963625139840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.592425:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30bb80 with x1830963625139840 ext(1048576->2056191) 00002000:00010000:3.0:1746143844.592430:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30bb80 00000100:00100000:2.0:1746143844.592551:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625139584 00002000:00100000:2.0:1746143844.592570:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880093cf9500 x1830963625139584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.592576:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9500 with x1830963625139584 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.592579:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9500 00000100:00100000:3.0:1746143844.592666:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7373 00000100:00100000:3.0:1746143844.592673:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625139840:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143844.593062:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7374 00000100:00100000:2.0:1746143844.593068:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625139584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143844.604432:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625139840:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11747us (12712us total) trans 0 rc 1007616/1007616 00000100:00100000:2.0:1746143844.604432:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625139584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11352us (12803us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143844.604443:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7374 00000100:00100000:3.0:1746143844.604448:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7373 00002000:00100000:3.0:1746143844.604456:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2056191) req@ffff88011e30bb80 x1830963625139840/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.604456:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880093cf9500 x1830963625139584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.604465:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30bb80 with x1830963625139840 ext(1048576->2056191) 00002000:00100000:2.0:1746143844.604465:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9500 with x1830963625139584 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.604470:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9500 00002000:00010000:3.0:1746143844.604471:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30bb80 00000100:00100000:0.0:1746143844.613999:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.614614:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625139968 00000100:00100000:3.0:1746143844.614626:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625139968 00000100:00100000:3.0:1746143844.614684:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16871 00000100:00100000:3.0:1746143844.614692:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2924:x1830963625139968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.614712:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.614731:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122e7 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.616725:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.616734:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.616736:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.616740:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.616778:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 26 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.616791:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 26 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.616806:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627526528:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.616930:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.619710:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627526528:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.619746:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.619764:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3400, rc 0) 00000100:00100000:3.0:1746143844.619806:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2924:x1830963625139968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5114us (5818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.619814:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16871 00000100:00100000:0.0:1746143844.622543:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.623089:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625140096 00000100:00100000:3.0:1746143844.623099:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625140096 00002000:00100000:3.0:1746143844.623151:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2289664->2527231) req@ffff88011e30aa00 x1830963625140096/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.623160:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30aa00 with x1830963625140096 ext(2289664->2527231) 00010000:00010000:3.0:1746143844.623169:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 27 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.623183:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 27 pid: 3135 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143844.623190:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e30aa00 00000100:00100000:3.0:1746143844.623270:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2710 00000100:00100000:3.0:1746143844.623278:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625140096:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143844.629421:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625140096:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6072us (6816us total) trans 17179874012 rc 0/0 00000100:00100000:3.0:1746143844.629435:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2710 00002000:00100000:3.0:1746143844.629457:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2289664->2527231) req@ffff88011e30aa00 x1830963625140096/t17179874012(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.629467:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30aa00 with x1830963625140096 ext(2289664->2527231) 00010000:00010000:3.0:1746143844.629482:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 29 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.629498:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 29 pid: 3135 timeout: 1003 lvb_type: 0 00002000:00010000:3.0:1746143844.629509:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e30aa00 00000100:00100000:0.0:1746143844.635480:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.635604:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625140224 00000100:00100000:3.0:1746143844.635615:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625140224 00010000:00010000:3.0:1746143844.635655:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 29 pid: 3135 timeout: 1003 lvb_type: 0 00000100:00100000:3.0:1746143844.635686:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8265 00000100:00100000:3.0:1746143844.635693:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625140224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.635708:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143844.635725:0:7230:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143844 -> 1746143845 00002000:00010000:3.0:1746143844.635728:0:7230:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143844 -> 1746143845 00010000:00010000:3.0:1746143844.635734:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 29 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.635746:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 29 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.635769:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082085200/0x87925e4cb73b5f78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d9 expref: 29 pid: 3135 timeout: 1003 lvb_type: 0 00010000:00010000:3.0:1746143844.636097:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.636100:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.636108:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.636117:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.636152:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.636166:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627526656:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.636618:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.638762:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627526656:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143844.638785:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.638827:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625140224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3133us (3356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.638837:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8265 00000100:00100000:1.0:1746143844.647084:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.647445:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625140480 00000100:00100000:3.0:1746143844.647459:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625140480 00002000:00100000:3.0:1746143844.647508:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009eb85500 x1830963625140480/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.647518:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85500 with x1830963625140480 ext(2097152->4194303) 00002000:00010000:3.0:1746143844.647523:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85500 00000100:00100000:3.0:1746143844.648077:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7375 00000100:00100000:3.0:1746143844.648087:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625140480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143844.648764:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.648938:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625140736 00000100:00100000:1.0:1746143844.648944:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625140736 00002000:00100000:1.0:1746143844.648973:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88011e308700 x1830963625140736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.648983:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308700 with x1830963625140736 ext(2097152->4194303) 00002000:00010000:1.0:1746143844.648988:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e308700 00000100:00100000:1.0:1746143844.649013:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7376 00000100:00100000:1.0:1746143844.649019:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625140736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143844.664452:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625140480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16353us (17364us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143844.664466:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7375 00002000:00100000:3.0:1746143844.664480:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009eb85500 x1830963625140480/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.664496:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb85500 with x1830963625140480 ext(2097152->4194303) 00002000:00010000:3.0:1746143844.664503:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb85500 00000100:00100000:1.0:1746143844.671957:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625140736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22923us (23179us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143844.671971:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7376 00002000:00100000:1.0:1746143844.671982:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88011e308700 x1830963625140736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.671993:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308700 with x1830963625140736 ext(2097152->4194303) 00002000:00010000:1.0:1746143844.671999:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e308700 00000100:00100000:1.0:1746143844.691165:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.692577:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625141248 00000100:00100000:3.0:1746143844.692591:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625141248 00000100:00100000:3.0:1746143844.692647:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14058 00000100:00100000:3.0:1746143844.692655:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:2930:x1830963625141248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.692682:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.692702:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122ee expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.692779:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692792:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692803:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692817:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692823:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692828:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692944:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5fa2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692959:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.692965:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143844.692974:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143844.693048:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693055:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693060:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693066:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693072:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.693076:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693081:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693092:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143844.693095:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.693099:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.693104:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694509:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694523:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694528:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694532:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.694534:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694539:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694549:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ec00) 00010000:00010000:3.0:1746143844.694551:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.694554:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694558:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5f9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.694617:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5f8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122ee expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.694631:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122ee expref: 284 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.694637:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.694639:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143844.694642:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849e00, rc 0) 00000100:00100000:3.0:1746143844.694722:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2930:x1830963625141248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2067us (3568us total) trans 8589945141 rc 0/0 00000100:00100000:3.0:1746143844.694730:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14058 00000100:00100000:0.0:1746143844.695445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.696694:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625140992 00000100:00100000:0.0:1746143844.696705:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625140992 00002000:00100000:0.0:1746143844.696757:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88011e308000 x1830963625140992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.696767:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308000 with x1830963625140992 ext(4194304->4853759) 00002000:00010000:0.0:1746143844.696772:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308000 00000100:00100000:3.0:1746143844.696876:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7377 00000100:00100000:3.0:1746143844.696885:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625140992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143844.704541:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.704587:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.704938:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625141504 00000100:00100000:0.0:1746143844.704954:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625141504 00000100:00100000:0.0:1746143844.704997:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5466 00000100:00100000:0.0:1746143844.705004:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2930:x1830963625141504:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143844.705127:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625141632 00000100:00100000:3.0:1746143844.705134:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625141632 00000100:00100000:3.0:1746143844.705178:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1004 00000100:00100000:3.0:1746143844.705185:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2008:x1830963625141632:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143844.705186:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2930:x1830963625141504:12345-192.168.202.3@tcp:35:cat.0 Request processed in 181us (655us total) trans 8589945142 rc 0/0 00000100:00100000:0.0:1746143844.705193:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5466 00010000:00010000:3.0:1746143844.705197:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.705224:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b5fa2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122ee expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.705252:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.705257:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.705288:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963625141632:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 103us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.705294:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1004 00000100:00100000:3.0:1746143844.705383:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625140992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8499us (9940us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143844.705391:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7377 00002000:00100000:3.0:1746143844.705399:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88011e308000 x1830963625140992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.705414:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308000 with x1830963625140992 ext(4194304->4853759) 00002000:00010000:3.0:1746143844.705419:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308000 00000100:00100000:0.0:1746143844.722230:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.722271:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.722885:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.724480:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625141760 00000100:00100000:1.0:1746143844.724480:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625142016 00000100:00100000:3.0:1746143844.724493:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625141760 00000100:00100000:1.0:1746143844.724493:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625142016 00000100:00100000:1.0:1746143844.724548:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625141888 00000100:00100000:1.0:1746143844.724551:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625141888 00000100:00100000:3.0:1746143844.724558:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16872 00000100:00100000:3.0:1746143844.724566:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625142016:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143844.724572:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16873 00000100:00100000:1.0:1746143844.724578:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625141760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.724585:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.724587:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.724603:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412303 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.724603:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122f5 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.724611:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16874 00000100:00100000:2.0:1746143844.724621:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625141888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.724624:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.724624:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.724626:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.724626:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.724629:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.724634:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.724634:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.724637:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b5fbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484122fc expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.724648:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 29 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.724649:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 30 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.724658:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a8c00, rc 0) 00010000:00010000:3.0:1746143844.724659:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849e00, rc 0) 00000100:00100000:3.0:1746143844.724710:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625142016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 145us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.724710:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625141760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 132us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.724716:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16872 00000100:00100000:1.0:1746143844.724719:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16873 00000100:00100000:2.0:1746143844.724822:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627526784:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143844.724894:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.727592:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143844.727714:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143844.727718:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143844.727720:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143844 -> 1746143845 00000100:00100000:0.0:1746143844.727741:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627526784:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143844.727779:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b5fbe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122fc expref: 30 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.727793:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323b200/0x87925e4cb73b5fbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122fc expref: 30 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.727807:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323b200, rc 0) 00000100:00100000:0.0:1746143844.727848:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625141888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3230us (4964us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143844.727856:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16874 00000100:00100000:3.0:1746143844.728110:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625142272 00000100:00100000:3.0:1746143844.728117:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625142272 00000100:00100000:3.0:1746143844.728171:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14059 00000100:00100000:3.0:1746143844.728178:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2932:x1830963625142272:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.728197:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.728214:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841230a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.728287:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728300:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728320:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728332:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728338:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728346:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728569:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b5fda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728579:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b5fda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728584:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b5fda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143844.728593:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143844.728673:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728683:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728688:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728694:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728699:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.728702:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728708:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728718:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143844.728721:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.728725:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728729:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b5fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728752:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728757:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728761:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728765:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143844.728768:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728776:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728782:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632e700) 00010000:00010000:3.0:1746143844.728784:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143844.728787:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728791:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b5fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143844.728824:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3000/0x87925e4cb73b5fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841230a expref: 287 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.728835:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b5fda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841230a expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.728841:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.728843:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143844.728845:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3600, rc 0) 00000100:00100000:3.0:1746143844.728880:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2932:x1830963625142272:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 703us (1299us total) trans 8589945143 rc 0/0 00000100:00100000:3.0:1746143844.728886:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14059 00000100:00100000:0.0:1746143844.732320:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.732676:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625142400 00000100:00100000:3.0:1746143844.732686:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625142400 00000100:00100000:3.0:1746143844.732806:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1005 00000100:00100000:3.0:1746143844.732814:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2011:x1830963625142400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.732835:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.732861:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b5fda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841230a expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.732877:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.732882:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.732965:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2011:x1830963625142400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 152us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.732972:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1005 00000100:00100000:0.0:1746143844.733701:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.733786:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625142656 00000100:00100000:3.0:1746143844.733791:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625142656 00002000:00100000:3.0:1746143844.733824:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88011e30a680 x1830963625142656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.733833:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a680 with x1830963625142656 ext(1048576->2097151) 00002000:00010000:3.0:1746143844.733837:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e30a680 00000100:00100000:3.0:1746143844.733862:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7378 00000100:00100000:3.0:1746143844.733868:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625142656:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143844.743734:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625142656:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9854us (10028us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143844.743747:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7378 00002000:00100000:3.0:1746143844.743758:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88011e30a680 x1830963625142656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.745254:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a680 with x1830963625142656 ext(1048576->2097151) 00002000:00010000:3.0:1746143844.745266:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e30a680 00000100:00100000:0.0:1746143844.750374:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.750449:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625142784 00000100:00100000:2.0:1746143844.750460:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625142784 00000100:00100000:2.0:1746143844.750529:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16875 00000100:00100000:2.0:1746143844.750542:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2930:x1830963625142784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143844.750563:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.750585:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412311 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.750618:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.750626:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143844.750629:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143844.750632:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.750666:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.750678:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 11 pid: 13430 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.750690:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627526912:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.750786:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.757737:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627526912:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.757775:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.757792:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323a800, rc 0) 00000100:00100000:3.0:1746143844.758063:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2930:x1830963625142784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7524us (7700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.758072:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16875 00000100:00100000:3.0:1746143844.758152:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.758342:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625142912 00000100:00100000:2.0:1746143844.758350:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625142912 00002000:00100000:2.0:1746143844.758390:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (2056192->2097151) req@ffff88007f649180 x1830963625142912/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.758398:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963625142912 ext(2056192->2097151) 00010000:00010000:2.0:1746143844.758406:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.758418:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 12 pid: 13430 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.758424:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f649180 00000100:00100000:2.0:1746143844.758452:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2711 00000100:00100000:2.0:1746143844.758460:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625142912:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143844.768107:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625142912:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9640us (9946us total) trans 17179874013 rc 0/0 00000100:00100000:2.0:1746143844.768119:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2711 00002000:00100000:2.0:1746143844.768130:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (2056192->2097151) req@ffff88007f649180 x1830963625142912/t17179874013(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.768140:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649180 with x1830963625142912 ext(2056192->2097151) 00010000:00010000:2.0:1746143844.768148:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 14 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.768162:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 14 pid: 13430 timeout: 1003 lvb_type: 0 00002000:00010000:2.0:1746143844.768168:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88007f649180 00000100:00100000:0.0:1746143844.771518:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.771621:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625143040 00000100:00100000:2.0:1746143844.771631:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625143040 00010000:00010000:2.0:1746143844.771674:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 14 pid: 13430 timeout: 1003 lvb_type: 0 00000100:00100000:2.0:1746143844.771716:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8266 00000100:00100000:2.0:1746143844.771725:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625143040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.771740:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.771762:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 14 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.771776:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 14 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.771805:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b5f16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2056192->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122af expref: 14 pid: 13430 timeout: 1003 lvb_type: 0 00010000:00010000:2.0:1746143844.771838:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.771840:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.771848:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 29 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.771858:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 29 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.771894:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 29 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.771906:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627527040:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.772003:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.773686:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627527040:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.773708:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.773753:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625143040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2028us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.773762:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8266 00000100:00100000:0.0:1746143844.774813:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.774949:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625143296 00000100:00100000:2.0:1746143844.774957:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625143296 00002000:00100000:2.0:1746143844.774996:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88011e30ad80 x1830963625143296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.775010:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30ad80 with x1830963625143296 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.775015:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30ad80 00000100:00100000:2.0:1746143844.775045:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7379 00000100:00100000:2.0:1746143844.775052:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625143296:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143844.782507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.782576:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625143552 00000100:00100000:3.0:1746143844.782586:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625143552 00000100:00100000:2.0:1746143844.783581:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625143296:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8524us (8764us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143844.783592:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7379 00002000:00100000:2.0:1746143844.783604:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88011e30ad80 x1830963625143296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.783614:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30ad80 with x1830963625143296 ext(1048576->2097151) 00002000:00010000:2.0:1746143844.783620:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30ad80 00000100:00100000:1.0:1746143844.783969:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14060 00000100:00100000:1.0:1746143844.783978:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2935:x1830963625143552:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143844.783995:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.784012:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b5fef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412318 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.784075:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784085:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784095:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784105:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784109:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784117:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784368:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b6004 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784385:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b6004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784396:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b6004 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:1.0:1746143844.784407:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143844.784511:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784518:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784522:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784528:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784533:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143844.784536:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784542:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784551:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143844.784554:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143844.784557:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784562:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8800/0x87925e4cb73b5ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784865:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784870:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784874:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784878:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143844.784880:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784885:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784892:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800973cc200) 00010000:00010000:1.0:1746143844.784894:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143844.784896:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.784900:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b5ffd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.785530:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b5fef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412318 expref: 31 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.785549:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b6004 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412318 expref: 30 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.785555:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143844.785557:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143844.785560:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a9c00, rc 0) 00000100:00100000:1.0:1746143844.785622:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2935:x1830963625143552:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1644us (3124us total) trans 8589945144 rc 0/0 00000100:00100000:1.0:1746143844.785630:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14060 00000100:00100000:0.0:1746143844.793734:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.793825:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.793939:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625143936 00000100:00100000:1.0:1746143844.793947:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625143936 00000100:00100000:3.0:1746143844.794241:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625143680 00000100:00100000:3.0:1746143844.794245:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625143680 00000100:00100000:3.0:1746143844.794274:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1006 00000100:00100000:3.0:1746143844.794280:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625143680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.794291:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.794321:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a9c00/0x87925e4cb73b6004 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412318 expref: 31 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.794339:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.794343:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.794379:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5467 00000100:00100000:1.0:1746143844.794386:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2935:x1830963625143936:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143844.794899:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625143680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 261us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.794905:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1006 00000100:00100000:1.0:1746143844.795021:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2935:x1830963625143936:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 633us (1194us total) trans 8589945145 rc 0/0 00000100:00100000:1.0:1746143844.795027:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5467 00000100:00100000:0.0:1746143844.795899:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.797839:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625144192 00000100:00100000:2.0:1746143844.797848:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625144192 00002000:00100000:2.0:1746143844.797883:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88011e30b800 x1830963625144192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.797891:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b800 with x1830963625144192 ext(2097152->4194303) 00002000:00010000:2.0:1746143844.797895:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30b800 00000100:00100000:2.0:1746143844.797932:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7380 00000100:00100000:2.0:1746143844.797938:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625144192:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143844.816218:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625144192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18270us (20310us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143844.816229:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7380 00002000:00100000:2.0:1746143844.816242:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88011e30b800 x1830963625144192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.816250:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b800 with x1830963625144192 ext(2097152->4194303) 00002000:00010000:2.0:1746143844.816255:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e30b800 00000100:00100000:0.0:1746143844.818897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.820097:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625144320 00000100:00100000:3.0:1746143844.820107:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625144320 00000100:00100000:3.0:1746143844.822143:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16876 00000100:00100000:3.0:1746143844.822157:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2935:x1830963625144320:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.822173:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.822187:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841231f expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.822214:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.822222:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.822227:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.822229:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.822232:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.822255:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.822265:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 29 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143844.822275:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627527168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.822373:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.822381:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.822390:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627527296:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.822405:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.829314:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.829349:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.829958:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627527168:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.829968:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627527296:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.829995:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3137536->3145727] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 14 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.830009:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8200, rc 0) 00000100:00100000:3.0:1746143844.830048:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2935:x1830963625144320:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7896us (11156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.830056:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16876 00000100:00100000:3.0:1746143844.830079:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625144448 00000100:00100000:3.0:1746143844.830084:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625144448 00000100:00100000:3.0:1746143844.830117:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16877 00000100:00100000:3.0:1746143844.830123:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2932:x1830963625144448:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.830135:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.830146:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412326 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.830165:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.830171:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.830173:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.830176:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1138688->1904639] (req 1138688->1904639) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.830196:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.830205:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 31 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.830215:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627527424:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.830259:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.830276:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.830765:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625144704 00000100:00100000:2.0:1746143844.830769:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625144704 00002000:00100000:2.0:1746143844.830792:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8801368ea680 x1830963625144704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.830800:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea680 with x1830963625144704 ext(4194304->4853759) 00010000:00010000:2.0:1746143844.830806:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 32 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143844.830816:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 32 pid: 3135 timeout: 1004 lvb_type: 1 00002000:00010000:2.0:1746143844.830825:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ea680 00000100:00100000:2.0:1746143844.830840:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2712 00000100:00100000:2.0:1746143844.830846:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625144704:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143844.831117:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625144832 00000100:00100000:3.0:1746143844.831121:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625144832 00010000:00010000:3.0:1746143844.831135:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.831160:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8267 00000100:00100000:3.0:1746143844.831165:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625144832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.831172:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.831183:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.831191:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.831207:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3400/0x87925e4cb73b5f86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e7 expref: 14 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.831223:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.831316:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625144832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.831321:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8267 00000100:00100000:0.0:1746143844.836669:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.836831:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625144960 00000100:00100000:2.0:1746143844.836838:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625144960 00010000:00010000:2.0:1746143844.836869:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 34 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.836894:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8268 00000100:00100000:2.0:1746143844.836901:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625144960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.836937:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.836955:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 34 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.836964:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 34 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.837465:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.837467:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.837473:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.837480:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.837511:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.837522:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627527552:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.837601:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00010000:00010000:3.0:1746143844.838081:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012323a800/0x87925e4cb73b5fe8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412311 expref: 34 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.838098:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627527424:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.838115:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.838123:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625144704:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7276us (8772us total) trans 0 rc 659456/659456 00010000:00010000:3.0:1746143844.838124:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8c00, rc 0) 00000100:00100000:2.0:1746143844.838131:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2712 00002000:00100000:2.0:1746143844.838138:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8801368ea680 x1830963625144704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/440 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.838145:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea680 with x1830963625144704 ext(4194304->4853759) 00000100:00100000:3.0:1746143844.838146:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2932:x1830963625144448:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8023us (8847us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143844.838151:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 32 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143844.838152:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16877 00010000:00010000:2.0:1746143844.838160:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 32 pid: 3135 timeout: 1004 lvb_type: 1 00002000:00010000:2.0:1746143844.838165:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368ea680 00000100:00100000:0.0:1746143844.840614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.840906:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627527552:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.840959:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.841001:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625144960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4100us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.841011:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8268 00000100:00100000:3.0:1746143844.841181:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625145216 00000100:00100000:3.0:1746143844.841188:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625145216 00002000:00100000:3.0:1746143844.841218:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1142783) req@ffff8801368e9180 x1830963625145216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.841227:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963625145216 ext(1138688->1142783) 00002000:00010000:3.0:1746143844.841231:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:3.0:1746143844.841245:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7381 00000100:00100000:3.0:1746143844.841250:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625145216:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143844.841359:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625145216:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (751us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143844.841364:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7381 00002000:00100000:3.0:1746143844.841369:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1142783) req@ffff8801368e9180 x1830963625145216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.841376:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9180 with x1830963625145216 ext(1138688->1142783) 00002000:00010000:3.0:1746143844.841378:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9180 00000100:00100000:0.0:1746143844.842161:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.842807:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625145344 00000100:00100000:3.0:1746143844.842812:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625145344 00000100:00100000:3.0:1746143844.842849:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16878 00000100:00100000:3.0:1746143844.842855:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625145344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143844.842864:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.842877:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6020 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841232d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.842894:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.842902:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6020 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841232d expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.842927:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6020 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841232d expref: 31 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.842936:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8400, rc 0) 00000100:00100000:3.0:1746143844.842970:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625145344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 115us (809us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143844.842975:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16878 00000100:00100000:0.0:1746143844.844864:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.844935:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625145472 00000100:00100000:2.0:1746143844.844941:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625145472 00010000:00010000:2.0:1746143844.844963:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 30 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.844984:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8269 00000100:00100000:2.0:1746143844.844990:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625145472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.844999:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.845015:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 30 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143844.845024:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 30 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143844.845047:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b5fb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412303 expref: 30 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143844.845071:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.845073:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.845079:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.845087:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.845114:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.845124:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627527680:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143844.845195:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.848267:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627527680:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143844.848286:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.848330:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625145472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3339us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.848339:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8269 00000100:00100000:0.0:1746143844.849668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.849709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.850094:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.850120:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625145728 00000100:00100000:3.0:1746143844.850127:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625145728 00000100:00100000:1.0:1746143844.850142:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625145984 00000100:00100000:1.0:1746143844.850146:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625145984 00002000:00100000:3.0:1746143844.850161:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3137536->3141631) req@ffff8801368ea300 x1830963625145728/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.850161:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1900544->1904639) req@ffff8801368e9500 x1830963625145984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.850169:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963625145728 ext(3137536->3141631) 00002000:00100000:1.0:1746143844.850169:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963625145984 ext(1900544->1904639) 00002000:00010000:3.0:1746143844.850173:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ea300 00002000:00010000:1.0:1746143844.850173:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:3.0:1746143844.850188:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7382 00000100:00100000:3.0:1746143844.850193:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625145728:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143844.850193:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7383 00000100:00100000:1.0:1746143844.850197:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625145984:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143844.850285:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625145984:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 87us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143844.850292:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7383 00002000:00100000:1.0:1746143844.850296:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1900544->1904639) req@ffff8801368e9500 x1830963625145984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.850312:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9500 with x1830963625145984 ext(1900544->1904639) 00002000:00010000:1.0:1746143844.850315:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9500 00000100:00100000:3.0:1746143844.850408:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625145728:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 214us (743us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143844.850413:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7382 00002000:00100000:3.0:1746143844.850418:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3137536->3141631) req@ffff8801368ea300 x1830963625145728/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.850424:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ea300 with x1830963625145728 ext(3137536->3141631) 00002000:00010000:3.0:1746143844.850426:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ea300 00000100:00100000:1.0:1746143844.850579:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625146112 00000100:00100000:1.0:1746143844.850583:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625146112 00000100:00100000:1.0:1746143844.850611:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16879 00000100:00100000:1.0:1746143844.850616:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2930:x1830963625146112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143844.850624:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.850636:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412334 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.851099:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.851106:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.851108:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143844.851110:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4849664->5242879] (req 4849664->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.851133:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.851147:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 12 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.851156:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627527808:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.851714:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.852905:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.853021:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625146240 00000100:00100000:3.0:1746143844.853027:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625146240 00000100:00100000:3.0:1746143844.853065:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16880 00000100:00100000:3.0:1746143844.853071:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2935:x1830963625146240:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143844.853083:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143844.853096:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841233b expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.853116:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.853128:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.853133:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.853134:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.853137:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->2408447] (req 2097152->2408447) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 17 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.853157:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.853164:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143844.853173:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627527936:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.853237:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.853244:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 28 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.853252:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627528064:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.854687:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.855182:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627527808:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.855202:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4849664->5242879] (req 4849664->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.855215:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d67200, rc 0) 00000100:00100000:1.0:1746143844.855240:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2930:x1830963625146112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4623us (5146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.855247:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16879 00000100:00100000:0.0:1746143844.855578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.855649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.855798:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625146624 00000100:00100000:1.0:1746143844.855803:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625146624 00000100:00100000:1.0:1746143844.855833:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5468 00000100:00100000:1.0:1746143844.855838:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2932:x1830963625146624:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143844.856171:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625146368 00000100:00100000:3.0:1746143844.856175:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625146368 00002000:00100000:3.0:1746143844.856195:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3137536->3145727) req@ffff8801368e8380 x1830963625146368/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 8680/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143844.856204:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8380 with x1830963625146368 ext(3137536->3145727) 00010000:00010000:3.0:1746143844.856210:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 13 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.856219:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 13 pid: 13430 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143844.856224:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368e8380 00000100:00100000:3.0:1746143844.857516:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2713 00000100:00100000:3.0:1746143844.857525:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625146368:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143844.858448:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2932:x1830963625146624:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 2607us (2796us total) trans 8589945146 rc 0/0 00000100:00100000:1.0:1746143844.858457:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5468 00000100:00100000:0.0:1746143844.858632:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625146368:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 1108us (3053us total) trans 17179874014 rc 0/0 00000100:00100000:0.0:1746143844.858639:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2713 00002000:00100000:0.0:1746143844.858647:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3137536->3145727) req@ffff8801368e8380 x1830963625146368/t17179874014(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 8680/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.858655:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8380 with x1830963625146368 ext(3137536->3145727) 00010000:00010000:0.0:1746143844.858662:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 15 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.858672:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 15 pid: 13430 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143844.858683:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801368e8380 00000100:00100000:3.0:1746143844.858692:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627527936:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.859256:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627528064:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143844.859283:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->2408447] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 17 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.859295:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8e00, rc 0) 00000100:00100000:0.0:1746143844.859824:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2935:x1830963625146240:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6750us (6919us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.859831:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16880 00000100:00100000:0.0:1746143844.863119:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.863215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.863252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.863330:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625146880 00000100:00100000:2.0:1746143844.863338:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625146880 00010000:00010000:2.0:1746143844.863367:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.863404:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625146752 00000100:00100000:2.0:1746143844.863407:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625146752 00010000:00010000:2.0:1746143844.863417:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 29 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.863434:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625147008 00000100:00100000:2.0:1746143844.863437:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8270 00000100:00100000:3.0:1746143844.863438:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625147008 00000100:00100000:2.0:1746143844.863443:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625146880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.863454:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.863455:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 15 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.863471:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143844.863480:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143844.863481:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8271 00000100:00100000:3.0:1746143844.863487:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b41fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625146752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.863497:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.863500:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084c00/0x87925e4cb73b5f71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122d2 expref: 17 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.863506:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 29 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.863514:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 29 pid: 13430 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.863562:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8272 00000100:00100000:1.0:1746143844.863569:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625147008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.863577:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.863588:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 15 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.863596:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 15 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.863606:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8200/0x87925e4cb73b6012 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3137536->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841231f expref: 15 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.863619:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.863621:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.863627:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.863634:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.863772:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.863781:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627528192:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143844.863833:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143844.863997:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.864023:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625146880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 579us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.864029:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8270 00010000:00010000:3.0:1746143844.864195:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084a00/0x87925e4cb73b5eec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a1 expref: 29 pid: 13430 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.864217:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.864218:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.864222:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.864229:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.864247:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.864255:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627528320:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143844.864293:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.866206:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627528320:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143844.866224:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.866263:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b41fb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625146752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2775us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.866272:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8271 00000100:00100000:2.0:1746143844.869457:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.869528:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627528192:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143844.869549:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.869581:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625147008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6012us (6327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.869591:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8272 00000100:00100000:0.0:1746143844.869896:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625147136 00000100:00100000:0.0:1746143844.869902:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625147136 00000100:00100000:0.0:1746143844.869953:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16881 00000100:00100000:0.0:1746143844.869960:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625147136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143844.869973:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.869987:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d848000/0x87925e4cb73b6035 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412342 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.870026:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627528448:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143844.870082:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.870143:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.870280:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625147392 00000100:00100000:0.0:1746143844.870284:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625147392 00002000:00100000:0.0:1746143844.870315:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2404352->2408447) req@ffff88007f64a680 x1830963625147392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.870324:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a680 with x1830963625147392 ext(2404352->2408447) 00002000:00010000:0.0:1746143844.870327:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f64a680 00000100:00100000:0.0:1746143844.870340:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7384 00000100:00100000:0.0:1746143844.870345:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625147392:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143844.870696:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625147392:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 350us (552us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143844.870703:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7384 00002000:00100000:0.0:1746143844.870708:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2404352->2408447) req@ffff88007f64a680 x1830963625147392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.870715:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a680 with x1830963625147392 ext(2404352->2408447) 00002000:00010000:0.0:1746143844.870717:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f64a680 00002000:00010000:0.0:1746143844.871871:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143844.871876:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143844.871877:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143844 -> 1746143845 00000100:00100000:0.0:1746143844.871890:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627528448:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143844.871938:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d848000/0x87925e4cb73b6035 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412342 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.871950:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d848000/0x87925e4cb73b6035 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412342 expref: 29 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.872233:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848000, rc 0) 00000100:00100000:3.0:1746143844.872359:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625147136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2398us (2908us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143844.872365:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16881 00000100:00100000:0.0:1746143844.875091:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.875335:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625147648 00000100:00100000:1.0:1746143844.875347:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625147648 00002000:00100000:1.0:1746143844.875424:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff8801368eaa00 x1830963625147648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.875434:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eaa00 with x1830963625147648 ext(4849664->4853759) 00002000:00010000:1.0:1746143844.875439:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eaa00 00000100:00100000:1.0:1746143844.875469:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7385 00000100:00100000:1.0:1746143844.875477:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625147648:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143844.875627:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625147648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 152us (552us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143844.875634:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7385 00002000:00100000:1.0:1746143844.875639:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff8801368eaa00 x1830963625147648/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/4536 e 0 to 0 dl 1746143855 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143844.875646:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eaa00 with x1830963625147648 ext(4849664->4853759) 00002000:00010000:1.0:1746143844.875648:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368eaa00 00000100:00100000:0.0:1746143844.885594:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.885713:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625147776 00000100:00100000:1.0:1746143844.885724:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625147776 00000100:00100000:1.0:1746143844.885790:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14061 00000100:00100000:1.0:1746143844.885799:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2938:x1830963625147776:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143844.885828:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.885851:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b603c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412349 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.885953:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.885971:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.885982:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.885995:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.886001:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.886007:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.886077:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.886087:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.886094:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.886126:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.886138:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 29 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.886151:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627528576:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.886714:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.888892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.889024:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627528576:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.889046:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143844.889360:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148032 00000100:00100000:2.0:1746143844.889367:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148032 00000100:00100000:2.0:1746143844.889415:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5469 00000100:00100000:2.0:1746143844.889422:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:30659:x1830963625148032:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143844.889630:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+31:30659:x1830963625148032:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 207us (748us total) trans 8589945147 rc 0/0 00000100:00100000:2.0:1746143844.889640:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5469 00000100:00100000:0.0:1746143844.891604:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.893203:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148160 00000100:00100000:1.0:1746143844.893217:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148160 00010000:00010000:1.0:1746143844.893264:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 31 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.893321:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8273 00000100:00100000:1.0:1746143844.893330:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963625148160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.893345:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.893352:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 31 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.893363:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 31 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.893386:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b5e59 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841224d expref: 31 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.893420:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143844.893425:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.893436:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.893443:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.893471:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.893519:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963625148160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 190us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.893526:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8273 00010000:00010000:0.0:1746143844.893588:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893595:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143844.893652:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:0.0:1746143844.893656:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143844.893674:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893683:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893693:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893699:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893705:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893710:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893715:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4abe00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143844.893719:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893725:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893734:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143844.893737:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143844.893740:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893744:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abe00/0x87925e4cb73b6043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893760:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893764:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893781:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893786:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c4abc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143844.893788:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893793:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893799:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b40f3000) 00010000:00010000:0.0:1746143844.893801:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143844.893802:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893807:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b604a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.893839:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b603c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.893852:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.893857:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143844.893859:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143844.893862:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d000, rc 0) 00000100:00100000:0.0:1746143844.893888:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2938:x1830963625147776:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8090us (8307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.893894:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14061 00000100:00100000:0.0:1746143844.896540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.896582:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.897175:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.897199:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.897224:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148288 00000100:00100000:0.0:1746143844.897233:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148288 00000100:00100000:1.0:1746143844.897239:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148544 00000100:00100000:1.0:1746143844.897243:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148544 00000100:00100000:0.0:1746143844.897275:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148416 00000100:00100000:3.0:1746143844.897276:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148800 00000100:00100000:0.0:1746143844.897277:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148416 00000100:00100000:1.0:1746143844.897281:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16882 00000100:00100000:3.0:1746143844.897288:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148800 00000100:00100000:1.0:1746143844.897289:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2008:x1830963625148288:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143844.897293:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16883 00000100:00100000:0.0:1746143844.897298:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625148544:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143844.897320:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.897320:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.897338:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412350 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.897338:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841235e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.897345:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16884 00000100:00100000:3.0:1746143844.897352:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625148416:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143844.897362:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.897362:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.897364:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143844.897364:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.897369:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.897373:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.897373:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.897383:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412357 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.897388:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143844.897389:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.897398:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00010000:00010000:0.0:1746143844.897398:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8a00, rc 0) 00010000:00010000:3.0:1746143844.897403:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.897404:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.897412:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.897424:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143844.897434:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b4000, rc 0) 00000100:00100000:1.0:1746143844.897442:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625148288:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 153us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.897447:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16882 00000100:00100000:1.0:1746143844.897462:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16885 00000100:00100000:1.0:1746143844.897467:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625148800:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143844.897476:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.897482:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841236c expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.897493:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.897494:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.897499:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.897507:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.897514:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55dc00, rc 0) 00000100:00100000:0.0:1746143844.897582:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625148544:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 282us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.897587:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16883 00000100:00100000:0.0:1746143844.897618:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.897631:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148672 00000100:00100000:0.0:1746143844.897634:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148672 00000100:00100000:0.0:1746143844.897646:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16886 00000100:00100000:0.0:1746143844.897650:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625148672:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143844.897655:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.897662:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa16000/0x87925e4cb73b6074 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412365 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.897700:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627528704:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143844.898038:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.898107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.898121:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625148928 00000100:00100000:0.0:1746143844.898124:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625148928 00000100:00100000:0.0:1746143844.898141:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16887 00000100:00100000:0.0:1746143844.898145:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625148928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143844.898151:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.898159:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b607b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412373 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.898182:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627528832:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143844.898362:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.898450:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625148416:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1094us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.898458:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16884 00000100:00100000:1.0:1746143844.898595:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625148800:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1125us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.898602:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16885 00000100:00080000:1.0:1746143844.898623:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143844.902438:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627528704:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143844.902479:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa16000/0x87925e4cb73b6074 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412365 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.902495:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa16000/0x87925e4cb73b6074 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412365 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.902522:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa16000, rc 0) 00000100:00100000:2.0:1746143844.902571:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625148672:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4918us (4949us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143844.902579:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16886 00000100:00100000:1.0:1746143844.903135:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627528832:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143844.903155:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b607b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412373 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.903165:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5aac00/0x87925e4cb73b607b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412373 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.903185:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5aac00, rc 0) 00000100:00100000:1.0:1746143844.903221:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625148928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5074us (5114us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143844.903230:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16887 00000100:00100000:0.0:1746143844.905689:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.905989:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625149184 00000100:00100000:2.0:1746143844.905998:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625149184 00000100:00100000:2.0:1746143844.906061:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14062 00000100:00100000:2.0:1746143844.906069:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2938:x1830963625149184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143844.906090:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.906108:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841237a expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.906217:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.906231:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.906239:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.906272:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.906283:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 14 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.906294:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627528960:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.906393:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.907801:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627528960:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.907820:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143844.908727:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.908821:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625149312 00000100:00100000:3.0:1746143844.908828:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625149312 00010000:00010000:3.0:1746143844.908861:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 15 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.910956:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8274 00000100:00100000:3.0:1746143844.910976:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625149312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.910995:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.911007:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 15 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.911021:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 15 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.911044:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6051 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412349 expref: 15 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.911074:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.911081:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.911092:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.911099:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.911122:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.911179:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625149312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 211us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.911186:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8274 00010000:00010000:2.0:1746143844.911280:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.911288:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143844.911318:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143844.911461:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.911478:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.911485:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.911487:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143844.911490:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085c00, rc 0) 00000100:00100000:2.0:1746143844.911531:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2938:x1830963625149184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5462us (5852us total) trans 8589945148 rc 0/0 00000100:00100000:2.0:1746143844.911537:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14062 00000100:00100000:0.0:1746143844.914484:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.914735:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625149440 00000100:00100000:2.0:1746143844.914745:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625149440 00000100:00100000:2.0:1746143844.914805:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14063 00000100:00100000:2.0:1746143844.914813:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2938:x1830963625149440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143844.914839:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143844.914858:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6097 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412381 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.914999:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.915013:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.915020:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.915059:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.915071:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 15 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.915083:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627529088:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.915173:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.918810:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627529088:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.918840:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143844.920690:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.921007:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625149568 00000100:00100000:3.0:1746143844.921017:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625149568 00010000:00010000:3.0:1746143844.921054:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 16 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.921085:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8275 00000100:00100000:3.0:1746143844.921092:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625149568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.921109:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.921115:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 16 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.921126:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 16 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.921150:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6089 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841237a expref: 16 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.921181:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.921185:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.921198:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.921207:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.921405:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.921461:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625149568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 369us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.921469:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8275 00010000:00010000:2.0:1746143844.921524:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.921533:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143844.921588:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143844.921593:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143844.921610:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.921639:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6097 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412381 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.921656:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412381 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.921663:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.921665:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143844.921667:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00000100:00100000:2.0:1746143844.921705:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2938:x1830963625149440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6894us (7233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.921711:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14063 00000100:00100000:0.0:1746143844.926248:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.926330:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625149696 00000100:00100000:1.0:1746143844.926341:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625149696 00000100:00100000:0.0:1746143844.926366:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.926565:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625149824 00000100:00100000:1.0:1746143844.926569:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625149824 00000100:00100000:1.0:1746143844.926595:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16888 00000100:00100000:1.0:1746143844.926603:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625149696:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143844.926622:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143844.926641:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73b60a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412388 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.926697:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529216:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143844.926802:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16889 00000100:00100000:0.0:1746143844.926810:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625149824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143844.926818:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.926828:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73b60ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841238f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.926854:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627529344:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143844.926855:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.926877:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.930389:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529216:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143844.930425:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73b60a5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412388 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.930440:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c200/0x87925e4cb73b60a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412388 expref: 10 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143844.930522:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627529344:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143844.930542:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73b60ac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841238f expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.930556:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b9800/0x87925e4cb73b60ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841238f expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.930568:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9800, rc 0) 00000100:00100000:2.0:1746143844.930619:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625149824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3810us (4252us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143844.930629:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16889 00010000:00010000:1.0:1746143844.931536:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c200, rc 0) 00000100:00100000:1.0:1746143844.931625:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625149696:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5019us (5384us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143844.931634:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16888 00000100:00100000:2.0:1746143844.936070:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.936102:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150080 00000100:00100000:0.0:1746143844.936114:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150080 00000100:00100000:0.0:1746143844.936177:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14064 00000100:00100000:0.0:1746143844.936187:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2938:x1830963625150080:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143844.936209:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143844.936231:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b60b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412396 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.936373:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b60ba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.936389:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b60ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.936406:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b60ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143844.936418:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143844.936516:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9200/0x87925e4cb73b60b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412396 expref: 17 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.936549:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b60ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412396 expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.936558:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143844.936561:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143844.936564:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8400, rc 0) 00000100:00100000:0.0:1746143844.936620:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2938:x1830963625150080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 434us (561us total) trans 8589945149 rc 0/0 00000100:00100000:0.0:1746143844.936626:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14064 00000100:00100000:0.0:1746143844.939046:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.940429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.940664:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.940681:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150464 00000100:00100000:1.0:1746143844.940681:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150208 00000100:00100000:2.0:1746143844.940691:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150464 00000100:00100000:1.0:1746143844.940692:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150208 00000100:00100000:1.0:1746143844.940748:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16890 00000100:00100000:1.0:1746143844.940756:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625150208:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143844.940803:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.940823:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.940831:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.940837:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.940843:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.940844:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.940847:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.940880:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.940892:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 13 pid: 13430 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.940907:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529472:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.941059:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16891 00000100:00100000:2.0:1746143844.941066:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625150464:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143844.941088:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.941099:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.941106:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.941113:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.941117:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.941119:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.941121:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.941138:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 27 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.941146:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 27 pid: 9585 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.941154:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627529600:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.941290:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 9 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143844.941487:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150720 00010000:00010000:2.0:1746143844.941489:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 9 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143844.941491:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150720 00000100:00100000:0.0:1746143844.941532:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143844.941544:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 10 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143844.941545:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 9 pid: 1945 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.941553:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627529856:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.941553:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529728:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.941579:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.941585:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.941586:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 29 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.941593:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 15 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.941593:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529984:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.941600:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627530112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.941605:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.941615:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.941787:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150336 00000100:00100000:1.0:1746143844.941790:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150336 00000100:00100000:1.0:1746143844.941806:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16892 00000100:00100000:1.0:1746143844.941810:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625150720:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143844.941824:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.941833:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.941839:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.941848:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.941850:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.941852:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.941864:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143844.941869:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 10 pid: 13430 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.941876:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627530240:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.941902:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.941909:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 29 pid: 9585 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.941930:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627530368:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.941946:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.942633:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16893 00000100:00100000:2.0:1746143844.942642:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625150336:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143844.942665:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.942678:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.942685:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.942693:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 15 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.942699:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.942700:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143844.942703:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.942719:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 15 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.942726:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 15 pid: 1947 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.942734:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627530496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.942765:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143844.942773:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 10 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.942780:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627530624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.942799:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 27 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.942806:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 27 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.942812:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627530752:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.942824:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143844.943716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.943782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.943796:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150592 00000100:00100000:3.0:1746143844.943801:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150592 00000100:00100000:2.0:1746143844.943879:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150848 00000100:00100000:2.0:1746143844.943882:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150848 00000100:00100000:3.0:1746143844.944108:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16894 00000100:00100000:3.0:1746143844.944115:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625150592:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143844.944143:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.944157:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.944164:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.944165:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143844.944167:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.944191:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.944200:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 29 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.944211:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627530880:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.944354:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16895 00000100:00100000:2.0:1746143844.944361:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625150848:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143844.944381:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.944391:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.944396:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143844.944397:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143844.944399:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.944416:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 15 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.944424:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 15 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.944432:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627531008:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143844.944790:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143844.945570:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143844.953941:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.954060:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529472:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.954071:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529728:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.954150:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627529600:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.954161:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627529856:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.954218:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.954336:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151104 00000100:00100000:3.0:1746143844.954344:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151104 00010000:00010000:3.0:1746143844.954381:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 12 pid: 1945 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143844.954410:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625150976 00000100:00100000:3.0:1746143844.954412:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625150976 00010000:00010000:3.0:1746143844.954422:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 12 pid: 13430 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.954704:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627530112:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.954731:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.954778:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8276 00000100:00100000:3.0:1746143844.954787:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625151104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.954803:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.954826:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 12 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.954836:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 12 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.954860:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8a00/0x87925e4cb73b6058 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841235e expref: 12 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.954886:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.954946:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625151104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 160us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.954953:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8276 00000100:00100000:3.0:1746143844.954968:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8277 00000100:00100000:3.0:1746143844.954973:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625150976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.954981:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.954993:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 12 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.955001:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 12 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.955013:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b605f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412350 expref: 12 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143844.955022:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.955035:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625150976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 62us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.955040:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8277 00000100:00100000:1.0:1746143844.955102:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627530240:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.955110:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627530368:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.955124:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.955140:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627529984:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.955151:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.958067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958087:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958115:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958154:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958226:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958253:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.958274:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152256 00000100:00100000:0.0:1746143844.958283:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152256 00002000:00100000:0.0:1746143844.958339:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1904639) req@ffff880136acb100 x1830963625152256/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.958349:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963625152256 ext(1138688->1904639) 00010000:00010000:0.0:1746143844.958357:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.958369:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143844.958376:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143844.958394:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2714 00000100:00100000:0.0:1746143844.958402:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625152256:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143844.958590:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152512 00000100:00100000:0.0:1746143844.958594:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152512 00002000:00100000:0.0:1746143844.958610:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2408447) req@ffff880136ac9f80 x1830963625152512/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/0 e 0 to 0 dl 1746143855 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.958616:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9f80 with x1830963625152512 ext(2097152->2408447) 00010000:00010000:0.0:1746143844.958621:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.958629:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143844.958634:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136ac9f80 00000100:00100000:0.0:1746143844.958647:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2715 00000100:00100000:0.0:1746143844.958651:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625152512:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143844.959243:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151360 00000100:00100000:1.0:1746143844.959248:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151360 00010000:00010000:1.0:1746143844.959267:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 14 pid: 13430 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.959281:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151616 00000100:00100000:1.0:1746143844.959282:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151616 00010000:00010000:1.0:1746143844.959290:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 32 pid: 9585 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.959297:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151232 00000100:00100000:1.0:1746143844.959299:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151232 00010000:00010000:1.0:1746143844.959317:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 28 pid: 9585 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.959325:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151488 00000100:00100000:1.0:1746143844.959327:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151488 00010000:00010000:1.0:1746143844.959335:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 11 pid: 13430 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.959342:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151744 00000100:00100000:1.0:1746143844.959344:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151744 00010000:00010000:1.0:1746143844.959352:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 11 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.959359:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625151872 00000100:00100000:1.0:1746143844.959361:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625151872 00010000:00010000:1.0:1746143844.959367:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 18 pid: 1947 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143844.959373:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152000 00000100:00100000:1.0:1746143844.959374:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152000 00010000:00010000:1.0:1746143844.959380:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 33 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.959386:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152128 00000100:00100000:1.0:1746143844.959388:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152128 00010000:00010000:1.0:1746143844.959394:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 19 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.959399:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152384 00000100:00100000:1.0:1746143844.959401:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152384 00010000:00010000:1.0:1746143844.959406:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 29 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.959413:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8278 00000100:00100000:1.0:1746143844.959416:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625151360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959425:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959440:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 14 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959454:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 14 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959475:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84e800/0x87925e4cb73b5e36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412231 expref: 14 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959503:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.959531:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625151360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 114us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.959537:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8278 00000100:00100000:1.0:1746143844.959577:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8279 00000100:00100000:1.0:1746143844.959581:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625151616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959586:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959592:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.959600:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.959611:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096d67200/0x87925e4cb73b6027 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4849664->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412334 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.959617:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.959627:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625151616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.959635:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8279 00000100:00100000:1.0:1746143844.959642:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8280 00000100:00100000:1.0:1746143844.959646:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625151232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959652:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959661:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 29 pid: 9585 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959669:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 29 pid: 9585 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959680:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b5fb0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122f5 expref: 29 pid: 9585 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959689:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.959702:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625151232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 56us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.959706:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8280 00000100:00100000:1.0:1746143844.959715:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8281 00000100:00100000:1.0:1746143844.959719:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625151488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959725:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959731:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 11 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959739:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 11 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959753:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55dc00/0x87925e4cb73b606d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841236c expref: 11 pid: 13430 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959761:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.959763:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.959767:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.959774:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.959794:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.959808:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625151488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.959813:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8281 00000100:00100000:1.0:1746143844.959822:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8282 00000100:00100000:1.0:1746143844.959826:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625151744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959830:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959838:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 11 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959844:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 11 pid: 3135 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959853:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.959864:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625151744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 38us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.959869:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8282 00000100:00100000:1.0:1746143844.959877:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8283 00000100:00100000:1.0:1746143844.959881:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625151872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959886:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959892:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 19 pid: 1947 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959899:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 19 pid: 1947 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143844.959907:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.959952:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625151872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 70us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.959957:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8283 00000100:00100000:1.0:1746143844.959965:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8284 00000100:00100000:1.0:1746143844.959969:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625152000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.959974:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.959981:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 31 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.959988:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 31 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.959999:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ea00/0x87925e4cb73b5e05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841221c expref: 31 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.960011:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.960013:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.960016:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.960022:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.960034:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.960047:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625152000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (1891us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143844.960958:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b5e44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412238 expref: 18 pid: 1947 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.960980:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627530496:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.963655:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8284 00010000:00010000:0.0:1746143844.963724:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.963728:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8285 00010000:00010000:0.0:1746143844.963737:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963764:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963771:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963778:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.963781:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627530880:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143844.963785:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55ca00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143844.963789:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.963801:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963801:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.963818:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625152128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143844.963818:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963823:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b60d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.963836:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.963851:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 17 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.963862:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 17 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.963878:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b5f7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122e0 expref: 17 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.963889:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.963892:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.963896:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.963903:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143844.963905:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625150720:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 22093us (23239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.963925:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16892 00010000:00010000:0.0:1746143844.963950:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.963952:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143844.963957:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963968:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.963970:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625152128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 233us (5751us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143844.963974:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.963976:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8285 00010000:00010000:0.0:1746143844.963980:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963989:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55d200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143844.963992:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.963997:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143844.964005:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.964007:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8286 00010000:00010000:0.0:1746143844.964010:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b60c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.964012:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625152384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.964019:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.964028:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 27 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.964036:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 27 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143844.964039:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625150208:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 23284us (25003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.964044:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16890 00010000:00010000:3.0:1746143844.964047:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.964049:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143844.964052:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964058:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964066:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.964080:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625152384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 68us (5852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.964085:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8286 00010000:00010000:3.0:1746143844.964100:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964107:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964119:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964124:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964130:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964136:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143844.964138:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964144:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964152:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.964163:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b60cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.964191:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625150464:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 23125us (23768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.964197:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16891 00000100:00100000:3.0:1746143844.964250:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627531008:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143844.964262:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964702:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4000/0x87925e4cb73b6066 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412357 expref: 9 pid: 3135 timeout: 1004 lvb_type: 1 00000100:00100000:2.0:1746143844.964713:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627530624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.964723:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b5e0c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412223 expref: 26 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.964733:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627530752:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143844.964750:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964756:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964762:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964774:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964781:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964787:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964792:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c529600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143844.964794:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964799:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964813:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143844.964819:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c529600/0x87925e4cb73b60dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143844.964849:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625150336:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 22208us (23316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.964855:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16893 00000100:00100000:2.0:1746143844.970932:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625152256:12345-192.168.202.3@tcp:4:cat.0 Request processed in 12499us (12697us total) trans 17179874015 rc 0/0 00000100:00100000:2.0:1746143844.970946:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2714 00002000:00100000:2.0:1746143844.970959:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1138688->1904639) req@ffff880136acb100 x1830963625152256/t17179874015(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143844.970968:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb100 with x1830963625152256 ext(1138688->1904639) 00010000:00010000:2.0:1746143844.970979:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.970992:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143844.970999:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136acb100 00000100:00100000:0.0:1746143844.973826:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625152512:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 15166us (15563us total) trans 21474841285 rc 0/0 00000100:00100000:0.0:1746143844.973838:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2715 00002000:00100000:0.0:1746143844.973853:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2408447) req@ffff880136ac9f80 x1830963625152512/t21474841285(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:240/0 lens 488/448 e 0 to 0 dl 1746143855 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143844.973862:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9f80 with x1830963625152512 ext(2097152->2408447) 00010000:00010000:0.0:1746143844.973871:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.973887:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143844.973893:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136ac9f80 00000100:00100000:0.0:1746143844.976583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.977431:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152640 00000100:00100000:1.0:1746143844.977442:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152640 00010000:00010000:1.0:1746143844.977481:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.977518:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8287 00000100:00100000:1.0:1746143844.977526:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625152640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.977541:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.977562:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.977573:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.977600:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8c00/0x87925e4cb73b6019 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->1904639) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412326 expref: 30 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.977628:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.977630:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.977635:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.977642:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.978405:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.978416:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.978417:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143844.978434:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.978440:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.978446:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.978456:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801338b4400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143844.978460:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.978465:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625152640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 939us (1892us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143844.978468:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143844.978471:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8287 00010000:00010000:3.0:1746143844.978477:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.978483:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b4400/0x87925e4cb73b60e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.978763:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2008:x1830963625150592:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 34648us (35048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.978771:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16894 00000100:00100000:0.0:1746143844.978983:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.979069:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625152768 00000100:00100000:1.0:1746143844.979075:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625152768 00010000:00010000:1.0:1746143844.979094:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.979120:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8288 00000100:00100000:1.0:1746143844.979124:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625152768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.979135:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.979149:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.979164:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.979177:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800973b8e00/0x87925e4cb73b602e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841233b expref: 16 pid: 3135 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.979189:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.979191:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143844.979194:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.979200:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.979214:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.979242:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625152768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.979248:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8288 00010000:00010000:3.0:1746143844.979345:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979360:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979382:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979389:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979397:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979402:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143844.979405:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979412:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979427:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143844.979433:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b60eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143844.979526:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2008:x1830963625150848:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 35159us (35737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.979534:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16895 00000100:00100000:0.0:1746143844.981075:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143844.981091:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143844.981140:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625153024 00000100:00100000:1.0:1746143844.981147:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625153024 00000100:00100000:1.0:1746143844.981195:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14065 00000100:00100000:1.0:1746143844.981201:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2938:x1830963625153024:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:1.0:1746143844.981259:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.981278:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b609e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412381 expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981296:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143844.981311:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143844.981337:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.981349:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981355:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981361:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981367:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981373:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981378:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981384:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981389:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 10/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.981420:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981435:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981448:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531136:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.981535:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981543:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 29 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981551:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531264:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.981577:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981583:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 29 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981590:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531392:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.981606:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981612:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981622:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531520:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.981640:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 29 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981647:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 29 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981653:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531648:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.981669:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981674:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 29 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981681:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531776:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143844.981697:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143844.981704:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.981710:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531904:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.981724:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143844.985192:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531136:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.985197:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.985205:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531264:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.985252:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625153280 00000100:00100000:2.0:1746143844.985259:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625153280 00000100:00100000:2.0:1746143844.985325:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5470 00000100:00100000:2.0:1746143844.985333:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:30659:x1830963625153280:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143844.985783:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531392:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.986462:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.986481:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531520:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.986483:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143844.986491:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531648:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143844.986499:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.986513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.986531:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625153792 00000100:00100000:0.0:1746143844.986535:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625153792 00010000:00010000:0.0:1746143844.986558:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 288 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143844.986577:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154048 00000100:00100000:0.0:1746143844.986579:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154048 00000100:00100000:3.0:1746143844.986583:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625153536 00010000:00010000:0.0:1746143844.986587:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 30 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.986590:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625153536 00000100:00100000:0.0:1746143844.986598:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625153664 00000100:00100000:0.0:1746143844.986600:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625153664 00010000:00010000:0.0:1746143844.986606:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 32 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143844.986617:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8289 00000100:00100000:0.0:1746143844.986624:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:2008:x1830963625153792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143844.986634:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143844.986639:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 288 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.986647:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 288 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.986668:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133566800/0x87925e4cb73b59cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f60 expref: 288 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143844.986685:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143844.986690:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143844.986699:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.986703:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531776:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143844.986715:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627531904:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143844.986724:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+287:30659:x1830963625153280:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 1390us (1528us total) trans 8589945150 rc 0/0 00000100:00100000:2.0:1746143844.986733:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5470 00010000:00010000:1.0:1746143844.986751:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143844.986765:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8290 00000100:00100000:2.0:1746143844.986772:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963625154048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.986779:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143844.986784:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 32 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.986785:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8291 00010000:00010000:2.0:1746143844.986793:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 32 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.986794:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963625153664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.986807:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b5f08 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484122a8 expref: 32 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.986808:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.986815:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 31 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.986816:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.986819:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.986824:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.986862:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625154048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 91us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143844.986863:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2008:x1830963625153792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 238us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.986867:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5471 00000100:00100000:2.0:1746143844.986869:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8290 00000100:00100000:0.0:1746143844.986876:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8289 00000100:00100000:3.0:1746143844.986878:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+31:30523:x1830963625153536:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143844.986925:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143844.986941:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625153920 00000100:00100000:2.0:1746143844.986944:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625153920 00010000:00010000:2.0:1746143844.986955:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 31 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143844.986975:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8292 00000100:00100000:2.0:1746143844.986980:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625153920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143844.986987:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143844.986988:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143844.986990:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 32 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.987062:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 32 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.987080:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b59d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f67 expref: 32 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.987091:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143844.987094:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.987102:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.987145:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625153664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 352us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.987152:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8291 00000100:00100000:1.0:1746143844.987165:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154176 00000100:00100000:1.0:1746143844.987168:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154176 00010000:00010000:1.0:1746143844.987178:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 286 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143844.987200:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8293 00000100:00100000:1.0:1746143844.987206:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2008:x1830963625154176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143844.987212:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143844.987215:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 286 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.987221:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 286 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.987249:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:30523:x1830963625153536:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 376us (789us total) trans 8589945151 rc 0/0 00000100:00100000:3.0:1746143844.987255:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5471 00010000:00010000:1.0:1746143844.987508:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b5e8a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412262 expref: 286 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143844.987516:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143844.987519:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143844.987523:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143844.987562:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963625154176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 346us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143844.987568:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8293 00010000:00010000:2.0:1746143844.988504:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 29 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.988519:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634400/0x87925e4cb73b59c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248411f59 expref: 29 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143844.988531:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143844.988535:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143844.988541:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143844.988567:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625153920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1586us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143844.988574:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8292 00000100:00100000:0.0:1746143844.990446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143844.990493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143844.991796:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154304 00000100:00100000:3.0:1746143844.991806:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154304 00010000:00010000:3.0:1746143844.991837:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.991866:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154432 00000100:00100000:3.0:1746143844.991868:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154432 00010000:00010000:3.0:1746143844.991877:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 28 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143844.991893:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8294 00000100:00100000:3.0:1746143844.991899:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963625154304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.991908:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.991957:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.991966:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.991983:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d200/0x87925e4cb73b5de2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412200 expref: 285 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.991997:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.992001:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.992008:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.992051:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+284:2008:x1830963625154304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 151us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.992057:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8294 00000100:00100000:3.0:1746143844.992070:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8295 00000100:00100000:3.0:1746143844.992074:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625154432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143844.992079:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143844.992083:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 28 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.992090:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 28 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.992099:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2000/0x87925e4cb73b5ad9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841202b expref: 28 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143844.992106:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143844.992109:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.992115:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.992121:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.992136:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143844.992147:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963625154432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143844.992152:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8295 00010000:00010000:3.0:1746143844.992167:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143844.992172:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000040:00080000:3.0:1746143844.993554:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3275, 88 off276056 00000004:00080000:3.0:1746143844.993563:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904217650505ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.993653:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3266, 88 off274912 00000004:00080000:3.0:1746143844.993659:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904217746533ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996223:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3267, 88 off275000 00000004:00080000:3.0:1746143844.996232:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220319052ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996245:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3276, 88 off276144 00000004:00080000:3.0:1746143844.996248:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220335885ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996260:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3277, 88 off276232 00000004:00080000:3.0:1746143844.996262:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220349887ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996269:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3268, 88 off275088 00000004:00080000:3.0:1746143844.996272:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220359414ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996279:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3269, 88 off275176 00000004:00080000:3.0:1746143844.996281:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220369385ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996289:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3270, 88 off275264 00000004:00080000:3.0:1746143844.996294:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220381705ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996312:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3278, 88 off276320 00000004:00080000:3.0:1746143844.996316:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220403470ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996324:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3271, 88 off275352 00000004:00080000:3.0:1746143844.996327:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220414519ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996334:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3279, 88 off276408 00000004:00080000:3.0:1746143844.996336:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220424152ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996343:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3272, 88 off275440 00000004:00080000:3.0:1746143844.996346:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220434005ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143844.996353:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3280, 88 off276496 00000004:00080000:3.0:1746143844.996355:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220442852ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996362:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3281, 88 off276584 00000004:00080000:3.0:1746143844.996364:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220452254ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996371:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3282, 88 off276672 00000004:00080000:3.0:1746143844.996374:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220461659ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996381:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3283, 88 off276760 00000004:00080000:3.0:1746143844.996383:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904220470975ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143844.996391:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3273, 88 off275528 00000004:00080000:3.0:1746143844.996393:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904220480924ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143845.003313:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945152 is committed 00000004:00080000:2.0:1746143845.003323:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2486 committed 00000004:00080000:2.0:1746143845.003339:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2499 committed 00000004:00080000:2.0:1746143845.003350:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2498 committed 00000004:00080000:2.0:1746143845.003352:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2497 committed 00000004:00080000:2.0:1746143845.003353:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2496 committed 00000004:00080000:2.0:1746143845.003354:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2485 committed 00000004:00080000:2.0:1746143845.003356:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2495 committed 00000004:00080000:2.0:1746143845.003357:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2484 committed 00000004:00080000:2.0:1746143845.003359:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2494 committed 00000004:00080000:2.0:1746143845.003360:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2483 committed 00000004:00080000:2.0:1746143845.003361:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2482 committed 00000004:00080000:2.0:1746143845.003363:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2481 committed 00000004:00080000:2.0:1746143845.003364:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2493 committed 00000004:00080000:2.0:1746143845.003365:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2492 committed 00000004:00080000:2.0:1746143845.003367:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2480 committed 00000004:00080000:2.0:1746143845.003368:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2479 committed 00000004:00080000:2.0:1746143845.003370:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2491 committed 00000001:00080000:2.0:1746143845.003374:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945151 is committed 00000001:00080000:2.0:1746143845.003377:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945150 is committed 00000100:00100000:1.0:1746143845.003607:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.003660:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.003682:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.003696:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.003711:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746143845.003715:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.003728:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.003737:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.003749:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.003770:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532288 00000100:00100000:1.0:1746143845.003775:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532288 00000100:00080000:1.0:1746143845.003795:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143845.003818:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532800 00000100:00100000:1.0:1746143845.003821:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532800 00000100:00100000:1.0:1746143845.003831:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532416 00000100:00100000:1.0:1746143845.003832:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532416 00000100:00100000:1.0:1746143845.003841:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532928 00000100:00100000:1.0:1746143845.003842:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532928 00000100:00100000:1.0:1746143845.003853:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16896 00000100:00100000:1.0:1746143845.003858:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3771:x1830963627532288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.004006:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dd45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627532288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (345us total) trans 21474841286 rc 0/0 00000100:00100000:1.0:1746143845.004011:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16896 00000100:00100000:1.0:1746143845.004126:0:3771:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841274 gen 2 00000004:00080000:1.0:1746143845.004130:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880087df7b80, transno 21474841217 00000004:00080000:1.0:1746143845.004134:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880087df4700, transno 21474841218 00000004:00080000:1.0:1746143845.004136:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880087df6a00, transno 21474841219 00000004:00080000:1.0:1746143845.004138:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c33b80, transno 21474841220 00000004:00080000:1.0:1746143845.004140:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880087df5880, transno 21474841221 00000004:00080000:1.0:1746143845.004142:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880087df7100, transno 21474841222 00000004:00080000:1.0:1746143845.004144:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880087df5180, transno 21474841223 00000004:00080000:1.0:1746143845.004146:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c31f80, transno 21474841224 00000004:00080000:1.0:1746143845.004148:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610d880, transno 21474841226 00000004:00080000:1.0:1746143845.004150:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610d500, transno 21474841227 00000004:00080000:1.0:1746143845.004152:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610f100, transno 21474841228 00000004:00080000:1.0:1746143845.004154:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610d180, transno 21474841229 00000004:00080000:1.0:1746143845.004156:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610df80, transno 21474841230 00000004:00080000:1.0:1746143845.004158:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610f800, transno 21474841231 00000004:00080000:1.0:1746143845.004160:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610f480, transno 21474841232 00000004:00080000:1.0:1746143845.004162:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610fb80, transno 21474841233 00000004:00080000:1.0:1746143845.004163:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30700, transno 21474841247 00000004:00080000:1.0:1746143845.004165:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610c000, transno 21474841248 00000004:00080000:1.0:1746143845.004167:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610ce00, transno 21474841249 00000004:00080000:1.0:1746143845.004169:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610ed80, transno 21474841250 00000004:00080000:1.0:1746143845.004171:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610dc00, transno 21474841251 00000004:00080000:1.0:1746143845.004173:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c30e00, transno 21474841252 00000004:00080000:1.0:1746143845.004175:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610e680, transno 21474841253 00000004:00080000:1.0:1746143845.004177:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009610e300, transno 21474841254 00000004:00080000:1.0:1746143845.004179:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5bb80, transno 21474841259 00000004:00080000:1.0:1746143845.004181:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59f80, transno 21474841260 00000004:00080000:1.0:1746143845.004183:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59880, transno 21474841261 00000004:00080000:1.0:1746143845.004185:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5a680, transno 21474841262 00000004:00080000:1.0:1746143845.004186:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5ad80, transno 21474841263 00000004:00080000:1.0:1746143845.004188:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58380, transno 21474841264 00000004:00080000:1.0:1746143845.004190:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5b100, transno 21474841265 00000004:00080000:1.0:1746143845.004192:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58000, transno 21474841266 00000004:00080000:1.0:1746143845.004194:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136334000, transno 21474841267 00000004:00080000:1.0:1746143845.004197:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136336680, transno 21474841268 00000004:00080000:1.0:1746143845.004199:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719dc00, transno 21474841269 00000004:00080000:1.0:1746143845.004201:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136336d80, transno 21474841270 00000004:00080000:1.0:1746143845.004203:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136337800, transno 21474841271 00000004:00080000:1.0:1746143845.004205:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719ed80, transno 21474841272 00000004:00080000:1.0:1746143845.004207:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719ca80, transno 21474841273 00000004:00080000:1.0:1746143845.004208:0:3771:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719fb80, transno 21474841274 00000100:00100000:1.0:1746143845.004213:0:3771:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009eb87800 x1830963627532288/t21474841286(21474841286) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143861 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746143845.004221:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87800/2, rc 0, transno 21474841286 00000100:00100000:1.0:1746143845.004225:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.004239:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16897 00000100:00100000:1.0:1746143845.004244:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3771:x1830963627532800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.004315:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627532800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (617us total) trans 21474841287 rc 0/0 00000100:00100000:1.0:1746143845.004320:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16897 00000100:00100000:1.0:1746143845.004330:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16898 00000100:00100000:1.0:1746143845.004334:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3771:x1830963627532416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143845.004376:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143845.004379:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143845.004381:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143845.004393:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143845.004395:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:1.0:1746143845.004412:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627532416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (683us total) trans 21474841288 rc 0/0 00000100:00100000:1.0:1746143845.004417:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16898 00000100:00100000:1.0:1746143845.004425:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16899 00000100:00100000:1.0:1746143845.004429:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+8:3771:x1830963627532928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.004471:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3771:x1830963627532928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (721us total) trans 21474841289 rc 0/0 00000100:00100000:1.0:1746143845.004475:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16899 00000004:00080000:1.0:1746143845.004490:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87b80/2, rc 0, transno 21474841288 00000100:00100000:1.0:1746143845.004493:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143845.004498:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86680/2, rc 0, transno 21474841289 00000100:00100000:1.0:1746143845.004500:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143845.004505:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87480/2, rc 0, transno 21474841287 00000100:00100000:1.0:1746143845.004507:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627532800:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746143845.004650:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136ac8e00 reply state ffff8800b4c70800 transno 8589945152 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00080000:1.0:1746143845.004660:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 40 done 00010000:00010000:3.0:1746143845.004665:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.004672:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.004674:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143845.004678:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746143845.004734:0:14991:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746143845.004734:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.004743:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2938:x1830963625153024:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 23541us (23671us total) trans 8589945152 rc 0/0 00000100:00100000:3.0:1746143845.004748:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14065 00000100:00100000:0.0:1746143845.004763:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143845.004770:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.004776:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143845.004776:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532544:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143845.004782:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.004787:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55cc00 already unused, calling callback (ffffffffa0f2a690) 00000100:00100000:0.0:1746143845.004789:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143845.004791:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.004797:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143845.004800:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143845.004803:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532160:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143845.004804:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.004806:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143845.004808:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.004813:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b60f2 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143845.004815:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.004825:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.004829:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532032 00000100:00100000:3.0:1746143845.004832:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532032 00000100:00100000:0.0:1746143845.004837:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.004846:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532544 00000100:00100000:3.0:1746143845.004847:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532544 00000100:00100000:3.0:1746143845.004855:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532160 00000100:00100000:3.0:1746143845.004857:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532160 00000100:00100000:0.0:1746143845.004857:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627532672 00000100:00100000:0.0:1746143845.004860:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627532672 00000100:00100000:3.0:1746143845.004866:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16900 00000100:00100000:3.0:1746143845.004871:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627532032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.004879:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16901 00000100:00100000:0.0:1746143845.004883:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627532544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.004946:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963627532032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (187us total) trans 21474841290 rc 0/0 00000100:00100000:3.0:1746143845.004951:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16900 00000100:00100000:0.0:1746143845.004959:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627532544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (168us total) trans 21474841291 rc 0/0 00000100:00100000:3.0:1746143845.004961:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16902 00000100:00100000:0.0:1746143845.004965:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16901 00000100:00100000:3.0:1746143845.004966:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627532160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.004974:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16903 00000100:00100000:0.0:1746143845.004978:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3773:x1830963627532672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.005009:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963627532160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (193us total) trans 21474841292 rc 0/0 00000100:00100000:3.0:1746143845.005014:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16902 00002000:00010000:0.0:1746143845.005016:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:0.0:1746143845.005018:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143845.005020:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143845.005021:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143845.005023:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:0.0:1746143845.005040:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627532672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (202us total) trans 21474841293 rc 0/0 00000100:00100000:0.0:1746143845.005045:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16903 00000004:00080000:0.0:1746143845.005068:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86d80/2, rc 0, transno 21474841292 00000100:00100000:0.0:1746143845.005071:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143845.005077:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87100/2, rc 0, transno 21474841293 00000100:00100000:0.0:1746143845.005079:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143845.005085:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb84a80/2, rc 0, transno 21474841290 00000100:00100000:0.0:1746143845.005087:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143845.005092:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb84000/2, rc 0, transno 21474841291 00000100:00100000:0.0:1746143845.005094:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627532544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.005182:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.005201:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.005213:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.005224:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.005234:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143845.005238:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.005333:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.005346:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.005359:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.005598:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.005620:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.005632:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.005643:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.005652:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746143845.005656:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.005667:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.005676:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.005686:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.005698:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533440 00000100:00100000:2.0:1746143845.005701:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533440 00000100:00100000:2.0:1746143845.005718:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533952 00000100:00100000:2.0:1746143845.005720:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533952 00000100:00100000:2.0:1746143845.005726:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533312 00000100:00100000:2.0:1746143845.005728:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533312 00000100:00100000:2.0:1746143845.005733:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533824 00000100:00100000:2.0:1746143845.005735:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533824 00000100:00100000:2.0:1746143845.005739:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533184 00000100:00100000:2.0:1746143845.005741:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533184 00000100:00100000:2.0:1746143845.005745:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533696 00000100:00100000:2.0:1746143845.005747:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533696 00000100:00100000:2.0:1746143845.005752:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533056 00000100:00100000:2.0:1746143845.005753:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533056 00000100:00100000:2.0:1746143845.005758:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627533568 00000100:00100000:2.0:1746143845.005759:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627533568 00000100:00100000:2.0:1746143845.005766:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16904 00000100:00100000:2.0:1746143845.005771:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963627533440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.005849:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16905 00000100:00100000:3.0:1746143845.005855:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627533952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.005870:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627533440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (667us total) trans 17179874016 rc 0/0 00000100:00100000:2.0:1746143845.005876:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16904 00000100:00100000:2.0:1746143845.005885:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16906 00000100:00100000:2.0:1746143845.005889:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627533312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143845.005901:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:3.0:1746143845.005903:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143845.005905:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143845.005907:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143845.005908:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:3.0:1746143845.005946:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963627533952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (720us total) trans 17179874017 rc 0/0 00000100:00100000:3.0:1746143845.005951:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16905 00000100:00100000:2.0:1746143845.005955:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963627533312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (622us total) trans 17179874018 rc 0/0 00000100:00100000:2.0:1746143845.005960:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16906 00000100:00100000:3.0:1746143845.005963:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16907 00000100:00100000:3.0:1746143845.005968:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3772:x1830963627533824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.005969:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16908 00000100:00100000:2.0:1746143845.005973:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3774:x1830963627533184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.006005:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16909 00000100:00100000:3.0:1746143845.006010:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627533696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.006019:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627533184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (398us total) trans 17179874020 rc 0/0 00000100:00100000:2.0:1746143845.006024:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16908 00000100:00100000:2.0:1746143845.006032:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16910 00000100:00100000:2.0:1746143845.006035:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627533056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.006059:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3774:x1830963627533696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (414us total) trans 17179874021 rc 0/0 00000100:00100000:3.0:1746143845.006064:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16909 00000100:00100000:3.0:1746143845.006074:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16911 00000100:00100000:2.0:1746143845.006076:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627533056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (407us total) trans 17179874022 rc 0/0 00000100:00100000:3.0:1746143845.006078:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627533568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.006081:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16910 00000100:00080000:2.0:1746143845.006092:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143845.006106:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874005 gen 2 00000004:00080000:2.0:1746143845.006109:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136335500, transno 17179873943 00000004:00080000:2.0:1746143845.006114:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136336a00, transno 17179873944 00000004:00080000:2.0:1746143845.006116:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136334380, transno 17179873945 00000004:00080000:2.0:1746143845.006118:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45880, transno 17179873946 00000004:00080000:2.0:1746143845.006120:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b47800, transno 17179873947 00000004:00080000:2.0:1746143845.006122:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136337480, transno 17179873948 00000004:00080000:2.0:1746143845.006124:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136335c00, transno 17179873949 00000100:00100000:3.0:1746143845.006126:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3774:x1830963627533568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (438us total) trans 17179874023 rc 0/0 00000004:00080000:2.0:1746143845.006126:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136334700, transno 17179873950 00000004:00080000:2.0:1746143845.006128:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b46a00, transno 17179873951 00000004:00080000:2.0:1746143845.006130:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b8a80, transno 17179873953 00000100:00100000:3.0:1746143845.006131:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16911 00000004:00080000:2.0:1746143845.006131:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b8e00, transno 17179873954 00000004:00080000:2.0:1746143845.006133:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b8000, transno 17179873955 00000004:00080000:2.0:1746143845.006134:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9180, transno 17179873956 00000004:00080000:2.0:1746143845.006136:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9500, transno 17179873957 00000004:00080000:2.0:1746143845.006138:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bb100, transno 17179873958 00000004:00080000:2.0:1746143845.006140:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136334a80, transno 17179873959 00000004:00080000:2.0:1746143845.006142:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9880, transno 17179873960 00000004:00080000:2.0:1746143845.006143:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bb480, transno 17179873961 00000004:00080000:2.0:1746143845.006145:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d8380, transno 17179873975 00000004:00080000:2.0:1746143845.006147:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4df80, transno 17179873976 00000004:00080000:2.0:1746143845.006149:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdd500, transno 17179873977 00000004:00080000:2.0:1746143845.006151:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136634a80, transno 17179873978 00002000:00010000:3.0:1746143845.006153:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:2.0:1746143845.006153:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136637100, transno 17179873979 00000004:00080000:2.0:1746143845.006155:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdc380, transno 17179873980 00002000:00010000:3.0:1746143845.006156:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143845.006157:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:2.0:1746143845.006157:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136635f80, transno 17179873981 00002000:00010000:3.0:1746143845.006159:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00000004:00080000:2.0:1746143845.006159:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bdd180, transno 17179873982 00002000:00010000:3.0:1746143845.006160:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000004:00080000:2.0:1746143845.006161:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7b800, transno 17179873983 00000004:00080000:2.0:1746143845.006163:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78a80, transno 17179873988 00000004:00080000:2.0:1746143845.006165:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7a300, transno 17179873989 00000004:00080000:2.0:1746143845.006167:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7ad80, transno 17179873990 00000004:00080000:2.0:1746143845.006169:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7a680, transno 17179873991 00000004:00080000:2.0:1746143845.006171:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78000, transno 17179873992 00000004:00080000:2.0:1746143845.006172:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7bb80, transno 17179873993 00000004:00080000:2.0:1746143845.006174:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78700, transno 17179873994 00000100:00100000:3.0:1746143845.006175:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627533824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 208us (815us total) trans 17179874019 rc 0/0 00000004:00080000:2.0:1746143845.006176:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e79c00, transno 17179873995 00000004:00080000:2.0:1746143845.006178:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129dc3800, transno 17179873996 00000100:00100000:3.0:1746143845.006180:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16907 00000004:00080000:2.0:1746143845.006180:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457f100, transno 17179873997 00000004:00080000:2.0:1746143845.006182:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64aa00, transno 17179873998 00000004:00080000:2.0:1746143845.006184:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e492a00, transno 17179873999 00000004:00080000:2.0:1746143845.006186:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f648000, transno 17179874000 00000004:00080000:2.0:1746143845.006188:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e492680, transno 17179874001 00000004:00080000:2.0:1746143845.006190:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32300, transno 17179874002 00000004:00080000:2.0:1746143845.006192:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31f80, transno 17179874003 00000004:00080000:2.0:1746143845.006195:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e358e00, transno 17179874004 00000004:00080000:2.0:1746143845.006197:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33100, transno 17179874005 00000100:00100000:2.0:1746143845.006201:0:3774:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880136ac8700 x1830963627533056/t17179874022(17179874022) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143861 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746143845.006208:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8700/2, rc 0, transno 17179874022 00000100:00100000:2.0:1746143845.006567:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143845.007195:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac9500/2, rc 0, transno 17179874018 00000100:00100000:0.0:1746143845.007200:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143845.007213:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457c380/2, rc 0, transno 17179874019 00000100:00100000:0.0:1746143845.007216:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143845.007222:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136acad80/2, rc 0, transno 17179874016 00000100:00100000:0.0:1746143845.007225:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143845.007231:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457d500/2, rc 0, transno 17179874017 00000100:00100000:0.0:1746143845.007233:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627533952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.007337:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457ed80/2, rc 0, transno 17179874023 00000100:00100000:2.0:1746143845.007340:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533568:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.007346:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac9c00/2, rc 0, transno 17179874020 00000100:00100000:2.0:1746143845.007348:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.007354:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012457ca80/2, rc 0, transno 17179874021 00000100:00100000:2.0:1746143845.007356:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627533696:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143845.007378:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 9 in progress, 0 in flight, 44 done 00000100:00100000:1.0:1746143845.007462:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627534080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143845.007489:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.007751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.008298:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534080 00000100:00100000:3.0:1746143845.008310:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534080 00000100:00100000:3.0:1746143845.008346:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16912 00000100:00100000:3.0:1746143845.008351:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627534080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.008383:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154560 00000100:00100000:2.0:1746143845.008387:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154560 00000100:00080000:2.0:1746143845.008401:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143845.008430:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14066 00000100:00100000:2.0:1746143845.008435:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2938:x1830963625154560:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.008449:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143845.008455:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963627534080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (965us total) trans 17179874024 rc 0/0 00000100:00100000:3.0:1746143845.008461:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16912 00010000:00010000:2.0:1746143845.008462:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841239d expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.008504:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.008516:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.008530:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.008533:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143845.008535:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551000, rc 0) 00000100:00100000:2.0:1746143845.008562:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2938:x1830963625154560:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 127us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.008567:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14066 00000004:00080000:0.0:1746143845.008627:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88007f64aa00/2, rc 0, transno 17179874024 00000100:00100000:0.0:1746143845.008631:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627534080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.014604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.014931:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154688 00000100:00100000:2.0:1746143845.014943:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154688 00000100:00100000:2.0:1746143845.015005:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14067 00000100:00100000:2.0:1746143845.015013:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2938:x1830963625154688:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.015041:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.015063:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73b6100 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123a4 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.015155:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73b6107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.015169:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73b6107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.015179:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73b6107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143845.015203:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143845.015207:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143845.015222:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73b6107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.015242:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551200/0x87925e4cb73b6100 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123a4 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.015270:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73b6107 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123a4 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.015278:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.015280:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143845.015283:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551a00, rc 0) 00000100:00100000:2.0:1746143845.015341:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2938:x1830963625154688:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 328us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.015347:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14067 00000100:00100000:0.0:1746143845.017159:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.017188:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.017210:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.017238:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154816 00000100:00100000:1.0:1746143845.017247:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154816 00000100:00100000:0.0:1746143845.017265:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.017289:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625154944 00000100:00100000:1.0:1746143845.017290:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625154944 00000100:00100000:1.0:1746143845.017313:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155072 00000100:00100000:1.0:1746143845.017315:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155072 00000100:00100000:1.0:1746143845.017324:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155200 00000100:00100000:1.0:1746143845.017326:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155200 00000100:00100000:1.0:1746143845.017339:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16913 00000100:00100000:1.0:1746143845.017344:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625154816:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.017358:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.017373:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123ab expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.017394:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16914 00002000:00010000:1.0:1746143845.017395:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a64, atime: 0x68140a64, ctime: 0x68140a64, blocks: 0x748 00000100:00100000:3.0:1746143845.017402:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625154944:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.017409:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.017410:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.017411:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.017417:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.017420:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123b2 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.017430:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143845.017432:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a64, atime: 0x68140a63, ctime: 0x68140a64, blocks: 0x808 00010000:00010000:1.0:1746143845.017438:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d800, rc 0) 00010000:00010000:3.0:1746143845.017440:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.017441:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.017445:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.017459:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.017465:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a44800, rc 0) 00000100:00100000:1.0:1746143845.017477:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625154816:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 132us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.017482:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16913 00000100:00100000:3.0:1746143845.017483:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625154944:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.017488:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16914 00000100:00100000:1.0:1746143845.017493:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16915 00000100:00100000:1.0:1746143845.017496:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625155072:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143845.017499:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16916 00010000:00010000:1.0:1746143845.017501:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143845.017504:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625155200:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.017507:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123b9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.017509:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.017515:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123c0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143845.017515:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a64, atime: 0x68140a64, ctime: 0x68140a64, blocks: 0x808 00010000:00010000:1.0:1746143845.017521:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.017522:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746143845.017524:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a65, atime: 0x68140a65, ctime: 0x68140a65, blocks: 0x808 00010000:00010000:1.0:1746143845.017525:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.017531:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.017532:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.017533:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 9 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.017535:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.017540:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55cc00, rc 0) 00010000:00010000:3.0:1746143845.017543:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 9 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.017549:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092a45800, rc 0) 00000100:00100000:1.0:1746143845.017556:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625155072:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 59us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.017561:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16915 00000100:00100000:3.0:1746143845.017564:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625155200:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.017571:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16916 00000100:00100000:2.0:1746143845.018535:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.018590:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.018602:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155328 00000100:00100000:1.0:1746143845.018608:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155328 00000100:00100000:1.0:1746143845.018628:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155456 00000100:00100000:1.0:1746143845.018630:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155456 00000100:00100000:1.0:1746143845.018654:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16917 00000100:00100000:1.0:1746143845.018660:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625155328:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.018667:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.018677:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123c7 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143845.018688:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a65, atime: 0x68140a64, ctime: 0x68140a65, blocks: 0x1510 00010000:00010000:1.0:1746143845.018696:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.018698:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.018702:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.018712:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.018718:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c800, rc 0) 00000100:00100000:1.0:1746143845.018742:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625155328:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.018750:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16917 00000100:00100000:1.0:1746143845.018760:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16918 00000100:00100000:1.0:1746143845.018764:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625155456:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.018770:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.018777:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123ce expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143845.018787:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a65, atime: 0x68140a64, ctime: 0x68140a65, blocks: 0x1008 00010000:00010000:1.0:1746143845.018794:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.018795:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.018799:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.018808:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.018814:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:1.0:1746143845.018828:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625155456:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.018832:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16918 00000100:00100000:2.0:1746143845.025531:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.025568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.025596:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.025620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.025632:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.025653:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155840 00000100:00100000:2.0:1746143845.025653:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155712 00000100:00100000:0.0:1746143845.025653:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155584 00000100:00100000:3.0:1746143845.025661:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155840 00000100:00100000:2.0:1746143845.025661:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155712 00000100:00100000:0.0:1746143845.025661:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155584 00000100:00100000:3.0:1746143845.025697:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625155968 00000100:00100000:3.0:1746143845.025699:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625155968 00000100:00100000:2.0:1746143845.025699:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156224 00000100:00100000:2.0:1746143845.025700:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156224 00000100:00100000:0.0:1746143845.025711:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16919 00000100:00100000:0.0:1746143845.025719:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625155840:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143845.025720:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16920 00000100:00100000:2.0:1746143845.025724:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16921 00000100:00100000:3.0:1746143845.025725:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625155712:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143845.025729:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625155584:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143845.025739:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16922 00000100:00100000:3.0:1746143845.025743:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625155968:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143845.025818:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625155968:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.025818:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625155584:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.025820:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625155840:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 101us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.025824:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16921 00000100:00100000:3.0:1746143845.025827:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16922 00000100:00100000:0.0:1746143845.025830:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16919 00000100:00100000:2.0:1746143845.025838:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16923 00000100:00100000:2.0:1746143845.025843:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625156224:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143845.025872:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625156224:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.025876:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16923 00000100:00100000:3.0:1746143845.025909:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625155712:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 183us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.025931:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16920 00000100:00100000:2.0:1746143845.025948:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.025962:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156096 00000100:00100000:3.0:1746143845.025964:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156096 00000100:00100000:3.0:1746143845.025980:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16924 00000100:00100000:3.0:1746143845.025985:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625156096:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143845.026030:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625156096:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 45us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.026035:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16924 00000100:00100000:0.0:1746143845.028255:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.028289:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.028320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.028358:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.028367:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156352 00000100:00100000:1.0:1746143845.028375:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156352 00000100:00100000:1.0:1746143845.028407:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156480 00000100:00100000:1.0:1746143845.028409:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156480 00000100:00100000:1.0:1746143845.028421:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156736 00000100:00100000:1.0:1746143845.028423:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156736 00000100:00100000:1.0:1746143845.028432:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156608 00000100:00100000:1.0:1746143845.028434:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156608 00000100:00100000:1.0:1746143845.028447:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16925 00000100:00100000:1.0:1746143845.028453:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625156352:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143845.028541:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625156352:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 87us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.028547:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16925 00000100:00100000:1.0:1746143845.028560:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16926 00000100:00100000:1.0:1746143845.028564:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625156480:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143845.028600:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625156480:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 35us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.028605:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16926 00000100:00100000:3.0:1746143845.028611:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16927 00000100:00100000:1.0:1746143845.028615:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16928 00000100:00100000:3.0:1746143845.028619:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625156736:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143845.028620:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625156608:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143845.028650:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625156608:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.028654:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16928 00000100:00100000:3.0:1746143845.028662:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625156736:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 45us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.028669:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16927 00000100:00100000:3.0:1746143845.028904:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.028957:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.029015:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156992 00000100:00100000:0.0:1746143845.029018:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156992 00000100:00100000:0.0:1746143845.029043:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625156864 00000100:00100000:0.0:1746143845.029045:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625156864 00000100:00100000:0.0:1746143845.029059:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16929 00000100:00100000:0.0:1746143845.029064:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625156992:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143845.029118:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625156992:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 54us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.029124:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16929 00000100:00100000:2.0:1746143845.029128:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16930 00000100:00100000:2.0:1746143845.029135:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625156864:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143845.029176:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625156864:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 43us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.029182:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16930 00000100:00100000:0.0:1746143845.033034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.033291:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625157120 00000100:00100000:2.0:1746143845.033311:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625157120 00000100:00100000:2.0:1746143845.033372:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16931 00000100:00100000:2.0:1746143845.033380:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625157120:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143845.033593:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143845.033596:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.033598:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.033600:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.033602:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143845.033658:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625157120:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 278us (635us total) trans 21474841294 rc 0/0 00000100:00100000:2.0:1746143845.033665:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16931 00000100:00100000:0.0:1746143845.036371:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.037155:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625157248 00000100:00100000:2.0:1746143845.037165:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625157248 00000100:00100000:2.0:1746143845.037222:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16932 00000100:00100000:2.0:1746143845.037230:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625157248:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143845.037446:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143845.037450:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.037452:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.037454:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.037455:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:2.0:1746143845.037517:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625157248:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 288us (1155us total) trans 17179874025 rc 0/0 00000100:00100000:2.0:1746143845.037524:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16932 00000100:00100000:0.0:1746143845.045257:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.045296:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.045634:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.046189:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.046648:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625157632 00000100:00100000:2.0:1746143845.046659:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625157632 00000100:00100000:3.0:1746143845.046662:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625157760 00000100:00100000:3.0:1746143845.046666:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625157760 00000100:00100000:3.0:1746143845.046724:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625158144 00000100:00100000:3.0:1746143845.046727:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625158144 00000100:00100000:2.0:1746143845.046842:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7386 00000100:00100000:2.0:1746143845.046850:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625157760:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143845.046889:0:29557:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.046903:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.046904:0:29557:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.046909:0:29557:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.046940:0:29557:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.047655:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625158272 00000100:00100000:1.0:1746143845.047663:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625158272 00000100:00100000:0.0:1746143845.047687:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.047694:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625158656 00000100:00100000:1.0:1746143845.047696:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625158656 00000100:00100000:0.0:1746143845.047706:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7387 00000100:00100000:0.0:1746143845.047713:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625157632:12345-192.168.202.3@tcp:3:lfs.0 00000100:00100000:1.0:1746143845.047722:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7388 00000100:00100000:1.0:1746143845.047728:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625158272:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143845.047730:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.047739:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143845.047740:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143845.047742:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7389 00010000:00010000:0.0:1746143845.047743:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.047745:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.047748:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625158656:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143845.047752:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.047754:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.047756:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.047759:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.047760:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.047766:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.047767:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.047768:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.047769:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.047776:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.048427:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.048463:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625158912 00000100:00100000:1.0:1746143845.048466:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625158912 00000100:00100000:1.0:1746143845.048495:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7390 00000100:00100000:1.0:1746143845.048500:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625158912:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143845.048518:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.048526:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.048528:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.048531:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.048540:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.049683:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7391 00000100:00100000:3.0:1746143845.049693:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625158144:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143845.049805:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.049816:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.049818:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.049821:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.049831:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060829:0:29557:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060852:0:29557:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060860:0:29557:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060866:0:29557:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143845.060869:0:29557:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060877:0:29557:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060896:0:29557:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.060903:0:29557:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b6138 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29557 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.061039:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625157760:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 14184us (15735us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.061049:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7386 00010000:00010000:0.0:1746143845.061142:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.061152:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.061159:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.061169:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7e200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143845.061172:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.061179:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.061189:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.061195:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7e200/0x87925e4cb73b613f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [98304->1048575] (req 98304->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.061227:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625157632:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 13515us (15980us total) trans 0 rc 950272/950272 00000100:00100000:0.0:1746143845.061233:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7387 00010000:00010000:2.0:1746143845.070068:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.070087:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.070100:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.070106:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa16e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143845.070111:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.070119:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.070138:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.070144:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa16e00/0x87925e4cb73b6146 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.070222:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625158272:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 22488us (24027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.070234:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7388 00010000:00010000:2.0:1746143845.076351:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.076369:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.076378:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.076386:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143845.076390:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.076399:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.076417:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.076423:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551600/0x87925e4cb73b614d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.076529:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625158656:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 28774us (28836us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143845.076541:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7389 00010000:00010000:1.0:1746143845.082719:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.082739:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.082747:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.082760:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143845.082764:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.082771:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.082790:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.082796:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c000/0x87925e4cb73b6154 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.083958:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625158912:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 35448us (35522us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143845.083971:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7390 00010000:00010000:3.0:1746143845.090902:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.090994:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.091008:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.091015:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096010200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143845.091020:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.091027:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.091046:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.091052:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b615b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.091497:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625158144:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 41800us (45855us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.091508:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7391 00000100:00100000:0.0:1746143845.095398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.095673:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625159296 00000100:00100000:2.0:1746143845.095684:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625159296 00000100:00100000:2.0:1746143845.095747:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14068 00000100:00100000:2.0:1746143845.095756:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2938:x1830963625159296:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1746143845.095812:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.095839:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551a00/0x87925e4cb73b6107 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123a4 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.095874:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.095878:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143845.097051:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.097068:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.097079:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00010000:2.0:1746143845.097175:0:14991:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880129dc3480 reply state ffff880130909000 transno 8589945153 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.097182:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.097188:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.097191:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746143845.097194:0:14991:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143845.097290:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2938:x1830963625159296:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 1533us (1899us total) trans 8589945153 rc 0/0 00000100:00100000:2.0:1746143845.097297:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14068 00000100:00100000:0.0:1746143845.099508:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.099548:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.099573:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.099590:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.099617:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.099624:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625159424 00000100:00100000:2.0:1746143845.099634:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625159424 00000100:00100000:0.0:1746143845.099644:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.099669:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625159552 00000100:00100000:2.0:1746143845.099671:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625159552 00000100:00100000:0.0:1746143845.099681:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625159680 00000100:00100000:2.0:1746143845.099686:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625159808 00000100:00100000:0.0:1746143845.099687:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625159680 00000100:00100000:2.0:1746143845.099688:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625159808 00000100:00100000:2.0:1746143845.099697:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625159936 00000100:00100000:2.0:1746143845.099698:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625159936 00000100:00100000:2.0:1746143845.099717:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625160064 00000100:00100000:2.0:1746143845.099719:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625160064 00000100:00100000:0.0:1746143845.100164:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16933 00000100:00100000:0.0:1746143845.100173:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625159424:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143845.100314:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16934 00002000:00010000:0.0:1746143845.100314:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143845.100317:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143845.100319:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143845.100321:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143845.100323:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:3.0:1746143845.100324:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625159552:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:0.0:1746143845.100362:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dd46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625159424:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 191us (863us total) trans 17179874026 rc 0/0 00002000:00010000:3.0:1746143845.100410:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746143845.100410:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16935 00002000:00010000:3.0:1746143845.100413:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143844 -> 1746143845 00002000:00010000:3.0:1746143845.100414:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143843 -> 1746143845 00000100:00100000:0.0:1746143845.100415:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16933 00002000:00010000:3.0:1746143845.100416:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143844 -> 1746143845 00002000:00010000:3.0:1746143845.100419:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143845.100419:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625159808:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143845.100440:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625159552:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 117us (890us total) trans 21474841295 rc 0/0 00000100:00100000:3.0:1746143845.100446:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16934 00000100:00100000:3.0:1746143845.100458:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16936 00000100:00100000:3.0:1746143845.100464:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625159936:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:3.0:1746143845.100507:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:3.0:1746143845.100510:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.100511:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143844 -> 1746143845 00002000:00010000:3.0:1746143845.100513:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.100515:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:3.0:1746143845.100531:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625159936:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 67us (913us total) trans 17179874027 rc 0/0 00000100:00100000:0.0:1746143845.100535:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16937 00000100:00100000:3.0:1746143845.100538:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16936 00000100:00100000:0.0:1746143845.100540:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625159680:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:3.0:1746143845.100549:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16938 00000100:00100000:3.0:1746143845.100553:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625160064:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143845.100577:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143845.100580:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143845.100582:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143845.100584:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143844 -> 1746143845 00002000:00010000:0.0:1746143845.100586:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:3.0:1746143845.100591:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143845.100593:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.100595:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143844 -> 1746143845 00002000:00010000:3.0:1746143845.100597:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.100599:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143845.100600:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625159680:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 60us (1026us total) trans 21474841296 rc 0/0 00000100:00100000:0.0:1746143845.100605:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16937 00000100:00100000:3.0:1746143845.100616:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625160064:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 61us (971us total) trans 21474841297 rc 0/0 00000100:00100000:3.0:1746143845.100621:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16938 00002000:00010000:2.0:1746143845.100764:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143845.100767:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.100769:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.100771:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.100772:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143845.100811:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625159808:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 394us (1221us total) trans 17179874028 rc 0/0 00000100:00100000:2.0:1746143845.100818:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16935 00000100:00100000:1.0:1746143845.105391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.105476:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625160320 00000100:00100000:3.0:1746143845.105486:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625160320 00000100:00100000:3.0:1746143845.105538:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5472 00000100:00100000:3.0:1746143845.105544:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2938:x1830963625160320:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:3.0:1746143845.105609:0:7246:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b60ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412396 expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.105653:0:7246:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.105663:0:7246:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.105670:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.105697:0:7246:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.105707:0:7246:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 10 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.105719:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830963627534208:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.105795:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.108629:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830963627534208:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.108656:0:7246:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000100:00100000:0.0:1746143845.109904:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.110181:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625160448 00000100:00100000:2.0:1746143845.110190:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625160448 00010000:00010000:2.0:1746143845.110227:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 11 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.110276:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8296 00000100:00100000:2.0:1746143845.110284:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625160448:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.110297:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.110311:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 11 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.110322:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 11 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.110345:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551000/0x87925e4cb73b60f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841239d expref: 11 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.110373:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.110596:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746143845.110606:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746143845.110613:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746143845.110633:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.110694:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625160448:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 409us (795us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143845.110957:0:7246:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.110968:0:7246:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000100:00100000:2.0:1746143845.111283:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8296 00000040:00080000:3.0:1746143845.111487:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3284, 88 off276848 00000004:00080000:3.0:1746143845.111495:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335582305ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111589:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3274, 88 off275616 00000004:00080000:3.0:1746143845.111595:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335682478ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111651:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3275, 88 off275704 00000004:00080000:3.0:1746143845.111653:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335741402ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111661:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3285, 88 off276936 00000004:00080000:3.0:1746143845.111664:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335751572ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111676:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3286, 88 off277024 00000004:00080000:3.0:1746143845.111678:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335766318ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111686:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3276, 88 off275792 00000004:00080000:3.0:1746143845.111688:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335776095ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111695:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3277, 88 off275880 00000004:00080000:3.0:1746143845.111697:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335785038ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111703:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3278, 88 off275968 00000004:00080000:3.0:1746143845.111705:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335793350ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111712:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3287, 88 off277112 00000004:00080000:3.0:1746143845.111714:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335801570ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111721:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3279, 88 off276056 00000004:00080000:3.0:1746143845.111723:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335810873ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111730:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3288, 88 off277200 00000004:00080000:3.0:1746143845.111732:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335820215ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111742:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3280, 88 off276144 00000004:00080000:3.0:1746143845.111745:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335832923ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.111752:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3289, 88 off277288 00000004:00080000:3.0:1746143845.111755:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335842668ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111763:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3290, 88 off277376 00000004:00080000:3.0:1746143845.111766:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335854210ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111774:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3291, 88 off277464 00000004:00080000:3.0:1746143845.111777:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335864722ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111785:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3292, 88 off277552 00000004:00080000:3.0:1746143845.111787:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904335875340ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.111796:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3281, 88 off276232 00000004:00080000:3.0:1746143845.111800:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904335888277ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143845.115963:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945154 is committed 00000004:00080000:2.0:1746143845.115976:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2494 committed 00000004:00080000:2.0:1746143845.115995:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2508 committed 00000004:00080000:2.0:1746143845.116001:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2507 committed 00000004:00080000:2.0:1746143845.116003:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2506 committed 00000004:00080000:2.0:1746143845.116005:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2505 committed 00000004:00080000:2.0:1746143845.116006:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2493 committed 00000004:00080000:2.0:1746143845.116007:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2504 committed 00000004:00080000:2.0:1746143845.116009:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2492 committed 00000004:00080000:2.0:1746143845.116010:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2503 committed 00000004:00080000:2.0:1746143845.116013:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2491 committed 00000004:00080000:2.0:1746143845.116014:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2490 committed 00000004:00080000:2.0:1746143845.116016:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2489 committed 00000004:00080000:2.0:1746143845.116017:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2502 committed 00000004:00080000:2.0:1746143845.116018:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2501 committed 00000004:00080000:2.0:1746143845.116019:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2488 committed 00000004:00080000:2.0:1746143845.116020:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2487 committed 00000004:00080000:2.0:1746143845.116022:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2500 committed 00000004:00010000:2.0:1746143845.116090:0:7246:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009eb84700 reply state ffff8801313b3800 transno 8589945154 ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.116094:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.116105:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.116112:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.116124:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.116133:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d551600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.116134:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.116137:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143845.116141:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143845.116141:0:7246:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746143845.116147:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.116148:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.116149:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143845.116157:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.116157:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b60ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412396 expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.116160:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.116162:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.116171:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d551600/0x87925e4cb73b6162 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00080000:2.0:1746143845.116262:0:7246:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143845.116330:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2938:x1830963625160320:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 10784us (10948us total) trans 8589945154 rc 0/0 00000100:00100000:2.0:1746143845.116340:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5472 00000100:00100000:2.0:1746143845.116377:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627534336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.116381:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627534720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.116431:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116434:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627534464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.116464:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116488:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627534976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.116500:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116517:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627535488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.116524:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534336 00000100:00100000:0.0:1746143845.116531:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.116533:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534336 00010000:00010000:3.0:1746143845.116543:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00000100:00100000:0.0:1746143845.116547:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627536000:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746143845.116550:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.116554:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.116558:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096010c00 already unused, calling callback (ffffffffa0f2a690) 00000100:00100000:0.0:1746143845.116559:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143845.116560:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143845.116565:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7246 initiator: MDT0 00000100:00100000:1.0:1746143845.116565:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534464 00000100:00100000:1.0:1746143845.116567:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534464 00010000:00010000:3.0:1746143845.116572:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:0.0:1746143845.116572:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00010000:00010000:3.0:1746143845.116574:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143845.116576:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00000100:00100000:0.0:1746143845.116576:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627534592:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143845.116580:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6169 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00000100:00100000:1.0:1746143845.116580:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534976 00000100:00100000:1.0:1746143845.116582:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534976 00000100:00100000:0.0:1746143845.116588:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.116608:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535488 00000100:00100000:0.0:1746143845.116624:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627535104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.116630:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627534848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.116640:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116654:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627535616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143845.116656:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116671:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.116677:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627535360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.116683:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627536128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143845.116700:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116713:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627536000 00000100:00100000:2.0:1746143845.116714:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627535872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.116718:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627536000 00000100:00100000:2.0:1746143845.116729:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.116737:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143845.116741:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534592 00000100:00100000:2.0:1746143845.116742:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627535744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.116743:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534592 00000100:00100000:0.0:1746143845.116750:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535104 00000100:00100000:0.0:1746143845.116751:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535104 00000100:00100000:2.0:1746143845.116754:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116758:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534848 00000100:00100000:0.0:1746143845.116760:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534848 00000100:00100000:2.0:1746143845.116762:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627536256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.116766:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535616 00000100:00100000:0.0:1746143845.116767:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535616 00000100:00100000:0.0:1746143845.116773:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535360 00000100:00100000:0.0:1746143845.116775:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535360 00000100:00100000:2.0:1746143845.116776:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116781:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535872 00000100:00100000:0.0:1746143845.116782:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535872 00000100:00100000:0.0:1746143845.116788:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535744 00000100:00100000:0.0:1746143845.116790:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535744 00000100:00100000:2.0:1746143845.116791:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116796:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627536256 00000100:00100000:0.0:1746143845.116798:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627536256 00000100:00100000:2.0:1746143845.116802:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627535232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.116803:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627534720 00000100:00100000:0.0:1746143845.116805:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627534720 00000100:00100000:0.0:1746143845.116814:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16939 00000100:00100000:2.0:1746143845.116816:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.116821:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627534336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.116833:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.116851:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627535232 00000100:00100000:2.0:1746143845.116854:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535232 00000100:00100000:2.0:1746143845.116870:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627536128 00000100:00100000:2.0:1746143845.116872:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627536128 00000100:00100000:2.0:1746143845.116882:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16940 00000100:00100000:2.0:1746143845.116887:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627534464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143845.116985:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143845.116988:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.116990:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.116991:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.116993:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00002000:00010000:2.0:1746143845.116996:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143845.117000:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.117002:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.117004:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.117005:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143845.117026:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963627534336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (594us total) trans 17179874029 rc 0/0 00000100:00100000:2.0:1746143845.117032:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963627534464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 144us (568us total) trans 17179874030 rc 0/0 00000100:00100000:0.0:1746143845.117033:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16939 00000100:00100000:2.0:1746143845.117039:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16940 00000100:00100000:0.0:1746143845.117047:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16941 00000100:00100000:0.0:1746143845.117052:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627534976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.117053:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16942 00000100:00100000:2.0:1746143845.117059:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963627536000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.117109:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963627534976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (607us total) trans 17179874031 rc 0/0 00000100:00100000:0.0:1746143845.117114:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16941 00000100:00100000:0.0:1746143845.117124:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16943 00002000:00010000:2.0:1746143845.117125:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:2.0:1746143845.117128:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000100:00100000:0.0:1746143845.117128:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627534592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143845.117129:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.117131:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.117133:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:2.0:1746143845.117155:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627536000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (594us total) trans 21474841298 rc 0/0 00000100:00100000:2.0:1746143845.117160:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16942 00002000:00010000:0.0:1746143845.117161:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:0.0:1746143845.117164:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.117166:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.117168:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.117169:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:2.0:1746143845.117172:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16944 00000100:00100000:2.0:1746143845.117178:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963627535104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.117187:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963627534592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (597us total) trans 17179874032 rc 0/0 00000100:00100000:0.0:1746143845.117193:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16943 00000100:00100000:0.0:1746143845.117203:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16945 00000100:00100000:0.0:1746143845.117207:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3774:x1830963627534848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143845.117219:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143845.117221:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.117223:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.117225:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.117227:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:2.0:1746143845.117246:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3771:x1830963627535104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (606us total) trans 17179874033 rc 0/0 00000100:00100000:2.0:1746143845.117252:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16944 00000100:00100000:0.0:1746143845.117257:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3774:x1830963627534848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (600us total) trans 17179874034 rc 0/0 00000100:00100000:0.0:1746143845.117262:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16945 00000100:00100000:2.0:1746143845.117266:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16946 00000100:00100000:2.0:1746143845.117271:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963627535616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.117274:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16947 00000100:00100000:0.0:1746143845.117278:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963627535360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143845.117322:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143845.117324:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.117326:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.117328:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:2.0:1746143845.117329:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00002000:00010000:0.0:1746143845.117336:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143845.117338:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.117340:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.117342:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.117343:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143845.117348:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627535616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (677us total) trans 21474841299 rc 0/0 00000100:00100000:2.0:1746143845.117354:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16946 00000100:00100000:0.0:1746143845.117363:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627535360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (662us total) trans 21474841300 rc 0/0 00000100:00100000:2.0:1746143845.117366:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16948 00000100:00100000:0.0:1746143845.117369:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16947 00000100:00100000:2.0:1746143845.117371:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627535872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.117381:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16949 00000100:00100000:0.0:1746143845.117385:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963627535744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143845.117424:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143845.117426:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000100:00100000:2.0:1746143845.117428:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3774:x1830963627535872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (697us total) trans 21474841301 rc 0/0 00002000:00010000:0.0:1746143845.117428:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143845.117430:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143845.117432:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143845.117434:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16948 00000100:00100000:2.0:1746143845.117444:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16950 00000100:00100000:2.0:1746143845.117450:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627536256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.117450:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627535744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (694us total) trans 21474841302 rc 0/0 00000100:00100000:0.0:1746143845.117455:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16949 00000100:00100000:0.0:1746143845.117466:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16951 00000100:00100000:0.0:1746143845.117470:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627534720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.117502:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627536256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (725us total) trans 21474841303 rc 0/0 00000100:00100000:2.0:1746143845.117507:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16950 00000100:00100000:2.0:1746143845.117518:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16952 00000100:00100000:0.0:1746143845.117518:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627534720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (726us total) trans 17179874035 rc 0/0 00000100:00100000:2.0:1746143845.117522:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627535232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.117524:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16951 00000100:00100000:0.0:1746143845.117534:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16953 00000100:00100000:0.0:1746143845.117539:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963627536128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143845.117563:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:2.0:1746143845.117565:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.117567:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.117569:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.117571:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143845.117586:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627536128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (753us total) trans 21474841304 rc 0/0 00000100:00100000:0.0:1746143845.117590:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16953 00000100:00100000:2.0:1746143845.117592:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627535232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (774us total) trans 17179874036 rc 0/0 00000100:00100000:2.0:1746143845.117597:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16952 00000004:00080000:2.0:1746143845.117635:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136acb800/2, rc 0, transno 17179874035 00000100:00100000:2.0:1746143845.117652:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627534720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.117661:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4e680/2, rc 0, transno 17179874036 00000100:00100000:2.0:1746143845.117664:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627535232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.117680:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129dc0a80/2, rc 0, transno 17179874032 00000100:00100000:2.0:1746143845.117683:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627534592:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.117690:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8000/2, rc 0, transno 17179874033 00000100:00100000:2.0:1746143845.117692:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627535104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.117701:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86300/2, rc 0, transno 21474841299 00000100:00100000:2.0:1746143845.117704:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627535616:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143845.117717:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb480/2, rc 0, transno 21474841304 00000100:00100000:2.0:1746143845.117720:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627536128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143845.117726:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb100/2, rc 0, transno 21474841298 00000100:00100000:2.0:1746143845.117729:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627536000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143845.117735:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129dc1c00/2, rc 0, transno 17179874030 00000100:00100000:2.0:1746143845.117737:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627534464:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.117744:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac9880/2, rc 0, transno 17179874031 00000100:00100000:2.0:1746143845.117746:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627534976:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.117762:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e9c00/2, rc 0, transno 21474841302 00000100:00100000:2.0:1746143845.117765:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627535744:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143845.117770:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e8700/2, rc 0, transno 21474841303 00000100:00100000:2.0:1746143845.117772:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627536256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.117778:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627535488 00000004:00080000:2.0:1746143845.117780:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb84380/2, rc 0, transno 21474841300 00000100:00100000:2.0:1746143845.117782:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627535360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143845.117787:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e8000/2, rc 0, transno 21474841301 00000100:00100000:1.0:1746143845.117800:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16954 00000100:00100000:1.0:1746143845.117805:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627535488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143845.117861:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143845.117864:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:1.0:1746143845.117866:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:1.0:1746143845.117867:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:1.0:1746143845.117869:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143845.117895:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627535488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (1362us total) trans 21474841305 rc 0/0 00000100:00100000:1.0:1746143845.117900:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16954 00000100:00100000:3.0:1746143845.118417:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746143845.118427:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627536384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.118454:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143845.118484:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86a00/2, rc 0, transno 21474841305 00000100:00100000:3.0:1746143845.118488:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627535488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.118533:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627536384 00000100:00100000:0.0:1746143845.118536:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627536384 00000100:00100000:0.0:1746143845.118555:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16955 00000100:00100000:0.0:1746143845.118559:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627536384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.118627:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627536384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (172us total) trans 17179874037 rc 0/0 00000100:00100000:0.0:1746143845.118632:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16955 00000004:00080000:3.0:1746143845.118678:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4dc00/2, rc 0, transno 17179874037 00000100:00100000:3.0:1746143845.118681:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627536384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.118791:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627535872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143845.118807:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129dc1f80/2, rc 0, transno 17179874029 00000100:00100000:2.0:1746143845.118810:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129dc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627534336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.118819:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136ac8a80/2, rc 0, transno 17179874034 00000100:00100000:2.0:1746143845.118821:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627534848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.122660:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.122864:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625160576 00000100:00100000:2.0:1746143845.122873:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625160576 00000100:00100000:2.0:1746143845.123796:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14069 00000100:00100000:2.0:1746143845.123807:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2938:x1830963625160576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.123832:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.123854:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123d5 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.123929:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.123943:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.123961:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.123964:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143845.123967:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da800, rc 0) 00000100:00100000:2.0:1746143845.124207:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2938:x1830963625160576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 401us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.124213:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14069 00000100:00100000:0.0:1746143845.126675:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.126943:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625160832 00000100:00100000:2.0:1746143845.126953:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625160832 00000100:00100000:2.0:1746143845.126992:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5473 00000100:00100000:2.0:1746143845.126998:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2938:x1830963625160832:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143845.127200:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2938:x1830963625160832:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 201us (532us total) trans 8589945155 rc 0/0 00000100:00100000:2.0:1746143845.127208:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5473 00000100:00100000:0.0:1746143845.144474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.144534:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.145394:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625161088 00000100:00100000:3.0:1746143845.145406:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625161088 00000100:00100000:3.0:1746143845.145477:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625161344 00000100:00100000:3.0:1746143845.145480:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625161344 00000100:00100000:3.0:1746143845.145501:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14070 00000100:00100000:3.0:1746143845.145508:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+260:2952:x1830963625161088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.145532:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.145553:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096011c00/0x87925e4cb73b6177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123dc expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.145553:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14071 00000100:00100000:1.0:1746143845.145562:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2951:x1830963625161344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.145573:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.145581:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55aa00/0x87925e4cb73b617e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.145629:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.145630:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00000100:00080000:0.0:1746143845.145671:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143845.145672:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145685:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145699:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145705:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145710:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145814:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145822:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.145828:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143845.145836:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143845.145940:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146404:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146413:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146415:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146421:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146423:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146426:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146429:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146430:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146434:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55be00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.146438:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.146443:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.146453:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143845.146456:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143845.146460:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.146469:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146473:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146479:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146484:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143845.146489:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143845.146496:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.146501:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.146506:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.146510:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55a200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.146512:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146513:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146516:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146518:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146521:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b45fd00) 00010000:00010000:3.0:1746143845.146522:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146523:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.146525:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146525:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146529:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55dc00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.146529:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143845.146531:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146534:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146540:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143845.146542:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.146544:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146547:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55dc00/0x87925e4cb73b618c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146558:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55aa00/0x87925e4cb73b617e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.146568:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.146571:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146576:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146578:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.146580:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.146580:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143845.146582:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b800, rc 0) 00010000:00010000:3.0:1746143845.146583:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55c000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143845.146585:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146589:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146593:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b45fd00) 00010000:00010000:3.0:1746143845.146594:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.146596:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146599:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c000/0x87925e4cb73b61a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.146622:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096011c00/0x87925e4cb73b6177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.146632:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 262 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.146637:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:1.0:1746143845.146637:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2951:x1830963625161344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1077us (2102us total) trans 8589945156 rc 0/0 00010000:00010000:3.0:1746143845.146639:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143845.146641:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:1.0:1746143845.146643:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14071 00000100:00100000:3.0:1746143845.146889:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2952:x1830963625161088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1381us (2424us total) trans 8589945157 rc 0/0 00000100:00100000:3.0:1746143845.146896:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14070 00000100:00100000:0.0:1746143845.150602:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.150643:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.150653:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625161728 00000100:00100000:3.0:1746143845.150663:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625161728 00000100:00100000:0.0:1746143845.150685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.150705:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625162112 00000100:00100000:0.0:1746143845.150705:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.150708:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625162112 00000100:00100000:3.0:1746143845.150727:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14072 00000100:00100000:3.0:1746143845.150735:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2950:x1830963625161728:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143845.150740:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14073 00000100:00100000:0.0:1746143845.150747:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:2948:x1830963625162112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.150758:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143845.150758:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143845.151079:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625161472 00000100:00100000:2.0:1746143845.151083:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625161472 00000100:00100000:2.0:1746143845.151133:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625161856 00000100:00100000:2.0:1746143845.151136:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625161856 00000100:00100000:2.0:1746143845.151155:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16956 00000100:00100000:2.0:1746143845.151160:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2952:x1830963625161472:12345-192.168.202.3@tcp:101:cat.0 00000100:00080000:1.0:1746143845.151187:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143845.151221:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.151235:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123ea expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.151262:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.151264:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.151271:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.151548:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b61c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123ff expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.151549:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75200/0x87925e4cb73b61cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123f1 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.151644:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143845.151644:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143845.151680:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 30 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.151692:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db600, rc 0) 00000100:00100000:2.0:1746143845.151749:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+30:2952:x1830963625161472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 587us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.151755:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16956 00000100:00100000:2.0:1746143845.151775:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16957 00000100:00100000:2.0:1746143845.151780:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2951:x1830963625161856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.151787:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.151793:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484123f8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.151804:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.151805:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.151809:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 14 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.151816:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 14 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.151821:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da200, rc 0) 00000100:00100000:2.0:1746143845.151835:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2951:x1830963625161856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 55us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.151839:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16957 00010000:00010000:0.0:1746143845.152148:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.152156:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.152161:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143845.152226:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.152235:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143845.152329:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.152341:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 263 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143845.152353:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627536512:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143845.152426:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.152437:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 10 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143845.152444:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627536640:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.152463:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.155540:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.155718:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625162368 00000100:00100000:3.0:1746143845.155727:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625162368 00002000:00100000:3.0:1746143845.155775:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012457d880 x1830963625162368/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.155785:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d880 with x1830963625162368 ext(0->1048575) 00002000:00010000:3.0:1746143845.155790:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d880 00000100:00100000:3.0:1746143845.155815:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7392 00000100:00100000:3.0:1746143845.155822:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625162368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143845.156701:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627536512:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.156713:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627536640:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143845.156737:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:2.0:1746143845.159462:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.159513:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625162624 00000100:00100000:0.0:1746143845.159523:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625162624 00010000:00010000:0.0:1746143845.159561:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 11 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.159569:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.159610:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625162496 00000100:00100000:0.0:1746143845.159612:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625162496 00010000:00010000:0.0:1746143845.159624:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 264 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143845.159639:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8297 00000100:00100000:0.0:1746143845.159645:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625162624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143845.159657:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8298 00010000:00010000:0.0:1746143845.159657:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.159663:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 11 pid: 6587 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.159667:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963625162496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.159673:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 11 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.159675:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.159680:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 264 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.159697:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b800/0x87925e4cb73b619a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123e3 expref: 11 pid: 6587 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.159704:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 264 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.159716:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b61af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123dc expref: 264 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.159719:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143845.159723:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143845.159732:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143845.159738:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143845.159745:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143845.159750:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143845.159754:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.159760:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.159763:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143845.159776:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.159808:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:2009:x1830963625162496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.159814:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625162624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.159815:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8298 00000100:00100000:0.0:1746143845.159821:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8297 00010000:00010000:3.0:1746143845.159857:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.159865:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143845.159884:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143845.160046:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75200/0x87925e4cb73b61cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.160062:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.160068:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.160071:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143845.160073:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00010000:00010000:1.0:1746143845.160084:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143845.160091:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:3.0:1746143845.160098:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2950:x1830963625161728:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9364us (9507us total) trans 8589945158 rc 0/0 00000004:00200000:1.0:1746143845.160103:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000100:00100000:3.0:1746143845.160104:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14072 00010000:00010000:1.0:1746143845.160327:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b7a00/0x87925e4cb73b61c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.160353:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 263 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.160359:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143845.160361:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143845.160363:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6400, rc 0) 00000100:00100000:1.0:1746143845.160382:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2948:x1830963625162112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9636us (9697us total) trans 8589945159 rc 0/0 00000100:00100000:1.0:1746143845.160388:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14073 00000100:00100000:0.0:1746143845.163620:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.163680:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625162880 00000100:00100000:2.0:1746143845.163690:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625162880 00002000:00100000:2.0:1746143845.163735:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012457e680 x1830963625162880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.163744:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e680 with x1830963625162880 ext(0->1048575) 00002000:00010000:2.0:1746143845.163749:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457e680 00000100:00100000:2.0:1746143845.163778:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7393 00000100:00100000:2.0:1746143845.163785:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625162880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.165624:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625162368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9793us (10087us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143845.165636:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7392 00002000:00100000:0.0:1746143845.165646:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012457d880 x1830963625162368/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143845.165660:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457d880 with x1830963625162368 ext(0->1048575) 00002000:00010000:0.0:1746143845.165665:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457d880 00000100:00100000:0.0:1746143845.175409:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.175520:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163008 00000100:00100000:1.0:1746143845.175531:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163008 00000100:00100000:1.0:1746143845.175595:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16958 00000100:00100000:1.0:1746143845.175604:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2951:x1830963625163008:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.175625:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.175645:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412406 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.175673:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.175675:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.175683:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.175699:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.175709:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504e00, rc 0) 00000100:00100000:1.0:1746143845.175760:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2951:x1830963625163008:12345-192.168.202.3@tcp:101:cat.0 Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.175762:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625162880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11975us (12151us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143845.175766:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16958 00000100:00100000:2.0:1746143845.175775:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7393 00002000:00100000:2.0:1746143845.175784:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012457e680 x1830963625162880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.175794:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012457e680 with x1830963625162880 ext(0->1048575) 00002000:00010000:2.0:1746143845.175799:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012457e680 00000100:00100000:0.0:1746143845.177649:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.177752:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163136 00000100:00100000:1.0:1746143845.177760:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163136 00000100:00100000:1.0:1746143845.177810:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14074 00000100:00100000:1.0:1746143845.177817:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2948:x1830963625163136:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143845.177838:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.177856:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504800/0x87925e4cb73b61fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841240d expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.178111:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504800/0x87925e4cb73b61fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841240d expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.178125:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504800/0x87925e4cb73b61fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841240d expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.178143:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143845.178145:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143845.178149:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504800, rc 0) 00000100:00100000:1.0:1746143845.178196:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2948:x1830963625163136:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 379us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.178202:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14074 00000100:00100000:0.0:1746143845.183950:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.184045:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.184271:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163264 00000100:00100000:3.0:1746143845.184282:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163264 00000100:00100000:3.0:1746143845.184340:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163520 00000100:00100000:3.0:1746143845.184342:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163520 00000100:00100000:3.0:1746143845.184359:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14075 00000100:00100000:3.0:1746143845.184366:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2951:x1830963625163264:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143845.184378:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14076 00000100:00100000:2.0:1746143845.184387:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+264:2948:x1830963625163520:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.184390:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.184395:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.184397:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143845.184408:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412414 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.184481:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504800/0x87925e4cb73b61fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841240d expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.184585:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.184597:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.184613:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.184616:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143845.184619:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74200, rc 0) 00000100:00100000:3.0:1746143845.184662:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2951:x1830963625163264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 297us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.184668:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14075 00010000:00010000:2.0:1746143845.185133:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.185138:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143845.185147:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b620a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841241b expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.185179:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.185190:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.185197:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.185202:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.185230:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.185242:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 10 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.185253:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627536768:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.185351:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.185359:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 7 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.185366:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627536896:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.187093:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.187174:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163648 00000100:00100000:3.0:1746143845.187182:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163648 00000100:00100000:3.0:1746143845.187234:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16959 00000100:00100000:3.0:1746143845.187239:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2952:x1830963625163648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.187253:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.187266:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412422 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.187288:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.187289:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.187296:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.187317:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.187327:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:3.0:1746143845.187356:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2952:x1830963625163648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 117us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.187361:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16959 00000100:00080000:1.0:1746143845.187363:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143845.187475:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.190327:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.190539:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163776 00000100:00100000:3.0:1746143845.190548:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163776 00000100:00100000:3.0:1746143845.190609:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14077 00000100:00100000:3.0:1746143845.190617:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2952:x1830963625163776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.190638:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.190658:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412429 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.190718:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.190727:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.190744:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.190755:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 266 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.190766:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.190769:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143845.190771:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.190777:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:3.0:1746143845.190818:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2952:x1830963625163776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 202us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.190823:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14077 00000100:00100000:2.0:1746143845.191187:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627536768:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.191384:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.191416:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.191752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.191794:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625163904 00000100:00100000:2.0:1746143845.191799:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625163904 00000100:00100000:2.0:1746143845.191811:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625164032 00000100:00100000:2.0:1746143845.191812:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625164032 00010000:00010000:2.0:1746143845.191833:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 8 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.191852:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8299 00000100:00100000:2.0:1746143845.191858:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625164032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.191868:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.191873:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 8 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.191883:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 8 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.191900:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.191903:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.191909:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.191932:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.191970:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625164032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.191977:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8299 00000100:00100000:2.0:1746143845.191998:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625164288 00000100:00100000:2.0:1746143845.192001:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625164288 00002000:00100000:2.0:1746143845.192027:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800939a7b80 x1830963625164288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.192035:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7b80 with x1830963625164288 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.192040:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7b80 00000100:00100000:2.0:1746143845.192054:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7394 00000100:00100000:2.0:1746143845.192058:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625164288:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143845.192781:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 11 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.192798:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8300 00000100:00100000:2.0:1746143845.192803:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625163904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.192809:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.192813:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 11 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.192820:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 11 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.192833:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74200/0x87925e4cb73b6203 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412414 expref: 11 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.192849:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.192852:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.192859:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.192865:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.192872:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 265 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.192885:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.192901:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4da2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625163904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.192906:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8300 00010000:00010000:3.0:1746143845.194196:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6170 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123d5 expref: 7 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.194218:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627536896:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.194240:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.194247:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.194251:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14991 initiator: MDT0 00000040:00080000:3.0:1746143845.194508:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3293, 88 off277640 00000004:00080000:3.0:1746143845.194514:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418601322ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194540:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3282, 88 off276320 00000004:00080000:3.0:1746143845.194544:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418631655ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194554:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3283, 88 off276408 00000004:00080000:3.0:1746143845.194556:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418644132ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194563:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3294, 88 off277728 00000004:00080000:3.0:1746143845.194565:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418653467ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194572:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3295, 88 off277816 00000004:00080000:3.0:1746143845.194575:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418662858ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194582:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3284, 88 off276496 00000004:00080000:3.0:1746143845.194585:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418672852ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194592:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3285, 88 off276584 00000004:00080000:3.0:1746143845.194595:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418682557ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194601:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3286, 88 off276672 00000004:00080000:3.0:1746143845.194604:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418691618ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194611:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3296, 88 off277904 00000004:00080000:3.0:1746143845.194613:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418700583ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194619:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3287, 88 off276760 00000004:00080000:3.0:1746143845.194621:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418708914ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194628:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3297, 88 off277992 00000004:00080000:3.0:1746143845.194629:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418717452ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194636:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3288, 88 off276848 00000004:00080000:3.0:1746143845.194638:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418726123ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143845.194645:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3298, 88 off278080 00000004:00080000:3.0:1746143845.194647:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418734952ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194654:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3299, 88 off278168 00000004:00080000:3.0:1746143845.194657:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418744589ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194664:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3300, 88 off278256 00000004:00080000:3.0:1746143845.194666:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418753952ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194672:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3301, 88 off278344 00000004:00080000:3.0:1746143845.194675:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 904418762708ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143845.194682:0:14991:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3289, 88 off276936 00000004:00080000:3.0:1746143845.194685:0:14991:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 904418772582ns, next at 850789974850ns, rc = 0 00000100:00100000:0.0:1746143845.201158:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625164288:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9087us (9394us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143845.201172:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7394 00002000:00100000:0.0:1746143845.201185:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800939a7b80 x1830963625164288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143845.201195:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a7b80 with x1830963625164288 ext(1048576->2097151) 00002000:00010000:0.0:1746143845.201201:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800939a7b80 00000001:00080000:3.0:1746143845.201334:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945160 is committed 00000004:00080000:3.0:1746143845.201340:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2502 committed 00000004:00080000:3.0:1746143845.202106:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2517 committed 00000004:00080000:3.0:1746143845.202127:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2516 committed 00000004:00080000:3.0:1746143845.202129:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2515 committed 00000004:00080000:3.0:1746143845.202130:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2514 committed 00000004:00080000:3.0:1746143845.202131:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2501 committed 00000004:00080000:3.0:1746143845.202133:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2513 committed 00000004:00080000:3.0:1746143845.202134:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2500 committed 00000004:00080000:3.0:1746143845.202136:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2512 committed 00000004:00080000:3.0:1746143845.202137:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2499 committed 00000004:00080000:3.0:1746143845.202139:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2498 committed 00000004:00080000:3.0:1746143845.202140:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2497 committed 00000004:00080000:3.0:1746143845.202141:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2511 committed 00000004:00080000:3.0:1746143845.202143:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2510 committed 00000004:00080000:3.0:1746143845.202146:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2496 committed 00000004:00080000:3.0:1746143845.202150:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2495 committed 00000004:00080000:3.0:1746143845.202153:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2509 committed 00000001:00080000:3.0:1746143845.202163:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945158 is committed 00000001:00080000:3.0:1746143845.202169:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945155 is committed 00000100:00100000:3.0:1746143845.202203:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627537024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.202250:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.202255:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627537152:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143845.202267:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.202274:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.202278:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627537536:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143845.202282:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:0.0:1746143845.202284:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627537664:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143845.202285:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143845.202289:0:14991:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.202290:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143845.202307:0:14991:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.202314:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.202314:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537024 00000100:00100000:0.0:1746143845.202321:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537024 00000100:00100000:2.0:1746143845.202327:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627537408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.202329:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800939a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627537280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.202331:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.202345:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.202356:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537152 00000100:00100000:3.0:1746143845.202359:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627537792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.202359:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537152 00000100:00100000:3.0:1746143845.202371:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.202371:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537536 00000100:00100000:0.0:1746143845.202374:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537536 00000100:00100000:2.0:1746143845.202377:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537664 00000100:00100000:2.0:1746143845.202379:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537664 00000100:00100000:0.0:1746143845.202385:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537280 00000100:00100000:0.0:1746143845.202386:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537280 00000100:00100000:2.0:1746143845.202389:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537792 00000100:00100000:2.0:1746143845.202390:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537792 00000100:00100000:3.0:1746143845.202393:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16960 00000100:00100000:0.0:1746143845.202801:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16961 00000100:00100000:0.0:1746143845.202807:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627537152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143845.202949:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143845.202952:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.202954:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.202956:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.202958:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143845.202983:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627537152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (708us total) trans 17179874038 rc 0/0 00000100:00100000:0.0:1746143845.202988:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16961 00000100:00100000:2.0:1746143845.202997:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16962 00000100:00100000:0.0:1746143845.203001:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16963 00000100:00100000:2.0:1746143845.203003:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963627537536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.203005:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627537664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.203056:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627537664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (724us total) trans 17179874039 rc 0/0 00000100:00100000:0.0:1746143845.203061:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16963 00000100:00100000:0.0:1746143845.203069:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964 00000100:00100000:2.0:1746143845.203073:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3771:x1830963627537536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (781us total) trans 17179874040 rc 0/0 00000100:00100000:0.0:1746143845.203073:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963627537280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.203078:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16962 00000100:00100000:2.0:1746143845.203088:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965 00000100:00100000:2.0:1746143845.203092:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3773:x1830963627537792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143845.203106:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:0.0:1746143845.203109:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.203110:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.203112:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:0.0:1746143845.203113:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:0.0:1746143845.203132:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3773:x1830963627537280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (786us total) trans 17179874041 rc 0/0 00000100:00100000:0.0:1746143845.203136:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964 00000004:00080000:0.0:1746143845.203168:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a7800/2, rc 0, transno 17179874038 00000100:00100000:0.0:1746143845.203174:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627537152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143845.203181:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322d180/2, rc 0, transno 17179874039 00000100:00100000:0.0:1746143845.203183:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627537664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.203207:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143845.203212:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627538048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.203228:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.203244:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538048 00000100:00100000:0.0:1746143845.203248:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538048 00000100:00100000:0.0:1746143845.203262:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16966 00000100:00100000:0.0:1746143845.203265:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627538048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143845.203275:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143845.203278:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.203279:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.203281:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.203283:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:2.0:1746143845.203306:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3773:x1830963627537792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (926us total) trans 17179874042 rc 0/0 00000100:00100000:2.0:1746143845.203311:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965 00000100:00100000:2.0:1746143845.203328:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.203330:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627538048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (100us total) trans 17179874043 rc 0/0 00000100:00100000:0.0:1746143845.203334:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16966 00000100:00100000:2.0:1746143845.203339:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627537920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143845.203342:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537408 00000100:00100000:0.0:1746143845.203345:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537408 00000100:00100000:2.0:1746143845.203353:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.203355:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627537920 00000100:00100000:0.0:1746143845.203356:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627537920 00000100:00100000:0.0:1746143845.203364:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967 00000100:00100000:0.0:1746143845.203367:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963627537408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143845.203369:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968 00000100:00100000:2.0:1746143845.203373:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963627537920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143845.203412:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:2.0:1746143845.203415:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.203416:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143845.203418:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143845.203419:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143845.203420:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3774:x1830963627537408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (91us total) trans 17179874044 rc 0/0 00000100:00100000:0.0:1746143845.203425:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967 00000100:00100000:2.0:1746143845.203433:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963627537920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (79us total) trans 17179874045 rc 0/0 00000100:00100000:2.0:1746143845.203437:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968 00000004:00080000:0.0:1746143845.203445:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322df80/2, rc 0, transno 17179874043 00000100:00100000:0.0:1746143845.203449:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627538048:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.203455:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a7100/2, rc 0, transno 17179874044 00000100:00100000:2.0:1746143845.203458:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627537408:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.203463:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322ca80/2, rc 0, transno 17179874045 00000100:00100000:2.0:1746143845.203466:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627537920:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143845.203492:0:14991:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 264 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.203502:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627538176:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143845.203544:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2480 going to sleep for 11 seconds 00000004:00080000:2.0:1746143845.203647:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a6d80/2, rc 0, transno 17179874041 00000100:00100000:2.0:1746143845.203651:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627537280:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.203656:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009322f800/2, rc 0, transno 17179874042 00000100:00100000:2.0:1746143845.203659:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627537792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143845.203671:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a6680/2, rc 0, transno 17179874040 00000100:00100000:2.0:1746143845.203674:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627537536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143845.203746:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963627537024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143845.203799:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143845.203802:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.203803:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.203805:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.203807:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:3.0:1746143845.203830:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963627537024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1431us (1580us total) trans 17179874046 rc 0/0 00000100:00100000:3.0:1746143845.203835:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16960 00000100:00100000:3.0:1746143845.205010:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627538432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.205048:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.205079:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627538944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.205137:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.205153:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746143845.205158:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627538560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.205172:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.205184:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627539072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.205197:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.205217:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538432 00000100:00100000:3.0:1746143845.205222:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538432 00000100:00100000:3.0:1746143845.205244:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538944 00000100:00100000:3.0:1746143845.205245:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538944 00000100:00100000:3.0:1746143845.205255:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538560 00000100:00100000:3.0:1746143845.205256:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538560 00000100:00100000:3.0:1746143845.205264:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627539072 00000100:00100000:3.0:1746143845.205266:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627539072 00000100:00100000:3.0:1746143845.205276:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969 00000100:00100000:3.0:1746143845.205281:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963627538432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143845.205387:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143845.205390:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.205392:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.205394:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.205396:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143845.205420:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dd46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3773:x1830963627538432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (371us total) trans 21474841306 rc 0/0 00000100:00100000:3.0:1746143845.205425:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969 00000100:00100000:3.0:1746143845.205552:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970 00000100:00100000:3.0:1746143845.205557:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963627538944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143845.205596:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:3.0:1746143845.205599:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143845.205600:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143845.205602:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143845.205604:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143845.205620:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3773:x1830963627538944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (483us total) trans 21474841307 rc 0/0 00000100:00100000:3.0:1746143845.205625:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970 00000100:00100000:3.0:1746143845.205633:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16971 00000100:00100000:3.0:1746143845.205637:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963627538560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143845.205671:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143845.205673:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.205675:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.205676:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:3.0:1746143845.205678:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746143845.205692:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3773:x1830963627538560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (518us total) trans 21474841308 rc 0/0 00000100:00100000:3.0:1746143845.205697:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16971 00000100:00100000:3.0:1746143845.205705:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972 00000100:00100000:3.0:1746143845.205709:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3773:x1830963627539072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143845.205754:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3773:x1830963627539072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (555us total) trans 21474841309 rc 0/0 00000100:00100000:3.0:1746143845.205758:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972 00000004:00080000:3.0:1746143845.205786:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb800/2, rc 0, transno 21474841308 00000100:00100000:3.0:1746143845.205790:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627538560:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143845.205798:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c69500/2, rc 0, transno 21474841309 00000100:00100000:3.0:1746143845.205800:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627539072:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143845.205806:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368e8a80/2, rc 0, transno 21474841306 00000100:00100000:3.0:1746143845.205808:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627538432:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143845.205813:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c68a80/2, rc 0, transno 21474841307 00000100:00100000:3.0:1746143845.205815:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627538944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.206000:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627538304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.206025:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.206039:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627538816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143845.206051:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627538688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.206053:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.206076:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.206108:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627539200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143845.206123:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143845.206142:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800939a5880/2, rc 0, transno 17179874046 00000100:00100000:2.0:1746143845.206147:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800939a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627537024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143845.206187:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538304 00000100:00100000:1.0:1746143845.206193:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538304 00000100:00100000:1.0:1746143845.206213:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538816 00000100:00100000:1.0:1746143845.206214:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538816 00000100:00100000:1.0:1746143845.206223:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627538688 00000100:00100000:1.0:1746143845.206225:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627538688 00000100:00100000:1.0:1746143845.206232:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627539200 00000100:00100000:1.0:1746143845.206233:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627539200 00000100:00100000:1.0:1746143845.206241:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16973 00000100:00100000:1.0:1746143845.206246:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627538304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143845.206296:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143845.206308:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143845 -> 1746143845 00002000:00010000:1.0:1746143845.206310:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143845 -> 1746143845 00002000:00010000:1.0:1746143845.206312:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143845 -> 1746143845 00002000:00010000:1.0:1746143845.206314:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143845.206337:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627538304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (311us total) trans 21474841310 rc 0/0 00000100:00100000:1.0:1746143845.206342:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16973 00000100:00100000:1.0:1746143845.206352:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16974 00000100:00100000:1.0:1746143845.206355:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627538816:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143845.206397:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368ebb80/2, rc 0, transno 21474841310 00000100:00100000:1.0:1746143845.206401:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627538816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (347us total) trans 21474841311 rc 0/0 00000100:00100000:0.0:1746143845.206401:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627538304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.206406:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16974 00000004:00080000:0.0:1746143845.206406:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c69c00/2, rc 0, transno 21474841311 00000100:00100000:0.0:1746143845.206409:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627538816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.206415:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16975 00000100:00100000:1.0:1746143845.206419:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963627538688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.206422:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16976 00000100:00100000:0.0:1746143845.206427:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3771:x1830963627539200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143845.206455:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143845.206457:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143845.206459:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143845.206460:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143845.206462:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143845.206479:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3771:x1830963627539200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (354us total) trans 21474841313 rc 0/0 00000100:00100000:0.0:1746143845.206484:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16976 00000100:00100000:1.0:1746143845.207337:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3771:x1830963627538688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 914us (1257us total) trans 21474841312 rc 0/0 00000004:00080000:2.0:1746143845.207339:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c6a300/2, rc 0, transno 21474841312 00000100:00100000:2.0:1746143845.207343:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627538688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143845.207343:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16975 00000004:00080000:2.0:1746143845.207351:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c6a680/2, rc 0, transno 21474841313 00000100:00100000:2.0:1746143845.207353:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627539200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143845.207442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.207523:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625164416 00000100:00100000:2.0:1746143845.207528:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625164416 00000100:00100000:2.0:1746143845.207560:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16977 00000100:00100000:2.0:1746143845.207565:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2951:x1830963625164416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.207577:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.207592:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412430 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.207617:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.207619:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.207626:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 17 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.207640:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 17 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.207649:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:2.0:1746143845.207677:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2951:x1830963625164416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 112us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.207682:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16977 00000100:00100000:2.0:1746143845.208668:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627538176:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143845.208701:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b620a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 264 pid: 14991 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143845.208720:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.208748:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52c00, rc 0) 00000100:00100000:2.0:1746143845.208786:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:2948:x1830963625163520:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 24401us (24741us total) trans 8589945160 rc 0/0 00000100:00100000:2.0:1746143845.208792:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14076 00000100:00100000:0.0:1746143845.209893:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.210234:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625164544 00000100:00100000:2.0:1746143845.210241:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625164544 00000100:00100000:2.0:1746143845.210453:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5474 00000100:00100000:2.0:1746143845.210460:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2952:x1830963625164544:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:2.0:1746143845.211051:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2952:x1830963625164544:12345-192.168.202.3@tcp:49:cat.0 Request processed in 588us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.211058:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5474 00000100:00100000:0.0:1746143845.211314:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.211356:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625164672 00000100:00100000:2.0:1746143845.211360:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625164672 00000100:00100000:0.0:1746143845.211782:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.211889:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625164800 00000100:00100000:3.0:1746143845.211893:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625164800 00000100:00100000:2.0:1746143845.211988:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14078 00000100:00100000:2.0:1746143845.211999:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2951:x1830963625164672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.212015:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.212033:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412437 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.212075:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.212086:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.212100:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.212102:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143845.212104:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a3800, rc 0) 00000100:00100000:2.0:1746143845.212126:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2951:x1830963625164672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 133us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.212131:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14078 00000100:00100000:3.0:1746143845.212188:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5475 00000100:00100000:3.0:1746143845.212194:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2948:x1830963625164800:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143845.212243:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2948:x1830963625164800:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 49us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.212248:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5475 00000100:00100000:0.0:1746143845.224613:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.224684:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625165056 00000100:00100000:2.0:1746143845.224695:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625165056 00000100:00100000:0.0:1746143845.224726:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143845.224745:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009322c380 x1830963625165056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.224754:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c380 with x1830963625165056 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.224760:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322c380 00000100:00100000:2.0:1746143845.224781:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7395 00000100:00100000:2.0:1746143845.224789:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625165056:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.225236:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625165184 00000100:00100000:3.0:1746143845.225240:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625165184 00000100:00100000:3.0:1746143845.225268:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16978 00000100:00100000:3.0:1746143845.225273:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+30:2948:x1830963625165184:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.225283:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.225313:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841243e expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.225339:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.225346:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.225354:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 31 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.225359:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.225361:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.225364:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [4096->249855] (req 4096->249855) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.225393:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 31 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.225403:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 31 pid: 3134 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.225414:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627539328:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.225509:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.225517:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 13 pid: 3134 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.225524:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627539456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.225548:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.225559:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 13 pid: 9587 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.225566:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627539584:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.225583:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.233039:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625165056:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8235us (8423us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.233054:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7395 00002000:00100000:2.0:1746143845.233067:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009322c380 x1830963625165056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.233077:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c380 with x1830963625165056 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.233084:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322c380 00000100:00100000:3.0:1746143845.234377:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627539456:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.234388:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627539584:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.235800:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.235834:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.235882:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.235956:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625165312 00000100:00100000:3.0:1746143845.235963:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625165312 00010000:00010000:3.0:1746143845.236000:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 14 pid: 3134 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.236025:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625165440 00000100:00100000:3.0:1746143845.236027:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625165440 00010000:00010000:3.0:1746143845.236036:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 14 pid: 9587 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.236059:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625165568 00000100:00100000:3.0:1746143845.236061:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625165568 00010000:00010000:3.0:1746143845.236071:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 32 pid: 3134 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.236084:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8301 00000100:00100000:3.0:1746143845.236090:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625165312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.236104:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.236123:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 14 pid: 3134 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.236132:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 14 pid: 3134 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.236153:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e2da200/0x87925e4cb73b61e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f8 expref: 14 pid: 3134 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.236174:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.236210:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625165312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 120us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.236216:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8301 00000100:00100000:3.0:1746143845.236230:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8302 00000100:00100000:3.0:1746143845.236234:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625165440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.236239:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.236250:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 14 pid: 9587 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.236256:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 14 pid: 9587 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.236266:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d800/0x87925e4cb73b610e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ab expref: 14 pid: 9587 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.236274:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.236285:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625165440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.236290:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8302 00000100:00100000:3.0:1746143845.236308:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8303 00000100:00100000:3.0:1746143845.236313:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625165568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.236319:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.236324:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 32 pid: 3134 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.236332:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 32 pid: 3134 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.236342:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.236344:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.236350:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.236358:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.236386:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 32 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.236397:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627539712:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143845.236448:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00010000:00010000:3.0:1746143845.236486:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e2db600/0x87925e4cb73b61bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ea expref: 32 pid: 3134 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.236498:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627539328:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.236528:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.236536:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:3.0:1746143845.236552:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:2948:x1830963625165184:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11280us (11826us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.236558:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16978 00000100:00100000:3.0:1746143845.237972:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627539712:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143845.237984:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.238015:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625165568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1701us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.238023:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8303 00000100:00100000:0.0:1746143845.239130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.239253:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625165824 00000100:00100000:2.0:1746143845.239261:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625165824 00002000:00100000:2.0:1746143845.239314:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (4096->8191) req@ffff88009322fb80 x1830963625165824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.239324:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322fb80 with x1830963625165824 ext(4096->8191) 00002000:00010000:2.0:1746143845.239329:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322fb80 00000100:00100000:2.0:1746143845.239361:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7396 00000100:00100000:2.0:1746143845.239370:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625165824:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143845.239518:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625165824:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 149us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.239525:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7396 00002000:00100000:2.0:1746143845.239530:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (4096->8191) req@ffff88009322fb80 x1830963625165824/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.239537:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322fb80 with x1830963625165824 ext(4096->8191) 00002000:00010000:2.0:1746143845.239540:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322fb80 00000100:00100000:0.0:1746143845.239980:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.240044:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625166080 00000100:00100000:1.0:1746143845.240048:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625166080 00002000:00100000:1.0:1746143845.240068:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009322ea00 x1830963625166080/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.240076:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ea00 with x1830963625166080 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.240080:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ea00 00000100:00100000:1.0:1746143845.240103:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7397 00000100:00100000:1.0:1746143845.240109:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625166080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.246591:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.246637:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.246702:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625166208 00000100:00100000:3.0:1746143845.246712:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625166208 00000100:00100000:3.0:1746143845.246887:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16979 00000100:00100000:3.0:1746143845.246896:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2952:x1830963625166208:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.246928:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.246946:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412445 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.246975:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.246977:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.246985:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 28 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.247005:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 28 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.247017:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53c00, rc 0) 00000100:00100000:2.0:1746143845.247184:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625166464 00000100:00100000:2.0:1746143845.247188:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625166464 00002000:00100000:2.0:1746143845.247218:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (245760->249855) req@ffff880090e59f80 x1830963625166464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.247228:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59f80 with x1830963625166464 ext(245760->249855) 00002000:00010000:2.0:1746143845.247234:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e59f80 00000100:00100000:2.0:1746143845.247260:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7398 00000100:00100000:2.0:1746143845.247266:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625166464:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.248102:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2952:x1830963625166208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1202us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.248110:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16979 00000100:00100000:2.0:1746143845.248732:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625166464:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1461us (2088us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.248741:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7398 00002000:00100000:2.0:1746143845.248750:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (245760->249855) req@ffff880090e59f80 x1830963625166464/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.248758:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59f80 with x1830963625166464 ext(245760->249855) 00002000:00010000:2.0:1746143845.248762:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e59f80 00000100:00100000:1.0:1746143845.252716:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625166080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12594us (12723us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143845.252728:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7397 00002000:00100000:1.0:1746143845.252740:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009322ea00 x1830963625166080/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.252751:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ea00 with x1830963625166080 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.252757:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ea00 00000100:00100000:0.0:1746143845.260130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.261615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.261690:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625166848 00000100:00100000:3.0:1746143845.261703:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625166848 00000100:00100000:3.0:1746143845.261776:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16980 00000100:00100000:3.0:1746143845.261785:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2951:x1830963625166848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.261806:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.261959:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841244c expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.261995:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.261998:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.262007:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 14 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.262024:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 14 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.262037:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53e00, rc 0) 00000100:00100000:3.0:1746143845.262118:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2951:x1830963625166848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 332us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.262129:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16980 00000100:00100000:1.0:1746143845.262220:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625166720 00000100:00100000:1.0:1746143845.262227:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625166720 00002000:00100000:1.0:1746143845.262266:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880090e59880 x1830963625166720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.262276:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59880 with x1830963625166720 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.262281:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59880 00000100:00100000:1.0:1746143845.263340:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7399 00000100:00100000:1.0:1746143845.263349:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625166720:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143845.268568:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.269418:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625167104 00000100:00100000:2.0:1746143845.269430:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625167104 00002000:00100000:2.0:1746143845.269486:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880090e5ad80 x1830963625167104/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.269524:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963625167104 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.269530:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:2.0:1746143845.269587:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7400 00000100:00100000:2.0:1746143845.269598:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625167104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143845.277183:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625166720:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13823us (17055us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143845.277196:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7399 00002000:00100000:1.0:1746143845.277208:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880090e59880 x1830963625166720/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.277224:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59880 with x1830963625166720 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.277229:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59880 00000100:00100000:0.0:1746143845.282345:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.282422:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625167232 00000100:00100000:3.0:1746143845.282432:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625167232 00000100:00100000:3.0:1746143845.282478:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16981 00000100:00100000:3.0:1746143845.282486:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+30:2952:x1830963625167232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.282505:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.282523:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412453 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.282550:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.282552:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.282560:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.282575:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.282585:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d200, rc 0) 00000100:00100000:3.0:1746143845.282645:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+31:2952:x1830963625167232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 159us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.282651:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16981 00000100:00100000:2.0:1746143845.284020:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625167104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14417us (15459us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.284031:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7400 00002000:00100000:2.0:1746143845.284045:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880090e5ad80 x1830963625167104/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.284054:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5ad80 with x1830963625167104 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.284059:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5ad80 00000100:00100000:0.0:1746143845.288796:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.289046:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625167488 00000100:00100000:2.0:1746143845.289056:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625167488 00002000:00100000:2.0:1746143845.289114:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880090e5b100 x1830963625167488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.289125:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b100 with x1830963625167488 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.289131:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5b100 00000100:00100000:1.0:1746143845.290374:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7401 00000100:00100000:1.0:1746143845.290391:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625167488:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143845.300385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.300439:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.302141:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625167616 00000100:00100000:2.0:1746143845.302155:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625167616 00000100:00100000:2.0:1746143845.302226:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625167872 00000100:00100000:2.0:1746143845.302231:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625167872 00000100:00100000:2.0:1746143845.302262:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16982 00000100:00100000:2.0:1746143845.302273:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625167616:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.302296:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.302332:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73b6250 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841245a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.302401:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627539840:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.302534:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.302565:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16983 00000100:00100000:2.0:1746143845.302574:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625167872:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.302583:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.302595:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412468 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.302610:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.302612:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.302623:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.302639:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.302651:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082ea0200, rc 0) 00000100:00100000:2.0:1746143845.302683:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625167872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 109us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.302689:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16983 00000100:00100000:1.0:1746143845.302825:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.303152:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625167488:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12765us (14365us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143845.303161:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7401 00002000:00100000:1.0:1746143845.303172:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880090e5b100 x1830963625167488/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.303181:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b100 with x1830963625167488 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.303185:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5b100 00000100:00100000:1.0:1746143845.303276:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625167744 00000100:00100000:1.0:1746143845.303282:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625167744 00000100:00100000:1.0:1746143845.303320:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16984 00000100:00100000:1.0:1746143845.303326:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625167744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.303336:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.303344:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412461 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.303354:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.303356:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.303360:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.303376:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.303383:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6000, rc 0) 00000100:00100000:1.0:1746143845.303404:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625167744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 78us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.303409:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16984 00000100:00100000:0.0:1746143845.307557:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.307623:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625168000 00000100:00100000:3.0:1746143845.307634:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625168000 00000100:00100000:3.0:1746143845.307687:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16985 00000100:00100000:3.0:1746143845.307696:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625168000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.307716:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.307733:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841246f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.307748:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627539840:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143845.307758:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.307760:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.307768:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.307776:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73b6250 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841245a expref: 16 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.307781:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.307789:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28a00/0x87925e4cb73b6250 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841245a expref: 16 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.307791:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189de00, rc 0) 00010000:00010000:2.0:1746143845.307812:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:3.0:1746143845.307833:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625168000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.307838:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16985 00000100:00100000:2.0:1746143845.308065:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625167616:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5705us (7605us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.308071:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16982 00000100:00100000:1.0:1746143845.310284:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.310382:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625168128 00000100:00100000:3.0:1746143845.310391:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625168128 00000100:00100000:3.0:1746143845.310434:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16986 00000100:00100000:3.0:1746143845.310440:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625168128:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.310457:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.310473:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412476 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.310496:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.310498:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.310508:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.310522:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.310534:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:3.0:1746143845.310572:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625168128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 132us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.310578:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16986 00000100:00100000:0.0:1746143845.322039:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.323999:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.324407:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625168384 00000100:00100000:1.0:1746143845.324418:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625168384 00000100:00100000:2.0:1746143845.324428:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625168640 00000100:00100000:2.0:1746143845.324431:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625168640 00002000:00100000:2.0:1746143845.324467:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880090e59c00 x1830963625168640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.324467:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e5b800 x1830963625168384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.324477:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59c00 with x1830963625168640 ext(2097152->4194303) 00002000:00100000:1.0:1746143845.324477:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b800 with x1830963625168384 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.324482:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59c00 00002000:00010000:1.0:1746143845.324482:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5b800 00000100:00100000:1.0:1746143845.324535:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7402 00000100:00100000:2.0:1746143845.324541:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7403 00000100:00100000:1.0:1746143845.324542:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625168384:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143845.324546:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625168640:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.328467:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.328513:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.328592:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169024 00000100:00100000:2.0:1746143845.328602:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169024 00002000:00100000:2.0:1746143845.328651:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e58e00 x1830963625169024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.328661:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58e00 with x1830963625169024 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.328666:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58e00 00000100:00100000:2.0:1746143845.328702:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169152 00000100:00100000:2.0:1746143845.328705:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169152 00002000:00100000:2.0:1746143845.328721:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880090e59500 x1830963625169152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.328729:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59500 with x1830963625169152 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.328732:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59500 00000100:00100000:2.0:1746143845.328748:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7404 00000100:00100000:2.0:1746143845.328755:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625169024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143845.330412:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7405 00000100:00100000:2.0:1746143845.330423:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625169152:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.352856:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.353660:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625168384:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29114us (31628us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143845.353673:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7402 00002000:00100000:2.0:1746143845.353685:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e5b800 x1830963625168384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.353695:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b800 with x1830963625168384 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.353701:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5b800 00000100:00100000:3.0:1746143845.354646:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625168640:12345-192.168.202.3@tcp:3:cat.0 Request processed in 30094us (30650us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143845.354655:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7403 00002000:00100000:3.0:1746143845.354662:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880090e59c00 x1830963625168640/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.354670:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59c00 with x1830963625168640 ext(2097152->4194303) 00002000:00010000:3.0:1746143845.354673:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e59c00 00000100:00100000:1.0:1746143845.355632:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169280 00000100:00100000:1.0:1746143845.355642:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169280 00000100:00100000:3.0:1746143845.356779:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16987 00000100:00100000:3.0:1746143845.356792:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2950:x1830963625169280:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.356811:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.356831:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841247d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.356860:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.356869:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.356875:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 21 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.356882:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.356884:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.356887:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2637824->3145727] (req 2637824->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.356995:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 21 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.357007:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 21 pid: 1945 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.357019:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627539968:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.357788:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.357798:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 28 pid: 13436 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.357806:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627540096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.357843:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 13 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.357851:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 13 pid: 9839 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.357863:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627540224:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.357883:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.368860:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627539968:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.368901:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625169024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 40143us (40441us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143845.368929:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7404 00002000:00100000:2.0:1746143845.368940:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880090e58e00 x1830963625169024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.368951:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58e00 with x1830963625169024 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.368956:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58e00 00000100:00100000:0.0:1746143845.376933:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.376953:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.376967:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627540096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.376979:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627540224:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.377006:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143845.377014:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2637824->3145727] (req 2637824->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 21 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.377034:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:0.0:1746143845.377039:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169664 00000100:00100000:0.0:1746143845.377044:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169664 00000100:00100000:3.0:1746143845.377077:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2950:x1830963625169280:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 20290us (24233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.377080:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16988 00000100:00100000:3.0:1746143845.377085:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16987 00000100:00100000:0.0:1746143845.377086:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2952:x1830963625169664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143845.377100:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143845.377110:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169408 00000100:00100000:3.0:1746143845.377113:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169408 00010000:00010000:0.0:1746143845.377115:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412484 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.377126:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 14 pid: 9839 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.377133:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143845.377138:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [2637824->3145727] (req 2637824->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.377139:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169536 00000100:00100000:3.0:1746143845.377141:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169536 00010000:00010000:0.0:1746143845.377145:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143845.377148:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 31 pid: 13436 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.377148:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.377160:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8304 00000100:00100000:3.0:1746143845.377165:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625169408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.377172:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.377177:0:9585:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [2637824->3145727] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.377186:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.377188:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 14 pid: 9839 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.377192:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7de00, rc 0) 00010000:00010000:3.0:1746143845.377197:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 14 pid: 9839 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746143845.377206:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2952:x1830963625169664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 121us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.377210:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16988 00010000:00010000:3.0:1746143845.377214:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55c600/0x87925e4cb73b6131 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ce expref: 14 pid: 9839 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.377228:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.377240:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625169408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.377246:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8304 00000100:00100000:3.0:1746143845.377257:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8305 00000100:00100000:3.0:1746143845.377261:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625169536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.377266:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.377272:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 30 pid: 13436 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.377279:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 30 pid: 13436 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.377288:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189dc00/0x87925e4cb73b626c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412476 expref: 30 pid: 13436 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.377310:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.377326:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625169536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 65us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.377538:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8305 00000100:00100000:2.0:1746143845.377630:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625169152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 47209us (49120us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143845.377642:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7405 00002000:00100000:2.0:1746143845.377651:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880090e59500 x1830963625169152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.377659:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59500 with x1830963625169152 ext(2097152->4194303) 00010000:00010000:2.0:1746143845.377664:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 19 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143845.377673:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 19 pid: 1945 timeout: 1004 lvb_type: 1 00002000:00010000:2.0:1746143845.377679:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e59500 00000100:00100000:0.0:1746143845.383369:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.383540:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625169792 00000100:00100000:2.0:1746143845.383550:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625169792 00000100:00100000:2.0:1746143845.384454:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16989 00000100:00100000:2.0:1746143845.384466:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2951:x1830963625169792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.384485:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.384504:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841248b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.384533:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.384541:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 20 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.384554:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 20 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.384571:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136200, rc 0) 00000100:00100000:2.0:1746143845.384633:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2951:x1830963625169792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 171us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.384639:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16989 00000100:00100000:0.0:1746143845.388000:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.388142:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625170048 00000100:00100000:2.0:1746143845.388153:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625170048 00000100:00100000:2.0:1746143845.388843:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14079 00000100:00100000:2.0:1746143845.388855:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:2955:x1830963625170048:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143845.388876:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.388896:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b6288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412492 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.388961:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143845.388995:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389008:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389019:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389030:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389035:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389040:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389150:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389159:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389165:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143845.389173:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000100:00100000:3.0:1746143845.389185:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625170176 00000100:00100000:3.0:1746143845.389190:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625170176 00010000:00010000:3.0:1746143845.389210:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 20 pid: 1945 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.389228:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8306 00000100:00100000:3.0:1746143845.389232:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625170176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.389242:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.389249:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389254:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389258:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 20 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143845.389260:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389265:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389269:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 20 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143845.389271:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.389274:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389279:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389286:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082ea0200/0x87925e4cb73b6257 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412468 expref: 20 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:2.0:1746143845.389287:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143845.389289:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.389292:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389313:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b628f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389322:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.389323:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.389325:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389329:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.389329:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389334:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389338:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092137600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.389340:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389342:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.389344:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389349:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030400) 00010000:00010000:2.0:1746143845.389351:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.389352:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.389355:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137600/0x87925e4cb73b6296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.389373:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.389382:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.389392:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627540480:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143845.389396:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b6288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 266 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.389404:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 265 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.389413:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.389415:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143845.389416:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136e00, rc 0) 00000100:00100000:2.0:1746143845.389449:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+265:2955:x1830963625170048:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 597us (1538us total) trans 8589945161 rc 0/0 00000100:00100000:2.0:1746143845.389455:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14079 00000100:00100000:3.0:1746143845.389456:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.391512:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.391560:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627540480:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143845.391579:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.391579:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625170432 00000100:00100000:2.0:1746143845.391584:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625170432 00000100:00100000:3.0:1746143845.391645:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625170176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2411us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.391653:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8306 00000100:00100000:0.0:1746143845.391681:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143845.391791:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2637824->2641919) req@ffff88012e359c00 x1830963625170432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.391801:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963625170432 ext(2637824->2641919) 00010000:00010000:2.0:1746143845.391809:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.391822:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.391828:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e359c00 00000100:00100000:2.0:1746143845.391851:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2716 00000100:00100000:2.0:1746143845.391857:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625170432:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143845.392005:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625170432:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 148us (500us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.392010:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2716 00002000:00100000:2.0:1746143845.392015:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2637824->2641919) req@ffff88012e359c00 x1830963625170432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.392022:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359c00 with x1830963625170432 ext(2637824->2641919) 00010000:00010000:2.0:1746143845.392026:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.392034:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.392039:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e359c00 00000100:00100000:1.0:1746143845.392158:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625170688 00000100:00100000:1.0:1746143845.392162:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625170688 00000100:00100000:1.0:1746143845.392189:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5476 00000100:00100000:1.0:1746143845.392195:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:2955:x1830963625170688:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143845.392353:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:2955:x1830963625170688:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 158us (671us total) trans 8589945162 rc 0/0 00000100:00100000:1.0:1746143845.392362:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5476 00000100:00100000:0.0:1746143845.401068:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.401165:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.401242:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625170944 00000100:00100000:2.0:1746143845.401253:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625170944 00002000:00100000:2.0:1746143845.401318:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2637824->3145727) req@ffff88012e35a680 x1830963625170944/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.401327:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a680 with x1830963625170944 ext(2637824->3145727) 00010000:00010000:2.0:1746143845.401337:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.401352:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.401359:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e35a680 00000100:00100000:0.0:1746143845.402704:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.402726:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171072 00000100:00100000:1.0:1746143845.402733:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171072 00000100:00100000:3.0:1746143845.402761:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2717 00000100:00100000:1.0:1746143845.402767:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171200 00000100:00100000:1.0:1746143845.402769:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171200 00000100:00100000:3.0:1746143845.402771:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625170944:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143845.402783:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16990 00000100:00100000:1.0:1746143845.402787:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2955:x1830963625171072:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143845.402795:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.402812:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412499 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402834:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.402841:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402847:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 19 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402852:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.402853:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.402856:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1544192->1826815] (req 1544192->1826815) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402884:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 20 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402898:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 20 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.402926:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627540608:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.402950:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16991 00000100:00100000:3.0:1746143845.402955:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2950:x1830963625171200:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.402963:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.402972:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124a0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402980:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.402987:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.402989:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143845.402995:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627540736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.402996:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 31 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.403003:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.403009:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.403010:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.403012:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->3567615] (req 3145728->3567615) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.403014:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.403021:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 12 pid: 9587 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.403026:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143845.403028:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627540864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.403033:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 16 pid: 9585 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.403040:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627540992:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.403042:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a330600 going to sleep for 11 seconds 00010000:00010000:3.0:1746143845.403061:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 31 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.403068:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 31 pid: 1945 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.403075:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627541120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.403094:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 12 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.403101:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 12 pid: 9839 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.403108:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627541248:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.403120:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.409472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.409488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.409501:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.409525:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171584 00000100:00100000:0.0:1746143845.409533:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171584 00010000:00010000:0.0:1746143845.409572:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 13 pid: 9587 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746143845.409595:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171328 00000100:00100000:0.0:1746143845.409597:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171328 00010000:00010000:0.0:1746143845.409605:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 21 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143845.409616:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171840 00000100:00100000:0.0:1746143845.409618:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171840 00010000:00010000:0.0:1746143845.409626:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 13 pid: 9839 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746143845.409638:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8307 00000100:00100000:0.0:1746143845.409644:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625171584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.409657:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.409678:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 13 pid: 9587 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.409688:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 13 pid: 9587 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.409715:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143845.409752:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625171584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.409758:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8307 00000100:00100000:0.0:1746143845.409772:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8308 00000100:00100000:0.0:1746143845.409776:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625171328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.409781:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.409786:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 21 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.409793:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 21 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.409802:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143845.409812:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625171328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 36us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.409816:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8308 00000100:00100000:0.0:1746143845.409823:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8309 00000100:00100000:0.0:1746143845.409826:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625171840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.409833:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.409844:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 13 pid: 9839 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.409851:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 13 pid: 9839 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.409861:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143845.409872:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625171840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.409876:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8309 00000100:00100000:0.0:1746143845.409938:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.409952:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171712 00000100:00100000:0.0:1746143845.409955:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171712 00010000:00010000:0.0:1746143845.409964:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 17 pid: 9585 timeout: 1004 lvb_type: 1 00000100:00100000:0.0:1746143845.409977:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8310 00000100:00100000:0.0:1746143845.409980:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625171712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.409986:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.409991:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 17 pid: 9585 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.409998:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 17 pid: 9585 timeout: 1004 lvb_type: 1 00010000:00010000:0.0:1746143845.410007:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143845.410018:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625171712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.410022:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8310 00010000:00010000:3.0:1746143845.410343:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6000/0x87925e4cb73b625e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412461 expref: 16 pid: 9585 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.410361:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627540992:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.410371:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627541120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.410378:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c800/0x87925e4cb73b612a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c7 expref: 12 pid: 9839 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143845.410381:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6226 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412430 expref: 20 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.410385:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627541248:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.410395:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627540608:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.410406:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627540736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.410412:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->3567615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 15 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.410412:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55cc00/0x87925e4cb73b611c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b9 expref: 12 pid: 9587 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143845.410419:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627540864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.410422:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00010000:00010000:1.0:1746143845.410440:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1544192->1826815] (req 1544192->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.410443:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2950:x1830963625171200:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7488us (7744us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143845.410448:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635400, rc 0) 00000100:00100000:3.0:1746143845.410449:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16991 00000100:00100000:1.0:1746143845.410462:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2955:x1830963625171072:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7675us (9297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.410467:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16990 00000100:00100000:3.0:1746143845.412317:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625170944:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9540us (11251us total) trans 21474841314 rc 0/0 00000100:00100000:3.0:1746143845.412327:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2717 00002000:00100000:3.0:1746143845.412434:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2637824->3145727) req@ffff88012e35a680 x1830963625170944/t21474841314(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/448 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.412444:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35a680 with x1830963625170944 ext(2637824->3145727) 00010000:00010000:3.0:1746143845.412452:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.412465:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:3.0:1746143845.412472:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e35a680 00000100:00100000:0.0:1746143845.413538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.413576:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.413639:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171456 00000100:00100000:1.0:1746143845.413647:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171456 00010000:00010000:1.0:1746143845.413674:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.413707:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625171968 00000100:00100000:1.0:1746143845.413710:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625171968 00010000:00010000:1.0:1746143845.413721:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 32 pid: 1945 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143845.413737:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8311 00000100:00100000:1.0:1746143845.413743:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625171456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143845.413755:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143845.413771:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.413781:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.413804:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a53c00/0x87925e4cb73b623b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412445 expref: 30 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.413818:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.413820:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.413827:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.413836:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.413870:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.413881:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627541376:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143845.413972:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a330600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.414029:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8312 00000100:00100000:3.0:1746143845.414036:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625171968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.414044:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.414057:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 32 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.414065:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 32 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.414078:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189de00/0x87925e4cb73b6265 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841246f expref: 32 pid: 1945 timeout: 1004 lvb_type: 1 00010000:00010000:3.0:1746143845.414091:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.414093:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.414096:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.414102:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.414119:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.414127:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627541504:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143845.414148:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.415254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.415720:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625172096 00000100:00100000:2.0:1746143845.415727:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625172096 00010000:00010000:2.0:1746143845.415755:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.415786:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8313 00000100:00100000:2.0:1746143845.415793:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625172096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.415804:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.415818:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.415828:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.415843:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b6273 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2637824->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841247d expref: 20 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.415869:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.415871:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.415877:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.415885:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.415892:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.415894:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.415897:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.415902:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.415947:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.415958:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627541632:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143845.416031:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.416039:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627541760:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143845.416054:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.416607:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.416625:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625172352 00000100:00100000:3.0:1746143845.416629:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625172352 00002000:00100000:3.0:1746143845.416661:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1544192->1548287) req@ffff88007f648e00 x1830963625172352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.416670:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648e00 with x1830963625172352 ext(1544192->1548287) 00002000:00010000:3.0:1746143845.416674:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f648e00 00000100:00100000:3.0:1746143845.416688:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7406 00000100:00100000:3.0:1746143845.416693:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625172352:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.416801:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625172352:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (196us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143845.416811:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7406 00002000:00100000:3.0:1746143845.416816:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1544192->1548287) req@ffff88007f648e00 x1830963625172352/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.416822:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648e00 with x1830963625172352 ext(1544192->1548287) 00002000:00010000:3.0:1746143845.416825:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f648e00 00000100:00100000:1.0:1746143845.416951:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627541376:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143845.416968:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143845.416989:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625171456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3246us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.416995:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8311 00000100:00100000:2.0:1746143845.417172:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627541504:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143845.417182:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.417199:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625171968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3164us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.417204:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8312 00000100:00100000:2.0:1746143845.418670:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627541632:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143845.418681:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627541760:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143845.418695:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.418727:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625172096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2933us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.418735:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8313 00000100:00100000:0.0:1746143845.422438:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.422553:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625172608 00000100:00100000:3.0:1746143845.422564:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625172608 00002000:00100000:3.0:1746143845.422610:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3563520->3567615) req@ffff88012e359500 x1830963625172608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.422621:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359500 with x1830963625172608 ext(3563520->3567615) 00002000:00010000:3.0:1746143845.422626:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e359500 00000100:00100000:3.0:1746143845.422690:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7407 00000100:00100000:3.0:1746143845.422698:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625172608:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.423097:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625172608:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 398us (668us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143845.423266:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7407 00002000:00100000:3.0:1746143845.423273:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3563520->3567615) req@ffff88012e359500 x1830963625172608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.423280:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359500 with x1830963625172608 ext(3563520->3567615) 00002000:00010000:3.0:1746143845.423284:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e359500 00000100:00100000:0.0:1746143845.423769:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.423961:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625172864 00000100:00100000:3.0:1746143845.423966:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625172864 00002000:00100000:3.0:1746143845.423986:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012e358380 x1830963625172864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.423999:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358380 with x1830963625172864 ext(2097152->3145727) 00002000:00010000:3.0:1746143845.424002:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358380 00000100:00100000:3.0:1746143845.424013:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7408 00000100:00100000:3.0:1746143845.424018:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625172864:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143845.427158:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.427183:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.427877:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625173120 00000100:00100000:1.0:1746143845.427888:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625173120 00002000:00100000:1.0:1746143845.427962:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012e35bb80 x1830963625173120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.427972:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35bb80 with x1830963625173120 ext(2097152->3145727) 00002000:00010000:1.0:1746143845.427983:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35bb80 00000100:00100000:1.0:1746143845.428012:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625173376 00000100:00100000:1.0:1746143845.428014:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625173376 00002000:00100000:1.0:1746143845.428025:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3be:0x0] (1822720->1826815) req@ffff88012e35aa00 x1830963625173376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.428031:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35aa00 with x1830963625173376 ext(1822720->1826815) 00002000:00010000:1.0:1746143845.428035:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35aa00 00000100:00100000:1.0:1746143845.428049:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7409 00000100:00100000:1.0:1746143845.428056:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625173120:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143845.428109:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7410 00000100:00100000:0.0:1746143845.428118:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625173376:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143845.428241:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625173376:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 124us (1055us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143845.428248:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7410 00002000:00100000:0.0:1746143845.428255:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1822720->1826815) req@ffff88012e35aa00 x1830963625173376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143845.428262:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35aa00 with x1830963625173376 ext(1822720->1826815) 00002000:00010000:0.0:1746143845.428266:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35aa00 00000100:00100000:3.0:1746143845.434372:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625172864:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10340us (10590us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.434385:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7408 00002000:00100000:3.0:1746143845.434398:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012e358380 x1830963625172864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.434407:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358380 with x1830963625172864 ext(2097152->3145727) 00002000:00010000:3.0:1746143845.434414:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358380 00000100:00100000:1.0:1746143845.434536:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625173120:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6480us (7388us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143845.434543:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7409 00002000:00100000:1.0:1746143845.434548:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012e35bb80 x1830963625173120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.434555:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35bb80 with x1830963625173120 ext(2097152->3145727) 00002000:00010000:1.0:1746143845.434559:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e35bb80 00000100:00100000:0.0:1746143845.442464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.442667:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625173760 00000100:00100000:1.0:1746143845.442677:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625173760 00000100:00100000:1.0:1746143845.442733:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16992 00000100:00100000:1.0:1746143845.442741:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2952:x1830963625173760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.442760:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.442781:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124a7 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.442812:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.442819:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143845.442821:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143845.442824:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.442857:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.442870:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 14 pid: 13436 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.442882:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627541888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.442999:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a330600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.443278:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.443491:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174016 00000100:00100000:1.0:1746143845.443494:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174016 00002000:00100000:1.0:1746143845.443524:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88012e358700 x1830963625174016/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.443533:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358700 with x1830963625174016 ext(3145728->4194303) 00002000:00010000:1.0:1746143845.443538:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358700 00000100:00100000:0.0:1746143845.443667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.445876:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625173632 00000100:00100000:1.0:1746143845.445886:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625173632 00000100:00100000:1.0:1746143845.445936:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627541888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143845.445964:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.445979:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97200, rc 0) 00000100:00100000:1.0:1746143845.446016:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2952:x1830963625173760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3276us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.446024:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16992 00002000:00100000:1.0:1746143845.446067:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3567616->4194303) req@ffff88012e35b800 x1830963625173632/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.446074:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b800 with x1830963625173632 ext(3567616->4194303) 00010000:00010000:1.0:1746143845.446080:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 15 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.446090:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 15 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:1.0:1746143845.446095:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e35b800 00000100:00100000:1.0:1746143845.446112:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2718 00000100:00100000:1.0:1746143845.446117:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625173632:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.447178:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7411 00000100:00100000:3.0:1746143845.447190:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625174016:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143845.448592:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.449602:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174144 00000100:00100000:2.0:1746143845.449614:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174144 00002000:00100000:2.0:1746143845.449661:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3567615) req@ffff88012e359f80 x1830963625174144/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.449672:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359f80 with x1830963625174144 ext(3145728->3567615) 00010000:00010000:2.0:1746143845.449683:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 17 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.449698:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 17 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.449704:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e359f80 00000100:00100000:2.0:1746143845.449737:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2719 00000100:00100000:2.0:1746143845.449744:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625174144:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143845.452170:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625173632:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6041us (8492us total) trans 0 rc 626688/626688 00000100:00100000:1.0:1746143845.452182:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2718 00002000:00100000:1.0:1746143845.452193:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (3567616->4194303) req@ffff88012e35b800 x1830963625173632/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 626688/626688 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.452208:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b800 with x1830963625173632 ext(3567616->4194303) 00010000:00010000:1.0:1746143845.452218:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 17 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.452233:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 17 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:1.0:1746143845.452239:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e35b800 00000100:00100000:3.0:1746143845.456714:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625174016:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9515us (13423us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.456727:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7411 00002000:00100000:3.0:1746143845.456741:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88012e358700 x1830963625174016/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.456751:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358700 with x1830963625174016 ext(3145728->4194303) 00002000:00010000:3.0:1746143845.456757:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358700 00000100:00100000:2.0:1746143845.457238:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625174144:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7493us (8651us total) trans 17179874047 rc 0/0 00000100:00100000:2.0:1746143845.457246:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2719 00002000:00100000:2.0:1746143845.457252:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3567615) req@ffff88012e359f80 x1830963625174144/t17179874047(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/448 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.457259:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359f80 with x1830963625174144 ext(3145728->3567615) 00010000:00010000:2.0:1746143845.457269:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 17 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.457283:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 17 pid: 13436 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.457290:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e359f80 00000100:00100000:0.0:1746143845.460171:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.460209:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.460236:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.460278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.460315:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174400 00000100:00100000:0.0:1746143845.460325:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174400 00000100:00100000:1.0:1746143845.460330:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174528 00000100:00100000:1.0:1746143845.460335:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174528 00000100:00100000:0.0:1746143845.460364:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174656 00000100:00100000:0.0:1746143845.460366:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174656 00000100:00100000:2.0:1746143845.460511:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174272 00000100:00100000:2.0:1746143845.460516:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174272 00010000:00010000:2.0:1746143845.460548:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 19 pid: 13436 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.460597:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16993 00000100:00100000:0.0:1746143845.460604:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16994 00000100:00100000:1.0:1746143845.460606:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625174400:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143845.460609:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16995 00000100:00100000:0.0:1746143845.460610:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625174528:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143845.460616:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625174656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.460622:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.460622:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143845.460622:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.460636:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b62c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124bc expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.460636:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123268a00/0x87925e4cb73b62c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124ae expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.460636:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137e00/0x87925e4cb73b62ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124b5 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.460683:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627542016:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143845.460757:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a330600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.460789:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627542144:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143845.460789:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627542272:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143845.460811:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.460813:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.460813:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8314 00000100:00100000:2.0:1746143845.460819:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625174272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.460828:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.460845:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 21 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.460854:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 21 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.460871:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.460872:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.460989:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.461001:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.461023:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.461032:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627542400:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143845.461082:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd29c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143845.462264:0:1945:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88007f64b800 x1830963627542144) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 21 pid: 13436 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.462290:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3567615) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a0 expref: 21 pid: 13436 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.462322:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627542144:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.462326:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627542272:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.462346:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137e00/0x87925e4cb73b62ce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124b5 expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.462347:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b62c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124bc expref: 20 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.462356:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b62c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124bc expref: 20 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.462356:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137e00/0x87925e4cb73b62ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124b5 expref: 20 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.462362:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76600, rc 0) 00010000:00010000:2.0:1746143845.462368:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137e00, rc 0) 00000100:00100000:1.0:1746143845.462441:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627542016:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143845.462457:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123268a00/0x87925e4cb73b62c0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ae expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.462465:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123268a00/0x87925e4cb73b62c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ae expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143845.462563:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625174656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1946us (2283us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143845.462570:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16995 00000100:00100000:2.0:1746143845.462570:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625174528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1960us (2332us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.462576:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16994 00010000:00010000:1.0:1746143845.462651:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268a00, rc 0) 00000100:00100000:1.0:1746143845.462669:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625174400:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2066us (2460us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143845.462675:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16993 00000100:00100000:2.0:1746143845.463360:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627542400:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143845.463372:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.463403:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625174272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2584us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.463410:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8314 00000100:00100000:0.0:1746143845.464740:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.464813:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625174784 00000100:00100000:1.0:1746143845.464821:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625174784 00000100:00100000:1.0:1746143845.464872:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16996 00000100:00100000:1.0:1746143845.464880:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2951:x1830963625174784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.464897:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.464950:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124c3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.464973:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.464975:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.464982:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.464998:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.465007:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269c00, rc 0) 00000100:00100000:1.0:1746143845.465035:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2951:x1830963625174784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 156us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.465040:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16996 00000100:00100000:0.0:1746143845.469786:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.469823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.469868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.469951:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625175168 00000100:00100000:2.0:1746143845.469960:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625175168 00002000:00100000:2.0:1746143845.470013:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800972e8e00 x1830963625175168/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.470022:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8e00 with x1830963625175168 ext(4194304->4853759) 00002000:00010000:2.0:1746143845.470028:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8e00 00000100:00100000:2.0:1746143845.470054:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625175296 00000100:00100000:2.0:1746143845.470056:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625175296 00002000:00100000:2.0:1746143845.470069:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800972ea680 x1830963625175296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.470075:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ea680 with x1830963625175296 ext(3145728->4194303) 00002000:00010000:2.0:1746143845.470078:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972ea680 00000100:00100000:2.0:1746143845.470087:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625175552 00000100:00100000:2.0:1746143845.470089:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625175552 00002000:00100000:2.0:1746143845.470099:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800972eb800 x1830963625175552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.470105:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb800 with x1830963625175552 ext(3145728->4194303) 00002000:00010000:2.0:1746143845.470109:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb800 00000100:00100000:2.0:1746143845.470122:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7412 00000100:00100000:2.0:1746143845.470129:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625175168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143845.470189:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7413 00000100:00100000:3.0:1746143845.470205:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7414 00000100:00100000:3.0:1746143845.470212:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625175552:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.472185:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625175296:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143845.474820:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625175168:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4678us (5032us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143845.474833:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7412 00002000:00100000:3.0:1746143845.474845:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800972e8e00 x1830963625175168/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.474854:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8e00 with x1830963625175168 ext(4194304->4853759) 00002000:00010000:3.0:1746143845.474860:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8e00 00000100:00100000:3.0:1746143845.480060:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625175552:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9836us (10178us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.480074:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7414 00002000:00100000:3.0:1746143845.480085:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800972eb800 x1830963625175552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.480094:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eb800 with x1830963625175552 ext(3145728->4194303) 00002000:00010000:3.0:1746143845.480100:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972eb800 00000100:00100000:1.0:1746143845.480378:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.480420:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625175296:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 10222us (10594us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.480427:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7413 00002000:00100000:2.0:1746143845.480433:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800972ea680 x1830963625175296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.480440:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ea680 with x1830963625175296 ext(3145728->4194303) 00002000:00010000:2.0:1746143845.480443:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972ea680 00000100:00100000:3.0:1746143845.480709:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625175680 00000100:00100000:3.0:1746143845.480717:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625175680 00000100:00100000:3.0:1746143845.480751:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16997 00000100:00100000:3.0:1746143845.480757:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625175680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.480771:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.480787:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124ca expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.480945:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627542528:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143845.481013:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.481370:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.481488:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625175808 00000100:00100000:2.0:1746143845.481492:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625175808 00000100:00100000:2.0:1746143845.481519:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16998 00000100:00100000:2.0:1746143845.481524:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625175808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.481533:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.481542:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73b62e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124d1 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.481571:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627542656:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.481598:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.483668:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627542528:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143845.483704:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62dc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ca expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.483719:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b62dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ca expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.483737:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:3.0:1746143845.483796:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625175680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3037us (3417us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143845.483806:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16997 00000100:00100000:2.0:1746143845.484021:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627542656:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.484044:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73b62e3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124d1 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.484054:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093716200/0x87925e4cb73b62e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124d1 expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.484567:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716200, rc 0) 00000100:00100000:2.0:1746143845.484591:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625175808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3066us (3221us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.484597:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16998 00000100:00100000:0.0:1746143845.488439:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.488470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.488548:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625176064 00000100:00100000:2.0:1746143845.488559:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625176064 00000100:00100000:0.0:1746143845.488566:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.488600:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625176192 00000100:00100000:2.0:1746143845.488602:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625176192 00000100:00100000:0.0:1746143845.488611:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16999 00000100:00100000:0.0:1746143845.488619:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625176064:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143845.488717:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17000 00000100:00100000:2.0:1746143845.488724:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625176192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.488734:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143845.488745:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625176320 00000100:00100000:3.0:1746143845.488749:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625176320 00010000:00010000:2.0:1746143845.488751:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b62ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124df expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143845.488785:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800972eaa00 x1830963625176320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.488794:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eaa00 with x1830963625176320 ext(4194304->4853759) 00002000:00010000:3.0:1746143845.488798:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972eaa00 00000100:00100000:2.0:1746143845.488803:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627542784:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143845.488818:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7415 00000100:00100000:3.0:1746143845.488823:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625176320:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:0.0:1746143845.488904:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143845.488941:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b62f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124d8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.488948:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.488966:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627542912:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143845.488986:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143845.491383:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627542912:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143845.491417:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b62f1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124d8 expref: 18 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.491428:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b62f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124d8 expref: 18 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.491454:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00000100:00100000:1.0:1746143845.491490:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625176064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2873us (3064us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143845.491499:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16999 00000100:00100000:2.0:1746143845.491536:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627542784:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.491557:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b62ea lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124df expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.491572:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093716600/0x87925e4cb73b62ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124df expref: 20 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.491588:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:2.0:1746143845.491611:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625176192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2888us (3139us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.491616:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17000 00000100:00100000:3.0:1746143845.493549:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625176320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4713us (4970us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143845.493562:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7415 00002000:00100000:3.0:1746143845.493574:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800972eaa00 x1830963625176320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.493583:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972eaa00 with x1830963625176320 ext(4194304->4853759) 00002000:00010000:3.0:1746143845.493588:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972eaa00 00000100:00100000:0.0:1746143845.496493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.496635:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625176576 00000100:00100000:2.0:1746143845.496645:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625176576 00000100:00100000:2.0:1746143845.496704:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5477 00000100:00100000:2.0:1746143845.496712:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2951:x1830963625176576:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143845.497141:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2951:x1830963625176576:12345-192.168.202.3@tcp:35:cat.0 Request processed in 429us (657us total) trans 8589945163 rc 0/0 00000100:00100000:2.0:1746143845.497148:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5477 00000100:00100000:0.0:1746143845.499344:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.499482:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625176832 00000100:00100000:2.0:1746143845.499491:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625176832 00000100:00100000:2.0:1746143845.499783:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5478 00000100:00100000:2.0:1746143845.499791:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+266:2952:x1830963625176832:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143845.500020:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:2952:x1830963625176832:12345-192.168.202.3@tcp:35:cat.0 Request processed in 229us (684us total) trans 8589945164 rc 0/0 00000100:00100000:2.0:1746143845.500027:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5478 00000100:00100000:0.0:1746143845.630378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.632887:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625177088 00000100:00100000:2.0:1746143845.632900:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625177088 00000100:00100000:2.0:1746143845.632972:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14080 00000100:00100000:2.0:1746143845.632982:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+267:2962:x1830963625177088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.633009:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.633030:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b62f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124e6 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.633102:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633120:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633130:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633142:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633148:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633153:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633246:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b630d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633255:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b630d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633260:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b630d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143845.633268:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143845.633346:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633353:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633358:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633363:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633369:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8aa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.633372:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633378:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633389:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143845.633391:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.633395:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633399:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8aa00/0x87925e4cb73b62ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633425:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633430:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633435:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633439:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.633442:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633446:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633452:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030400) 00010000:00010000:2.0:1746143845.633454:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.633455:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633459:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b400/0x87925e4cb73b6306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.633493:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8ae00/0x87925e4cb73b62f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124e6 expref: 270 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.633504:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b630d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124e6 expref: 269 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.633509:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.633511:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143845.633512:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a200, rc 0) 00000100:00100000:2.0:1746143845.633579:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+269:2962:x1830963625177088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 598us (3211us total) trans 8589945165 rc 0/0 00000100:00100000:2.0:1746143845.633586:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14080 00000100:00100000:0.0:1746143845.638898:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.641045:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625177216 00000100:00100000:2.0:1746143845.641061:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625177216 00000100:00100000:2.0:1746143845.641143:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1007 00000100:00100000:2.0:1746143845.641152:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+269:2010:x1830963625177216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.641175:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.641205:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b630d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124e6 expref: 269 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.641238:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.641243:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.641311:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+268:2010:x1830963625177216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 160us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.641317:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1007 00000100:00100000:0.0:1746143845.642592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.642641:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.642650:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625177472 00000100:00100000:3.0:1746143845.642657:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625177472 00000100:00100000:0.0:1746143845.642668:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625177728 00000100:00100000:0.0:1746143845.642671:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625177728 00002000:00100000:3.0:1746143845.642697:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096e56a00 x1830963625177472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 504/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143845.642697:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880096e56300 x1830963625177728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 504/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.642707:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56a00 with x1830963625177472 ext(0->1048575) 00002000:00010000:3.0:1746143845.642712:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e56a00 00002000:00100000:0.0:1746143845.642712:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56300 with x1830963625177728 ext(1048576->2097151) 00002000:00010000:0.0:1746143845.642716:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e56300 00000100:00100000:3.0:1746143845.642729:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7416 00000100:00100000:3.0:1746143845.642734:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625177472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.644318:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7417 00000100:00100000:0.0:1746143845.644331:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625177728:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143845.651429:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625177472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8683us (8830us total) trans 0 rc 802816/802816 00000100:00100000:3.0:1746143845.651442:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7416 00002000:00100000:3.0:1746143845.651454:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096e56a00 x1830963625177472/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 504/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.651463:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56a00 with x1830963625177472 ext(0->1048575) 00002000:00010000:3.0:1746143845.651469:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e56a00 00000100:00100000:0.0:1746143845.656265:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.656490:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625177728:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12160us (13846us total) trans 0 rc 765952/765952 00000100:00100000:1.0:1746143845.656503:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7417 00002000:00100000:1.0:1746143845.656515:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880096e56300 x1830963625177728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 504/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.656525:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56300 with x1830963625177728 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.656532:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e56300 00000100:00100000:2.0:1746143845.657017:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625177856 00000100:00100000:2.0:1746143845.657026:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625177856 00000100:00100000:2.0:1746143845.657086:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14081 00000100:00100000:2.0:1746143845.657093:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2963:x1830963625177856:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.657116:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.657136:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a400/0x87925e4cb73b631b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124ed expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.659255:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659278:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659290:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659314:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659320:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659326:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659406:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659421:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.659430:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.659437:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.659475:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.659488:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 9 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.659502:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627543040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.659621:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.659629:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 267 pid: 10936 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.659638:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627543168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.659657:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.663262:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.664628:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627543040:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.664640:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627543168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.664667:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143845.664859:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625178112 00000100:00100000:3.0:1746143845.664868:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625178112 00000100:00100000:3.0:1746143845.664940:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5479 00000100:00100000:3.0:1746143845.664948:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:30501:x1830963625178112:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143845.665186:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:30501:x1830963625178112:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 238us (1935us total) trans 8589945166 rc 0/0 00000100:00100000:3.0:1746143845.665194:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5479 00000100:00100000:1.0:1746143845.667076:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.667123:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.667146:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625178624 00000100:00100000:1.0:1746143845.667153:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625178624 00000100:00100000:1.0:1746143845.667191:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14082 00000100:00100000:1.0:1746143845.667198:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2965:x1830963625178624:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143845.667216:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.667235:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b6337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124f4 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.667327:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667342:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667352:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667361:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667367:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667373:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667477:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667487:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667492:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:1.0:1746143845.667502:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143845.667586:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667593:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667602:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667607:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667613:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.667617:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667623:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.667634:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00000100:00100000:2.0:1746143845.667680:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625178368 00000100:00100000:2.0:1746143845.667684:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625178368 00000100:00100000:2.0:1746143845.667711:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5480 00000100:00100000:2.0:1746143845.667716:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:8585:x1830963625178368:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143845.667837:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:8585:x1830963625178368:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 120us (770us total) trans 8589945168 rc 0/0 00000100:00100000:2.0:1746143845.667843:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5480 00000100:00100000:0.0:1746143845.668562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.668732:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625178880 00000100:00100000:2.0:1746143845.668737:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625178880 00000100:00100000:2.0:1746143845.668775:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14083 00000100:00100000:2.0:1746143845.668781:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+269:2967:x1830963625178880:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143845.668792:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.668801:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b635a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484124fb expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.668846:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143845.668995:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143845.669002:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669008:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2a00/0x87925e4cb73b633e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669022:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669027:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669031:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669036:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b3600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.669038:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669047:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669054:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030c00) 00010000:00010000:1.0:1746143845.669056:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143845.669058:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143845.669062:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143845.669120:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669128:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669139:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669144:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669148:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669209:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b636f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669218:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b636f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669224:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b636f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143845.669230:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143845.669269:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669275:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669279:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669283:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.669287:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e5a8e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.669290:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670239:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670250:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143845.670252:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.670255:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670259:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8e00/0x87925e4cb73b6361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670268:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670273:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670278:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670282:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e32000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.670284:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670289:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670304:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030c00) 00010000:00010000:2.0:1746143845.670306:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.670308:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670312:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32000/0x87925e4cb73b6368 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.670347:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b635a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124fb expref: 272 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.670357:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b636f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124fb expref: 271 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.670363:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.670364:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143845.670367:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.670373:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.670377:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32400, rc 0) 00000100:00100000:3.0:1746143845.670495:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.670519:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179136 00000100:00100000:3.0:1746143845.670524:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179136 00010000:00010000:3.0:1746143845.670549:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 15 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.670570:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8315 00000100:00100000:3.0:1746143845.670576:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625179136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.670587:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.670592:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 15 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.670600:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 15 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.670612:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b61d2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123f1 expref: 15 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.670620:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.670629:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.670635:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.670643:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.670647:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.670688:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625179136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.670694:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8315 00000100:00100000:3.0:1746143845.670727:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.670791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.670802:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179392 00000100:00100000:3.0:1746143845.670805:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179392 00010000:00010000:3.0:1746143845.670816:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 272 pid: 10936 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.670830:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8316 00000100:00100000:3.0:1746143845.670834:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+272:2008:x1830963625179392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.670841:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.670844:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 272 pid: 10936 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.670852:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 272 pid: 10936 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.670863:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6400/0x87925e4cb73b61d9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123ff expref: 272 pid: 10936 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.670871:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.670875:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.670881:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.670888:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.670905:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.670939:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+271:2008:x1830963625179392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 104us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.670945:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8316 00000100:00100000:0.0:1746143845.671031:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179264 00000100:00100000:0.0:1746143845.671035:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179264 00002000:00100000:0.0:1746143845.671064:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88007f649f80 x1830963625179264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143845.671074:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963625179264 ext(2097152->3145727) 00002000:00010000:0.0:1746143845.671078:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649f80 00010000:00010000:1.0:1746143845.671130:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3a00/0x87925e4cb73b6337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.671144:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.671149:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143845.671150:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143845.671152:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:0.0:1746143845.673684:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7418 00000100:00100000:0.0:1746143845.673701:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625179264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143845.675475:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2965:x1830963625178624:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8267us (8341us total) trans 8589945167 rc 0/0 00000100:00100000:1.0:1746143845.675486:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14082 00010000:00010000:1.0:1746143845.675581:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675592:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:1.0:1746143845.675645:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:1.0:1746143845.675651:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143845.675669:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675683:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675694:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675700:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675706:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675711:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675716:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8b800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.675720:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675726:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675741:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143845.675744:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143845.675747:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675752:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b6322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675766:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675771:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675776:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675779:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8be00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143845.675782:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675786:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675791:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030c00) 00010000:00010000:1.0:1746143845.675793:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143845.675795:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675799:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8be00/0x87925e4cb73b6329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.675830:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a400/0x87925e4cb73b631b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.675841:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.675847:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143845.675849:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143845.675851:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8a200, rc 0) 00000100:00100000:1.0:1746143845.675883:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2963:x1830963625177856:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 18791us (19629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.675889:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14081 00000100:00100000:2.0:1746143845.676109:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:2967:x1830963625178880:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7325us (7546us total) trans 8589945169 rc 0/0 00000100:00100000:2.0:1746143845.676116:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14083 00000100:00100000:0.0:1746143845.684462:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.684506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.684528:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179520 00000100:00100000:0.0:1746143845.684538:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.684540:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179520 00000100:00100000:0.0:1746143845.684555:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.684581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.684603:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1008 00000100:00100000:1.0:1746143845.684611:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+270:2008:x1830963625179520:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143845.684628:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143845.684655:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b636f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124fb expref: 270 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.684674:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143845.684679:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143845.684725:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+269:2008:x1830963625179520:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.684772:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179648 00000100:00100000:3.0:1746143845.684776:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179648 00000100:00100000:3.0:1746143845.684798:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179904 00000100:00100000:3.0:1746143845.684800:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179904 00000100:00100000:3.0:1746143845.684812:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180160 00000100:00100000:3.0:1746143845.684813:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180160 00000100:00100000:3.0:1746143845.684828:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625179776 00000100:00100000:3.0:1746143845.684830:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625179776 00000100:00100000:3.0:1746143845.684844:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17001 00000100:00100000:3.0:1746143845.684849:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:2967:x1830963625179648:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.684864:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.684884:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412502 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.684934:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.684943:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 35 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.684946:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17002 00010000:00010000:3.0:1746143845.684951:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 16 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.684955:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625179904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143845.684958:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.684960:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.684963:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1384448->1462271] (req 1384448->1462271) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.684963:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.684974:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33800/0x87925e4cb73b6384 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412510 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.684994:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 16 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.685005:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 16 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.685011:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627543424:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143845.685014:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627543296:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.685066:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 35 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.685074:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 35 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.685082:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627543552:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.685157:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.685188:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17003 00000100:00100000:2.0:1746143845.685195:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625180160:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.685202:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.685209:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841251e expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.685219:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.685220:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.685227:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 15 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.685241:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 15 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.685249:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:2.0:1746143845.685273:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625180160:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 78us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.685278:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17003 00000100:00100000:2.0:1746143845.685305:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17004 00000100:00100000:2.0:1746143845.685310:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625179776:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.685316:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.685322:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6392 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412509 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.685376:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627543680:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.685396:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.685429:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143845.685599:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.685613:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 13 pid: 1947 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.685621:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627543808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.685640:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.685655:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180032 00000100:00100000:3.0:1746143845.685658:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180032 00000100:00100000:3.0:1746143845.685679:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17005 00000100:00100000:3.0:1746143845.685684:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625180032:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143845.685690:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.685697:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412517 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.685708:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.685710:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.685715:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.685725:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.685733:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e59fa00, rc 0) 00000100:00100000:3.0:1746143845.685748:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625180032:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 64us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.685754:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17005 00000100:00100000:1.0:1746143845.686040:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1008 00000100:00100000:2.0:1746143845.687234:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625179264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13534us (16500us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.687246:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7418 00002000:00100000:2.0:1746143845.687256:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88007f649f80 x1830963625179264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.687265:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649f80 with x1830963625179264 ext(2097152->3145727) 00002000:00010000:2.0:1746143845.687270:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f649f80 00000100:00100000:3.0:1746143845.691145:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627543296:192.168.202.3@tcp:104: 00002000:00010000:2.0:1746143845.691339:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143845 -> 1746143846 00000100:00100000:2.0:1746143845.691361:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627543424:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.691396:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33800/0x87925e4cb73b6384 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412510 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.691410:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33800/0x87925e4cb73b6384 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412510 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.691419:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33800, rc 0) 00000100:00100000:2.0:1746143845.691477:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625179904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6523us (6937us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.691486:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17002 00000100:00100000:0.0:1746143845.694514:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.698991:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180288 00000100:00100000:1.0:1746143845.699007:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180288 00010000:00010000:1.0:1746143845.699054:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 17 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.699096:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8317 00000100:00100000:1.0:1746143845.699105:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625180288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143845.699122:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143845.699143:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 17 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.699154:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 17 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.699177:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53e00/0x87925e4cb73b6242 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841244c expref: 17 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:1.0:1746143845.699195:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143845.699256:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625180288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 152us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.699263:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8317 00000100:00100000:3.0:1746143845.699392:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627543552:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.700039:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.700247:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180416 00000100:00100000:1.0:1746143845.700251:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180416 00010000:00010000:1.0:1746143845.700268:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 15 pid: 1947 timeout: 1004 lvb_type: 1 00000100:00100000:1.0:1746143845.700308:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8318 00000100:00100000:1.0:1746143845.700313:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625180416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143845.700322:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143845.700332:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 15 pid: 1947 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143845.700339:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 15 pid: 1947 timeout: 1004 lvb_type: 1 00010000:00010000:1.0:1746143845.700354:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143845.700375:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625180416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.700381:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8318 00010000:00010000:3.0:1746143845.700631:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a45800/0x87925e4cb73b6123 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123c0 expref: 14 pid: 1947 timeout: 1004 lvb_type: 1 00000100:00100000:3.0:1746143845.700646:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627543808:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.700680:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1384448->1462271] (req 1384448->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.700690:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466200, rc 0) 00000100:00100000:3.0:1746143845.700725:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2967:x1830963625179648:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 15875us (16217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.700732:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17001 00002000:00010000:2.0:1746143845.700970:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143845 -> 1746143846 00000100:00100000:2.0:1746143845.700982:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627543680:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.701002:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6392 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412509 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.701011:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6392 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412509 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.701025:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:2.0:1746143845.701051:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625179776:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 15740us (16469us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.701057:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17004 00000100:00100000:0.0:1746143845.702260:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.702604:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.703168:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180544 00000100:00100000:2.0:1746143845.703176:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180544 00010000:00010000:2.0:1746143845.703204:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 33 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.703237:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8319 00000100:00100000:2.0:1746143845.703244:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625180544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.703255:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.703271:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 33 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.703281:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 33 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.703311:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6249 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412453 expref: 33 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.703323:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.703325:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.703330:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.703343:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.703375:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.703387:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627543936:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143845.703460:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.703819:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746143845.703830:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627544064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746143845.703862:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.703939:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627544064 00000100:00100000:1.0:1746143845.703943:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627544064 00000100:00100000:1.0:1746143845.703968:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1746143845.703974:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3771:x1830963627544064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1746143845.704002:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:1.0:1746143845.704039:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3771:x1830963627544064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.704053:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:2.0:1746143845.704233:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627544064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746143845.704586:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180672 00000100:00100000:3.0:1746143845.704591:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180672 00000100:00100000:3.0:1746143845.704622:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17006 00000100:00100000:3.0:1746143845.704627:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625180672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.704637:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.704649:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b63a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412525 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.704679:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627544192:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143845.704728:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.706661:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.708570:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627543936:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143845.708593:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.708645:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625180544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5400us (6386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.708656:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8319 00002000:00010000:3.0:1746143845.708704:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143845 -> 1746143846 00000100:00100000:3.0:1746143845.708719:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627544192:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143845.708743:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b63a0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412525 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.708756:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b63a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412525 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.708772:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095db2200, rc 0) 00000100:00100000:3.0:1746143845.708788:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625180672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4161us (6184us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143845.708794:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17006 00000100:00100000:3.0:1746143845.708812:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625180800 00000100:00100000:3.0:1746143845.708817:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625180800 00000100:00100000:2.0:1746143845.709109:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17007 00000100:00100000:2.0:1746143845.709118:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2965:x1830963625180800:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143845.709132:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.709145:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841252c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.709169:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.709176:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143845.709178:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143845.709181:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1708032->2019327] (req 1708032->2019327) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.709208:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.709219:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 28 pid: 9585 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.709230:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627544320:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.709288:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.713996:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.714093:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.714197:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627544320:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.714229:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1708032->2019327] (req 1708032->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.714247:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32400, rc 0) 00000100:00100000:2.0:1746143845.714307:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2965:x1830963625180800:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5178us (7641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.714316:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17007 00000100:00100000:1.0:1746143845.714617:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.714697:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625181056 00000100:00100000:3.0:1746143845.714704:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625181056 00000100:00100000:3.0:1746143845.714752:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14084 00000100:00100000:3.0:1746143845.714760:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2963:x1830963625181056:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143845.714777:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.714795:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b63ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412533 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.714900:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.714939:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.714948:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.714977:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.714987:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 8 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.714999:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627544448:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.715058:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143845.715235:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.715317:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625181312 00000100:00100000:2.0:1746143845.715321:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625181312 00000100:00100000:2.0:1746143845.715347:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17008 00000100:00100000:2.0:1746143845.715352:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625181312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.715361:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.715370:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b63bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841253a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.715401:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627544576:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.715426:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.715441:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625181184 00000100:00100000:2.0:1746143845.715444:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625181184 00002000:00100000:2.0:1746143845.715467:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1544192->1826815) req@ffff880095c68000 x1830963625181184/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.715476:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963625181184 ext(1544192->1826815) 00010000:00010000:2.0:1746143845.715482:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 31 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.715490:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 31 pid: 9585 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.715495:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c68000 00000100:00100000:2.0:1746143845.715506:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625181568 00000100:00100000:2.0:1746143845.715508:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625181568 00002000:00100000:2.0:1746143845.715521:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1384448->1388543) req@ffff880095c69f80 x1830963625181568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.715527:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69f80 with x1830963625181568 ext(1384448->1388543) 00002000:00010000:2.0:1746143845.715530:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69f80 00000100:00100000:2.0:1746143845.715541:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2720 00000100:00100000:2.0:1746143845.715545:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625181184:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143845.715641:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7419 00000100:00100000:2.0:1746143845.715646:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625181568:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143845.715742:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625181568:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 96us (1125us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.715748:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7419 00002000:00100000:2.0:1746143845.715753:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1384448->1388543) req@ffff880095c69f80 x1830963625181568/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.715760:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69f80 with x1830963625181568 ext(1384448->1388543) 00002000:00010000:2.0:1746143845.715763:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c69f80 00000100:00100000:1.0:1746143845.720356:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:0.0:1746143845.720507:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143845 -> 1746143846 00002000:00010000:0.0:1746143845.720512:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143845 -> 1746143846 00000100:00100000:0.0:1746143845.720527:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627544576:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143845.720565:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b63bc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841253a expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143845.720579:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b63bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841253a expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143845.720594:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32800, rc 0) 00000100:00100000:0.0:1746143845.720637:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625181312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5283us (5401us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143845.720646:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17008 00000100:00100000:2.0:1746143845.721143:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625181696 00000100:00100000:2.0:1746143845.721149:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625181696 00010000:00010000:2.0:1746143845.721177:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 9 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.721210:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8320 00000100:00100000:2.0:1746143845.721216:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625181696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.721230:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.721236:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 9 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.721245:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 9 pid: 14991 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.721265:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.721270:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.721281:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.721292:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143845.721316:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.721333:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625181696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.721340:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8320 00010000:00010000:3.0:1746143845.721401:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b6330 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124ed expref: 8 pid: 14991 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.721417:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627544448:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.721435:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.721442:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.721447:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143845.721465:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143845.721557:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b63ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.721572:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.721577:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.721580:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143845.721582:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa17600, rc 0) 00000100:00100000:3.0:1746143845.721604:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2963:x1830963625181056:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6845us (7620us total) trans 8589945170 rc 0/0 00000100:00100000:3.0:1746143845.721610:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14084 00000100:00100000:1.0:1746143845.722666:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.722667:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.723418:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625181184:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7868us (9322us total) trans 21474841315 rc 0/0 00000100:00100000:2.0:1746143845.723430:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2720 00002000:00100000:2.0:1746143845.723443:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1544192->1826815) req@ffff880095c68000 x1830963625181184/t21474841315(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/448 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.723453:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68000 with x1830963625181184 ext(1544192->1826815) 00010000:00010000:2.0:1746143845.723464:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 31 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.723477:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 31 pid: 9585 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.723483:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c68000 00000100:00100000:2.0:1746143845.724248:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625181952 00000100:00100000:2.0:1746143845.724257:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625181952 00002000:00100000:2.0:1746143845.724293:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1458176->1462271) req@ffff880096e55c00 x1830963625181952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.724312:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55c00 with x1830963625181952 ext(1458176->1462271) 00002000:00010000:2.0:1746143845.724316:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e55c00 00000100:00100000:2.0:1746143845.724339:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7420 00000100:00100000:2.0:1746143845.724346:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625181952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143845.725166:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625181952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 817us (2512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.725175:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7420 00002000:00100000:2.0:1746143845.725182:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1458176->1462271) req@ffff880096e55c00 x1830963625181952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.725189:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55c00 with x1830963625181952 ext(1458176->1462271) 00002000:00010000:2.0:1746143845.725193:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e55c00 00000100:00100000:3.0:1746143845.725300:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625182208 00000100:00100000:3.0:1746143845.725306:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625182208 00000100:00100000:3.0:1746143845.725339:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14085 00000100:00100000:3.0:1746143845.725343:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2970:x1830963625182208:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.725360:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.725379:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e59f000/0x87925e4cb73b63ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412541 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.725450:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725464:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725474:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725486:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725495:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725500:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725603:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b63df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725612:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b63df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725618:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b63df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143845.725627:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143845.725691:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725697:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725702:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725708:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725713:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd84800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143845.725716:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725721:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725735:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143845.725738:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.725742:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725747:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b63d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725758:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725762:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725766:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725770:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd85000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143845.725771:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725775:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725779:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008219e800) 00010000:00010000:3.0:1746143845.725781:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.725783:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725787:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85000/0x87925e4cb73b63d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.725821:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e59f000/0x87925e4cb73b63ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412541 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.725833:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b63df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412541 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.725839:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.725842:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143845.725844:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd85e00, rc 0) 00000100:00100000:3.0:1746143845.725879:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2970:x1830963625182208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 534us (3216us total) trans 8589945171 rc 0/0 00000100:00100000:3.0:1746143845.725883:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14085 00000100:00100000:0.0:1746143845.726104:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.726136:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.726156:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625182336 00000100:00100000:0.0:1746143845.726163:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625182336 00000100:00100000:0.0:1746143845.726198:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17009 00000100:00100000:0.0:1746143845.726205:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625182336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143845.726219:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143845.726233:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b63ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412548 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.726275:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627544704:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143845.726345:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143845.726506:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625182464 00000100:00100000:1.0:1746143845.726511:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625182464 00000100:00100000:1.0:1746143845.726543:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14086 00000100:00100000:1.0:1746143845.726548:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2963:x1830963625182464:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.726736:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.726746:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b63f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841254f expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.726803:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.726813:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.726820:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143845.726848:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.726857:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 9 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.726866:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627544832:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.728042:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.728063:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625182592 00000100:00100000:0.0:1746143845.728067:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625182592 00010000:00010000:0.0:1746143845.728088:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143845.728108:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8321 00000100:00100000:0.0:1746143845.728114:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625182592:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.728124:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.728141:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.728150:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.728168:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143845.728170:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143845.728176:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.728183:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.728202:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.728215:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627544960:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143845.728352:0:13436:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88009719ed80 x1830963627544704) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.728366:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635400/0x87925e4cb73b62ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1544192->1826815) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412499 expref: 33 pid: 9585 timeout: 1004 lvb_type: 0 00000100:00100000:0.0:1746143845.728380:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627544704:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143845.728399:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b63ed lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412548 expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143845.728408:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b63ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412548 expref: 32 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143845.728413:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97000, rc 0) 00000100:00100000:0.0:1746143845.728442:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625182336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2237us (2305us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143845.728453:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17009 00000100:00100000:1.0:1746143845.728595:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.728702:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.729903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.729958:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625182848 00000100:00100000:2.0:1746143845.729964:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625182848 00000100:00100000:2.0:1746143845.730008:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5481 00000100:00100000:2.0:1746143845.730015:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+269:2967:x1830963625182848:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143845.730265:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+270:2967:x1830963625182848:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 250us (366us total) trans 8589945172 rc 0/0 00000100:00100000:2.0:1746143845.730271:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5481 00000100:00100000:1.0:1746143845.731504:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.731700:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625182976 00000100:00100000:3.0:1746143845.731707:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625182976 00000100:00100000:0.0:1746143845.731865:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627544832:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143845.731892:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:1.0:1746143845.731983:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.732045:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1009 00000100:00100000:3.0:1746143845.732052:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625182976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.732067:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.732090:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b63df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412541 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.732103:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.732107:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.732115:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.732120:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143845.732125:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.732156:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625182976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.732162:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1009 00000100:00100000:2.0:1746143845.732390:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625183232 00000100:00100000:2.0:1746143845.732394:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625183232 00002000:00100000:2.0:1746143845.732425:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1708032->1712127) req@ffff88009322e680 x1830963625183232/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.732434:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322e680 with x1830963625183232 ext(1708032->1712127) 00002000:00010000:2.0:1746143845.732439:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322e680 00000100:00100000:2.0:1746143845.732454:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7421 00000100:00100000:2.0:1746143845.732460:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625183232:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143845.732576:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625183232:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 115us (592us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.732581:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7421 00002000:00100000:2.0:1746143845.732585:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1708032->1712127) req@ffff88009322e680 x1830963625183232/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.732592:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322e680 with x1830963625183232 ext(1708032->1712127) 00002000:00010000:2.0:1746143845.732595:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322e680 00000100:00100000:0.0:1746143845.732699:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627544960:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143845.732710:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143845.732726:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625182592:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4612us (4687us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.732732:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8321 00000100:00100000:0.0:1746143845.733145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.733256:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625183360 00000100:00100000:2.0:1746143845.733260:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625183360 00010000:00010000:2.0:1746143845.733275:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 10 pid: 7244 timeout: 1004 lvb_type: 0 00000100:00100000:2.0:1746143845.733460:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8322 00000100:00100000:2.0:1746143845.733467:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625183360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143845.733476:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143845.733481:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 10 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.733490:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 10 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.733505:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b63b5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412533 expref: 10 pid: 7244 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.733513:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.733517:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.733524:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.733531:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143845.733546:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143845.733574:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625183360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 107us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.733579:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8322 00010000:00010000:0.0:1746143845.733780:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143845.733787:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143845.733840:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:0.0:1746143845.733845:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143845.733860:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143845.733888:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b63f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.733901:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.733906:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143845.733909:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143845.733937:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24400, rc 0) 00000100:00100000:0.0:1746143845.733960:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2963:x1830963625182464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7412us (7863us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.733969:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14086 00000100:00100000:2.0:1746143845.735196:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627545216:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.735234:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627545472:0@lo:400:kworker.0 00000100:00100000:2.0:1746143845.735250:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.735267:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.735292:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963627545984:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.735330:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.735335:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3774:1830963627545728:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.735348:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746143845.735353:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3772:1830963627545344:0@lo:400:kworker.0 00000100:00100000:2.0:1746143845.735356:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.735370:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830963627546240:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.735372:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143845.735443:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545216 00000100:00100000:1.0:1746143845.735451:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545216 00000100:00100000:1.0:1746143845.735489:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1746143845.735495:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830963627545216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.735546:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b99f1f93-ef24-4932-a1b4-452b64359da1:3773:1830963627545088:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736044:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3772:1830963627545856:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736065:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.736090:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545984 00000100:00100000:3.0:1746143845.736093:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545984 00000100:00100000:3.0:1746143845.736123:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545728 00000100:00100000:3.0:1746143845.736125:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545728 00000100:00100000:3.0:1746143845.736136:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545344 00000100:00100000:3.0:1746143845.736138:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545344 00000100:00100000:3.0:1746143845.736145:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545856 00000100:00100000:3.0:1746143845.736147:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545856 00000100:00100000:3.0:1746143845.736158:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1746143845.736162:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3772:x1830963627545984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736187:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3772:x1830963627545984:12345-0@lo:400:kworker.0 Request processed in 24us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.736192:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1746143845.736204:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1746143845.736207:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830963627545728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143845.736225:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830963627545216:12345-0@lo:400:kworker.0 Request processed in 729us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.736227:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.736228:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830963627545728:12345-0@lo:400:kworker.0 Request processed in 20us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.736232:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1746143845.736232:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1746143845.736237:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627546240 00000100:00100000:3.0:1746143845.736238:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627546240 00000100:00100000:3.0:1746143845.736245:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1746143845.736248:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3772:x1830963627545344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143845.736255:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1746143845.736257:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627545216:0@lo:400:kworker.0 00000100:00100000:1.0:1746143845.736260:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3772:x1830963627545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736262:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3772:x1830963627545344:12345-0@lo:400:kworker.0 Request processed in 13us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.736266:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1746143845.736272:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1746143845.736275:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830963627546240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143845.736279:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3774:1830963627545728:0@lo:400:kworker.0 00000100:00100000:1.0:1746143845.736284:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3772:x1830963627545856:12345-0@lo:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.736289:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830963627546240:12345-0@lo:400:kworker.0 Request processed in 13us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.736289:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1746143845.736303:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00080000:3.0:1746143845.736316:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746143845.736318:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830963627546240:0@lo:400:kworker.0 00000100:00080000:3.0:1746143845.736319:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143845.736334:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3772:1830963627545344:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736341:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3772:1830963627545856:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736347:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3772:1830963627545984:0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.736359:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.736398:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627545600:0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.736420:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.736433:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3773:1830963627546112:0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.736448:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.736470:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627546112 00000100:00100000:0.0:1746143845.736473:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627546112 00000100:00100000:0.0:1746143845.736494:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1746143845.736499:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3773:x1830963627546112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.736525:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3773:x1830963627546112:12345-0@lo:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.736531:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1746143845.736550:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3773:1830963627546112:0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.736575:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545472 00000100:00100000:0.0:1746143845.736578:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545472 00000100:00100000:0.0:1746143845.736598:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545600 00000100:00100000:0.0:1746143845.736600:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545600 00000100:00100000:0.0:1746143845.736613:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1746143845.736617:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627545472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.736643:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627545472:12345-0@lo:400:kworker.0 Request processed in 26us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.736648:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1746143845.736665:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f64b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627545472:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736685:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1746143845.736691:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627545600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.736719:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627545600:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.737212:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627545088 00000100:00100000:2.0:1746143845.737216:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627545088 00000100:00100000:2.0:1746143845.737243:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1746143845.737248:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a42afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3773:x1830963627545088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746143845.737274:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a42afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3773:x1830963627545088:12345-0@lo:400:kworker.0 Request processed in 26us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.737282:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1746143845.738068:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00080000:3.0:1746143845.738093:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746143845.738098:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143845.738100:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746143845.738110:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.738387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.738426:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625183744 00000100:00100000:3.0:1746143845.738430:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625183744 00000100:00100000:3.0:1746143845.738452:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17010 00000100:00100000:3.0:1746143845.738458:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625183744:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143845.738470:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143845.738474:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625183616 00000100:00100000:2.0:1746143845.738478:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625183616 00010000:00010000:3.0:1746143845.738486:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b6402 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412556 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.738502:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5482 00000100:00100000:2.0:1746143845.738508:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+270:2962:x1830963625183616:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143845.738535:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627546368:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143845.738591:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.739607:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:2962:x1830963625183616:12345-192.168.202.3@tcp:35:cat.0 Request processed in 1092us (1493us total) trans 8589945173 rc 0/0 00000100:00100000:2.0:1746143845.739616:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5482 00000100:00100000:0.0:1746143845.739866:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b99f1f93-ef24-4932-a1b4-452b64359da1:3773:1830963627545088:0@lo:400:kworker.0 00000100:00100000:0.0:1746143845.739884:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88007f648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627545600:0@lo:400:kworker.0 00000100:00100000:3.0:1746143845.740060:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.740133:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.740356:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625183872 00000100:00100000:0.0:1746143845.740362:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625183872 00000100:00100000:0.0:1746143845.741270:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625184000 00000100:00100000:0.0:1746143845.741275:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625184000 00000100:00100000:0.0:1746143845.741429:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17011 00000100:00100000:1.0:1746143845.741434:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17012 00000100:00100000:0.0:1746143845.741436:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625183872:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1746143845.741440:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625184000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143845.741453:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143845.741453:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.741469:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b6409 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412564 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143845.741469:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6410 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841255d expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.741519:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627546624:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143845.741519:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627546496:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143845.741676:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143845.741676:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00002000:00010000:3.0:1746143845.742084:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime: 1746143845 -> 1746143846 00002000:00010000:3.0:1746143845.742088:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime: 1746143845 -> 1746143846 00000100:00100000:3.0:1746143845.742105:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627546368:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143845.742127:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b6402 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412556 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.742138:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082084e00/0x87925e4cb73b6402 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412556 expref: 15 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.742162:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:3.0:1746143845.742200:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625183744:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3739us (3809us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143845.742206:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17010 00000100:00100000:3.0:1746143845.744815:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.744815:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627546496:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143845.744847:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6410 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841255d expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143845.744861:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6410 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841255d expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143845.744995:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00002000:00010000:1.0:1746143845.745004:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143845.745008:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143845 -> 1746143846 00000100:00100000:1.0:1746143845.745020:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627546624:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143845.745037:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625183872:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3601us (4977us total) trans 0 rc 301/301 00010000:00010000:1.0:1746143845.745041:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b6409 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412564 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143845.745045:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17011 00010000:00010000:1.0:1746143845.745049:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b6409 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412564 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.745061:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:1.0:1746143845.745081:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625184000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3642us (4948us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143845.745086:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17012 00000100:00100000:2.0:1746143845.745491:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625184256 00000100:00100000:2.0:1746143845.745498:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625184256 00002000:00100000:2.0:1746143845.745533:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (2015232->2019327) req@ffff880090e5b480 x1830963625184256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.745542:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b480 with x1830963625184256 ext(2015232->2019327) 00002000:00010000:2.0:1746143845.745547:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5b480 00000100:00100000:2.0:1746143845.745573:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7422 00000100:00100000:2.0:1746143845.745580:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625184256:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143845.745704:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625184256:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 125us (895us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143845.745710:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7422 00002000:00100000:2.0:1746143845.745715:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (2015232->2019327) req@ffff880090e5b480 x1830963625184256/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/4536 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.745722:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5b480 with x1830963625184256 ext(2015232->2019327) 00002000:00010000:2.0:1746143845.745725:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e5b480 00000100:00100000:0.0:1746143845.748395:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.748608:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.748647:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.748674:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625184512 00000100:00100000:1.0:1746143845.748684:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625184512 00000100:00100000:3.0:1746143845.748710:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.748727:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625184768 00000100:00100000:1.0:1746143845.748730:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625184768 00000100:00100000:1.0:1746143845.748746:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17013 00000100:00100000:1.0:1746143845.748754:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625184512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.748773:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.748793:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b6417 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841256b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.748841:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17014 00000100:00100000:0.0:1746143845.748847:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625184768:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143845.748852:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627546752:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143845.748853:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143845.748860:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b641e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412579 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143845.748880:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627546880:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.748980:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625184640 00000100:00100000:2.0:1746143845.748985:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625184640 00000100:00100000:2.0:1746143845.749018:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14087 00000100:00100000:2.0:1746143845.749023:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2963:x1830963625184640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143845.749032:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.749045:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6425 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412572 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.749140:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749154:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749165:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749176:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749181:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749187:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749192:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.749195:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749201:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749211:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.749214:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143845.749217:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749221:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33800/0x87925e4cb73b642c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.749246:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6425 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412572 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.749253:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6425 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412572 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.749259:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33a00, rc 0) 00000100:00100000:0.0:1746143845.749334:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143845.749393:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.749636:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2963:x1830963625184640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 611us (1251us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.749643:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14087 00000100:00100000:2.0:1746143845.749668:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625185024 00000100:00100000:2.0:1746143845.749671:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625185024 00000100:00100000:2.0:1746143845.749701:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5483 00000100:00100000:2.0:1746143845.749706:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2965:x1830963625185024:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143845.750067:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2965:x1830963625185024:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 358us (1353us total) trans 8589945174 rc 0/0 00000100:00100000:2.0:1746143845.750073:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5483 00000100:00100000:2.0:1746143845.751654:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627546880:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143845.751675:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627546752:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.751688:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b641e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412579 expref: 19 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.751691:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b6417 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841256b expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143845.751701:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b6417 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841256b expref: 19 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.751703:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b641e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412579 expref: 19 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.751711:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96a00, rc 0) 00010000:00010000:1.0:1746143845.751711:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00000100:00100000:2.0:1746143845.751752:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625184768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2904us (3103us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143845.751752:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625184512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2998us (3143us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143845.751759:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17013 00000100:00100000:2.0:1746143845.751762:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17014 00000100:00100000:0.0:1746143845.752317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.752371:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625185280 00000100:00100000:2.0:1746143845.752377:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625185280 00000100:00100000:2.0:1746143845.752421:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5484 00000100:00100000:2.0:1746143845.752426:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2963:x1830963625185280:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143845.752572:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2963:x1830963625185280:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 145us (255us total) trans 8589945175 rc 0/0 00000100:00100000:2.0:1746143845.752577:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5484 00000100:00100000:0.0:1746143845.754795:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.754958:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625185408 00000100:00100000:1.0:1746143845.754967:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625185408 00000100:00100000:1.0:1746143845.755053:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17015 00000100:00100000:1.0:1746143845.755061:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2970:x1830963625185408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.755079:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.755096:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412580 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.755131:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.755143:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143845.755145:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143845.755148:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.755176:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 31 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.755187:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 31 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:1.0:1746143845.755199:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627547008:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.755285:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143845.757133:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627547008:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143845.757160:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.757176:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25c00, rc 0) 00000100:00100000:1.0:1746143845.757209:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2970:x1830963625185408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2149us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.757218:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17015 00000100:00100000:0.0:1746143845.760110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.760495:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625185536 00000100:00100000:2.0:1746143845.760505:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625185536 00002000:00100000:2.0:1746143845.760566:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (4096->249855) req@ffff88009719c380 x1830963625185536/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.760577:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c380 with x1830963625185536 ext(4096->249855) 00010000:00010000:2.0:1746143845.760591:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 32 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:2.0:1746143845.760607:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 32 pid: 12328 timeout: 1004 lvb_type: 0 00002000:00010000:2.0:1746143845.760624:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719c380 00000100:00100000:2.0:1746143845.760651:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2721 00000100:00100000:2.0:1746143845.760660:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625185536:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143845.765409:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625185536:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4728us (5288us total) trans 17179874048 rc 0/0 00000100:00100000:0.0:1746143845.765465:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2721 00002000:00100000:0.0:1746143845.765481:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (4096->249855) req@ffff88009719c380 x1830963625185536/t17179874048(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/448 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143845.765511:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c380 with x1830963625185536 ext(4096->249855) 00010000:00010000:0.0:1746143845.765522:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 34 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:0.0:1746143845.765546:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 34 pid: 12328 timeout: 1004 lvb_type: 0 00002000:00010000:0.0:1746143845.765553:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719c380 00000100:00100000:0.0:1746143845.770412:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.770533:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625185664 00000100:00100000:3.0:1746143845.770544:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625185664 00010000:00010000:3.0:1746143845.770589:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 34 pid: 12328 timeout: 1004 lvb_type: 0 00000100:00100000:3.0:1746143845.771338:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8323 00000100:00100000:3.0:1746143845.771347:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625185664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.771364:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143845.771385:0:16784:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 1864 -> 2048 00010000:00010000:3.0:1746143845.771391:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 34 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.771405:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 34 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.771430:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74e00/0x87925e4cb73b6234 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->249855) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841243e expref: 34 pid: 12328 timeout: 1004 lvb_type: 0 00010000:00010000:3.0:1746143845.771463:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.771465:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.771473:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 16 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.771480:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 16 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.771513:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 16 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.771527:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627547136:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143845.771621:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.774265:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627547136:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143845.774286:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.774354:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625185664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3007us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.774366:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8323 00000100:00100000:0.0:1746143845.779547:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.779577:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.779605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.779616:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625185920 00000100:00100000:2.0:1746143845.779626:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625185920 00002000:00100000:2.0:1746143845.779679:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009719f100 x1830963625185920/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.779689:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f100 with x1830963625185920 ext(0->1048575) 00002000:00010000:2.0:1746143845.779694:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719f100 00000100:00100000:2.0:1746143845.779720:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625186176 00000100:00100000:2.0:1746143845.779722:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625186176 00002000:00100000:2.0:1746143845.779736:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009719c700 x1830963625186176/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.779743:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c700 with x1830963625186176 ext(1048576->2097151) 00000100:00100000:3.0:1746143845.779745:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625186432 00002000:00010000:2.0:1746143845.779746:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719c700 00000100:00100000:3.0:1746143845.779752:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625186432 00000100:00100000:2.0:1746143845.779760:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7423 00002000:00100000:3.0:1746143845.779767:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009719df80 x1830963625186432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 504/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143845.779767:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625185920:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143845.779772:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719df80 with x1830963625186432 ext(1048576->2097151) 00002000:00010000:3.0:1746143845.779775:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719df80 00000100:00100000:3.0:1746143845.779792:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7424 00000100:00100000:3.0:1746143845.779795:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625186176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.780352:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7425 00000100:00100000:0.0:1746143845.780359:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625186432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143845.791077:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625186176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11265us (11483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.791096:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7424 00002000:00100000:3.0:1746143845.791110:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009719c700 x1830963625186176/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.791120:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719c700 with x1830963625186176 ext(1048576->2097151) 00002000:00010000:3.0:1746143845.791126:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719c700 00000100:00100000:2.0:1746143845.792286:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625185920:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12513us (12742us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.792306:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7423 00002000:00100000:2.0:1746143845.792315:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009719f100 x1830963625185920/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.792323:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719f100 with x1830963625185920 ext(0->1048575) 00002000:00010000:2.0:1746143845.792328:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719f100 00000100:00100000:2.0:1746143845.795323:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625186432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14953us (15704us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746143845.795335:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7425 00002000:00100000:2.0:1746143845.795347:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff88009719df80 x1830963625186432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 504/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.795356:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719df80 with x1830963625186432 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.795362:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009719df80 00000100:00100000:0.0:1746143845.805764:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.805838:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625186560 00000100:00100000:1.0:1746143845.805849:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625186560 00000100:00100000:1.0:1746143845.806618:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17016 00000100:00100000:1.0:1746143845.806629:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2970:x1830963625186560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143845.806650:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143845.806669:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412587 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.806700:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.806707:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143845.806709:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143845.806712:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.806744:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 32 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.806756:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 32 pid: 13436 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143845.806768:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627547264:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.806865:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143845.808799:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627547264:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143845.808824:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 18 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.808839:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de83000, rc 0) 00000100:00100000:1.0:1746143845.808879:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2970:x1830963625186560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2251us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.808888:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17016 00000100:00100000:0.0:1746143845.809756:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.809870:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625186688 00000100:00100000:2.0:1746143845.809878:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625186688 00002000:00100000:2.0:1746143845.809936:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1384448->1462271) req@ffff88009719ea00 x1830963625186688/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.809946:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ea00 with x1830963625186688 ext(1384448->1462271) 00010000:00010000:2.0:1746143845.809954:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 33 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143845.809966:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 33 pid: 13436 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143845.809973:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719ea00 00000100:00100000:2.0:1746143845.810000:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2722 00000100:00100000:2.0:1746143845.810007:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625186688:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143845.815223:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625186688:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5209us (5461us total) trans 17179874049 rc 0/0 00000100:00100000:2.0:1746143845.815233:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2722 00002000:00100000:2.0:1746143845.815244:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1384448->1462271) req@ffff88009719ea00 x1830963625186688/t17179874049(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/448 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.815253:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ea00 with x1830963625186688 ext(1384448->1462271) 00010000:00010000:2.0:1746143845.815261:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143845.815275:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143845.815281:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009719ea00 00000100:00100000:0.0:1746143845.820332:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.821397:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625186816 00000100:00100000:3.0:1746143845.821411:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625186816 00010000:00010000:3.0:1746143845.821457:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.821506:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8324 00000100:00100000:3.0:1746143845.821515:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625186816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.821531:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.821553:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.821567:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.821592:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466200/0x87925e4cb73b637d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->1462271) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412502 expref: 35 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.821626:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.821628:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.821636:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.821650:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.821685:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 17 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.821697:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627547392:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143845.821779:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.825486:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627547392:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143845.825509:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.825583:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625186816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4068us (5257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.825593:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8324 00000100:00100000:0.0:1746143845.826313:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.826824:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625187072 00000100:00100000:2.0:1746143845.826835:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625187072 00002000:00100000:2.0:1746143845.826877:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719ca80 x1830963625187072/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.826886:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ca80 with x1830963625187072 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.826891:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ca80 00000100:00100000:2.0:1746143845.826936:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7426 00000100:00100000:2.0:1746143845.826943:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625187072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143845.841564:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625187072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14607us (15239us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143845.841577:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7426 00002000:00100000:2.0:1746143845.841589:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009719ca80 x1830963625187072/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.841598:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719ca80 with x1830963625187072 ext(1048576->2097151) 00002000:00010000:2.0:1746143845.841604:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719ca80 00000100:00100000:0.0:1746143845.854614:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.854893:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625187328 00000100:00100000:2.0:1746143845.854904:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625187328 00002000:00100000:2.0:1746143845.855502:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009719fb80 x1830963625187328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.855512:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719fb80 with x1830963625187328 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.855517:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719fb80 00000100:00100000:2.0:1746143845.855540:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7427 00000100:00100000:2.0:1746143845.855553:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625187328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.872095:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.873168:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625187584 00000100:00100000:3.0:1746143845.873413:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625187584 00000100:00100000:3.0:1746143845.874571:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14088 00000100:00100000:3.0:1746143845.874583:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:2977:x1830963625187584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143845.874611:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.874633:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841258e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.874716:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874729:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874743:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874755:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874759:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874764:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874869:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874879:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874885:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143845.874893:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143845.874992:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.874998:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875004:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875009:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875014:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143845.875019:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875025:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875036:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143845.875039:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.875043:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875048:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875069:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875074:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875078:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875082:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143845.875084:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875088:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875095:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600bb00) 00010000:00010000:3.0:1746143845.875097:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143845.875099:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875106:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b644f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143845.875143:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.875152:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 273 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.875158:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.875160:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143845.875162:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085c00, rc 0) 00000100:00100000:3.0:1746143845.875245:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+273:2977:x1830963625187584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 665us (3162us total) trans 8589945176 rc 0/0 00000100:00100000:3.0:1746143845.875252:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14088 00000100:00100000:2.0:1746143845.878317:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625187328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 22757us (23703us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143845.878328:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7427 00002000:00100000:2.0:1746143845.878340:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009719fb80 x1830963625187328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.878348:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009719fb80 with x1830963625187328 ext(2097152->4194303) 00002000:00010000:2.0:1746143845.878354:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009719fb80 00000100:00100000:0.0:1746143845.878494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.878583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.879000:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625187712 00000100:00100000:2.0:1746143845.879008:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625187712 00000100:00100000:0.0:1746143845.879082:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.880035:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625187840 00000100:00100000:2.0:1746143845.880040:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625187840 00000100:00100000:2.0:1746143845.880062:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625187968 00000100:00100000:2.0:1746143845.880064:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625187968 00000100:00100000:2.0:1746143845.880078:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17017 00000100:00100000:2.0:1746143845.880085:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625187712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.880104:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.880122:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412595 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.880150:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.880152:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.880163:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 36 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.880179:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 36 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.880191:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:2.0:1746143845.880230:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625187712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 146us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.880236:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17017 00000100:00100000:2.0:1746143845.880250:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17018 00000100:00100000:2.0:1746143845.880255:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625187840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.880262:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.880271:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b646b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841259c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143845.880322:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627547520:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143845.880377:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.880404:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17019 00000100:00100000:2.0:1746143845.880409:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625187968:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.880415:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.880422:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125a3 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.880436:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.880437:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143845.880442:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 36 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.880450:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 36 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.880456:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467400, rc 0) 00000100:00100000:2.0:1746143845.880470:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625187968:12345-192.168.202.3@tcp:101:cat.0 Request processed in 62us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.880475:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17019 00000100:00100000:0.0:1746143845.890381:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.890826:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627547520:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143845.890863:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b646b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841259c expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.890878:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b646b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841259c expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143845.891120:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:3.0:1746143845.891157:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625188224 00000100:00100000:3.0:1746143845.891166:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625188224 00000100:00100000:3.0:1746143845.891225:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5485 00000100:00100000:3.0:1746143845.891233:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2970:x1830963625188224:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143845.891363:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625187840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11105us (12776us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143845.891371:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17018 00000100:00100000:3.0:1746143845.891437:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2970:x1830963625188224:12345-192.168.202.3@tcp:35:cat.0 Request processed in 205us (1068us total) trans 8589945177 rc 0/0 00000100:00100000:3.0:1746143845.891444:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5485 00000100:00100000:1.0:1746143845.895201:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627547776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746143845.895269:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143845.895344:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627547648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746143845.895349:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627547776 00000100:00100000:3.0:1746143845.895359:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627547776 00000100:00100000:0.0:1746143845.895371:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143845.895396:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627547648 00000100:00100000:3.0:1746143845.895399:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627547648 00000100:00100000:0.0:1746143845.895407:0:9589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1746143845.895415:0:9589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627547776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746143845.895420:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1746143845.895427:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963627547648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746143845.895440:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1158217792 pending 3211264 free 3906142208 avail 3674619904 00002000:00000024:0.0:1746143845.895445:0:9589:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 335872 granted 1172761792 pending 4395008 free 3910172672 avail 3678650368 00000100:00100000:0.0:1746143845.895471:0:9589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627547776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.895476:0:9589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1746143845.895483:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3771:x1830963627547648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.895488:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1746143845.895517:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627547648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746143845.895635:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627547776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143845.899741:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.900569:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625188480 00000100:00100000:2.0:1746143845.900580:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625188480 00002000:00100000:2.0:1746143845.900635:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800972e8700 x1830963625188480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.900644:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963625188480 ext(0->1048575) 00002000:00010000:2.0:1746143845.900649:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:2.0:1746143845.900671:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7428 00000100:00100000:2.0:1746143845.900679:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625188480:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143845.911899:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746143845.911927:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625188480:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11225us (12174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.911931:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627547904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746143845.911938:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7428 00002000:00100000:2.0:1746143845.911950:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800972e8700 x1830963625188480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143845.911960:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8700 with x1830963625188480 ext(0->1048575) 00002000:00010000:2.0:1746143845.911966:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8700 00000100:00100000:3.0:1746143845.911975:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143845.912005:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627547904 00000100:00100000:2.0:1746143845.912012:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627547904 00000100:00100000:2.0:1746143845.912608:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:2.0:1746143845.912615:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3774:x1830963627547904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746143845.912651:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445216256 avail 1315753984 00000100:00100000:2.0:1746143845.912702:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3774:x1830963627547904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143845.912707:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1746143845.912786:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627547904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746143845.920420:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.920497:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625188608 00000100:00100000:2.0:1746143845.920508:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625188608 00000100:00100000:2.0:1746143845.920575:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17020 00000100:00100000:2.0:1746143845.920584:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2977:x1830963625188608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143845.920606:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.920625:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125aa expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.920656:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.920664:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143845.920665:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143845.920668:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.920700:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.920711:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 19 pid: 13436 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143845.920723:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548032:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.920905:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.922723:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548032:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.922738:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143845.922750:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.922765:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467c00, rc 0) 00000100:00100000:2.0:1746143845.922933:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2977:x1830963625188608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2349us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.922936:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625188736 00000100:00100000:2.0:1746143845.922942:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17020 00000100:00100000:3.0:1746143845.922997:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625188736 00002000:00100000:3.0:1746143845.923035:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1708032->2019327) req@ffff8800972ead80 x1830963625188736/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.923043:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ead80 with x1830963625188736 ext(1708032->2019327) 00010000:00010000:3.0:1746143845.923049:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 20 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.923060:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 20 pid: 13436 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143845.923066:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800972ead80 00000100:00100000:3.0:1746143845.923090:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2723 00000100:00100000:3.0:1746143845.923097:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625188736:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143845.932079:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625188736:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8969us (9328us total) trans 21474841316 rc 0/0 00000100:00100000:3.0:1746143845.932097:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2723 00002000:00100000:3.0:1746143845.932111:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1708032->2019327) req@ffff8800972ead80 x1830963625188736/t21474841316(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:241/0 lens 488/448 e 0 to 0 dl 1746143856 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.932122:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ead80 with x1830963625188736 ext(1708032->2019327) 00010000:00010000:3.0:1746143845.932134:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.932149:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143845.932156:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800972ead80 00000100:00100000:0.0:1746143845.935999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.936721:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625188864 00000100:00100000:3.0:1746143845.936733:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625188864 00010000:00010000:3.0:1746143845.936778:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.936823:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8325 00000100:00100000:3.0:1746143845.936830:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625188864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.936844:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.936865:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.936877:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.936909:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32400/0x87925e4cb73b63a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1708032->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841252c expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.936969:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.936971:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.936980:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.936988:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.937025:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143845.937038:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627548160:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143845.937934:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.940702:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627548160:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143845.940719:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.941404:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625188864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4572us (5411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.941416:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8325 00000100:00100000:0.0:1746143845.944713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.945098:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.945180:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625189248 00000100:00100000:1.0:1746143845.945191:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625189248 00002000:00100000:1.0:1746143845.945242:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800972e9f80 x1830963625189248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.945253:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9f80 with x1830963625189248 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.945259:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9f80 00000100:00100000:1.0:1746143845.945684:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625189376 00000100:00100000:1.0:1746143845.945687:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625189376 00002000:00100000:1.0:1746143845.945702:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800972e9180 x1830963625189376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/0 e 0 to 0 dl 1746143856 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143845.945708:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9180 with x1830963625189376 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.945711:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9180 00000100:00100000:3.0:1746143845.945758:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7429 00000100:00100000:3.0:1746143845.945768:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625189248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143845.946391:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7430 00000100:00100000:1.0:1746143845.946399:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625189376:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143845.953853:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.954152:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625189248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8383us (9448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143845.954164:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7429 00002000:00100000:3.0:1746143845.954177:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800972e9f80 x1830963625189248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143845.954187:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9f80 with x1830963625189248 ext(1048576->2097151) 00002000:00010000:3.0:1746143845.954192:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9f80 00000100:00100000:2.0:1746143845.954323:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625189632 00000100:00100000:2.0:1746143845.954332:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625189632 00000100:00100000:2.0:1746143845.954372:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14089 00000100:00100000:2.0:1746143845.954379:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+273:2980:x1830963625189632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143845.954401:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.954421:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6480 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125b1 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.954524:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.954538:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.954544:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.954549:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746143845.954571:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625189376:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8172us (9473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143845.954577:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7430 00010000:00010000:2.0:1746143845.954578:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746143845.954582:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800972e9180 x1830963625189376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:241/0 lens 488/440 e 0 to 0 dl 1746143856 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143845.954589:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 274 pid: 7244 timeout: 1005 lvb_type: 0 00002000:00100000:1.0:1746143845.954595:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9180 with x1830963625189376 ext(1048576->2097151) 00002000:00010000:1.0:1746143845.954598:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9180 00000100:00100000:2.0:1746143845.954600:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627548288:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.955025:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 8 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.955038:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 8 pid: 14991 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143845.955046:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627548416:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143845.955229:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143845.956264:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627548288:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.958764:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.959140:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625189760 00000100:00100000:3.0:1746143845.959149:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625189760 00010000:00010000:3.0:1746143845.959187:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 275 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.959229:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8326 00000100:00100000:3.0:1746143845.959237:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+275:2009:x1830963625189760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.959257:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.959262:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 275 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.959273:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 275 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.959307:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085c00/0x87925e4cb73b6456 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841258e expref: 275 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.959482:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.959487:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143845.959496:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143845.959502:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.959551:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+274:2009:x1830963625189760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 315us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.959560:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8326 00000100:00100000:2.0:1746143845.963994:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627548416:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.964027:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143845.964211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.965468:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625189888 00000100:00100000:3.0:1746143845.965477:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625189888 00010000:00010000:3.0:1746143845.965511:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 9 pid: 14991 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.965539:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8327 00000100:00100000:3.0:1746143845.965545:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625189888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.965560:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.965565:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 9 pid: 14991 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.965576:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 9 pid: 14991 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.965599:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24400/0x87925e4cb73b63fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841254f expref: 9 pid: 14991 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143845.965624:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.965629:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143845.965639:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143845.965648:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143845.965665:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.965705:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625189888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 160us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.965711:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8327 00010000:00010000:2.0:1746143845.965935:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.965944:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143845.965967:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143845.966098:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b6480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 275 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.966115:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 274 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.966122:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.966125:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143845.966128:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2400, rc 0) 00000100:00100000:2.0:1746143845.966152:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:2980:x1830963625189632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11774us (12511us total) trans 8589945178 rc 0/0 00000100:00100000:2.0:1746143845.966158:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14089 00000100:00100000:0.0:1746143845.967138:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.967201:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625190144 00000100:00100000:3.0:1746143845.967206:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625190144 00000100:00100000:3.0:1746143845.967244:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5486 00000100:00100000:3.0:1746143845.967249:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:2977:x1830963625190144:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143845.967388:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2977:x1830963625190144:12345-192.168.202.3@tcp:35:cat.0 Request processed in 138us (252us total) trans 8589945179 rc 0/0 00000100:00100000:3.0:1746143845.967393:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5486 00000100:00100000:0.0:1746143845.981105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143845.981254:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625190400 00000100:00100000:2.0:1746143845.981269:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625190400 00000100:00100000:2.0:1746143845.981982:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14090 00000100:00100000:2.0:1746143845.981992:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2982:x1830963625190400:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143845.982131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.982208:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625190528 00000100:00100000:3.0:1746143845.982213:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625190528 00000100:00100000:3.0:1746143845.982241:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17021 00000100:00100000:3.0:1746143845.982246:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2980:x1830963625190528:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143845.982261:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143845.982279:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125bf expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.982323:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.982332:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.982340:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 20 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.982346:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.982348:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143845.982351:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2334720->2682879] (req 2334720->2682879) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.982385:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 20 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.982396:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 20 pid: 1945 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.982407:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548544:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143845.983590:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143845.983627:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b649c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125b8 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.984565:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984578:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984588:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984599:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984605:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984610:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984779:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b64b1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984793:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b64b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984799:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b64b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143845.984807:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143845.984884:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984889:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984894:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984898:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984903:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.984907:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984973:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984984:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143845.984986:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.984989:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.984994:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2c00/0x87925e4cb73b64a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985120:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985125:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985129:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985132:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800820b2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143845.985134:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985139:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985145:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030800) 00010000:00010000:2.0:1746143845.985146:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143845.985148:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985152:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2600/0x87925e4cb73b64aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143845.985189:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3400/0x87925e4cb73b649c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b8 expref: 18 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.985201:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b64b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b8 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143845.985207:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143845.985209:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143845.985211:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3600, rc 0) 00000100:00100000:2.0:1746143845.985699:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2982:x1830963625190400:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3707us (4604us total) trans 8589945180 rc 0/0 00000100:00100000:2.0:1746143845.985713:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14090 00010000:00010000:1.0:1746143845.986032:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143845.986603:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143845.986617:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 12 pid: 13430 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143845.986632:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.986689:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.986700:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.986707:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548800:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143845.986724:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143845.988387:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548544:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143845.988830:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.988974:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625190656 00000100:00100000:3.0:1746143845.988981:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625190656 00000100:00100000:3.0:1746143845.989036:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1010 00000100:00100000:3.0:1746143845.989044:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625190656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143845.989056:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143845.989081:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b3600/0x87925e4cb73b64b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b8 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143845.989110:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143845.989114:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143845.989157:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625190656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143845.989164:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1010 00000100:00100000:3.0:1746143845.989438:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548672:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143845.989843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143845.989895:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625190784 00000100:00100000:0.0:1746143845.989900:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625190784 00010000:00010000:0.0:1746143845.989947:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746143845.989967:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8328 00000100:00100000:0.0:1746143845.989973:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625190784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143845.989980:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143845.989997:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143845.990006:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143845.990019:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33c00/0x87925e4cb73b638b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841251e expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143845.990052:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143845.990089:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625190784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143845.990096:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8328 00000100:00100000:0.0:1746143845.991908:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143845.992140:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627548800:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143845.992168:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2334720->2682879] (req 2334720->2682879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.992174:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625190912 00000100:00100000:1.0:1746143845.992184:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625190912 00010000:00010000:3.0:1746143845.992185:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048200, rc 0) 00000100:00100000:3.0:1746143845.992217:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2980:x1830963625190528:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9969us (10085us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143845.992219:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 21 pid: 1945 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143845.992224:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17021 00000100:00100000:1.0:1746143845.992256:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8329 00000100:00100000:1.0:1746143845.992263:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625190912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143845.992275:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143845.992307:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 21 pid: 1945 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143845.992319:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 21 pid: 1945 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143845.992341:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136200/0x87925e4cb73b6281 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841248b expref: 21 pid: 1945 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143845.992367:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143845.992404:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625190912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 141us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143845.992411:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8329 00000100:00100000:0.0:1746143845.996640:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143845.996673:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625191040 00000100:00100000:1.0:1746143845.996686:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625191040 00010000:00010000:1.0:1746143845.996726:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143845.996782:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8330 00000100:00100000:1.0:1746143845.996790:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625191040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143845.996804:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143845.996825:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143845.996839:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143845.996863:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7de00/0x87925e4cb73b627a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412484 expref: 32 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143845.996877:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.996879:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143845.996892:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.996903:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143845.998158:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143845.998179:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627548928:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143845.998308:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.000201:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627548928:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143846.000222:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.000266:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625191040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3476us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.000276:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8330 00000100:00100000:0.0:1746143846.000758:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.000895:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625191296 00000100:00100000:1.0:1746143846.000901:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625191296 00002000:00100000:1.0:1746143846.000957:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2334720->2338815) req@ffff880094197800 x1830963625191296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.000966:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963625191296 ext(2334720->2338815) 00002000:00010000:1.0:1746143846.000970:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197800 00000100:00100000:1.0:1746143846.001938:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7431 00000100:00100000:1.0:1746143846.001947:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625191296:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143846.002060:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625191296:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 114us (1302us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143846.002066:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7431 00002000:00100000:1.0:1746143846.002072:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2334720->2338815) req@ffff880094197800 x1830963625191296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.002080:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197800 with x1830963625191296 ext(2334720->2338815) 00002000:00010000:1.0:1746143846.002083:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197800 00000100:00100000:0.0:1746143846.014214:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.014897:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625191552 00000100:00100000:1.0:1746143846.014906:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625191552 00002000:00100000:1.0:1746143846.015024:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2678784->2682879) req@ffff880094197b80 x1830963625191552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.015034:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963625191552 ext(2678784->2682879) 00002000:00010000:1.0:1746143846.015039:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:1.0:1746143846.015413:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7432 00000100:00100000:1.0:1746143846.015422:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625191552:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143846.015589:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625191552:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 167us (1383us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143846.015595:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7432 00002000:00100000:1.0:1746143846.015600:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2678784->2682879) req@ffff880094197b80 x1830963625191552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.015607:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197b80 with x1830963625191552 ext(2678784->2682879) 00002000:00010000:1.0:1746143846.015609:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197b80 00000100:00100000:0.0:1746143846.120862:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.121508:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625191808 00000100:00100000:2.0:1746143846.121519:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625191808 00000100:00100000:2.0:1746143846.121587:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14091 00000100:00100000:2.0:1746143846.121596:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2987:x1830963625191808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.121622:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.121643:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b64bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125c6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.121718:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121731:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121742:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121754:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121759:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121763:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121860:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b64d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121870:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b64d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.121875:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b64d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746143846.121884:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.122000:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122006:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122011:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122016:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122022:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee76600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.122026:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122031:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122041:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143846.122044:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143846.122048:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122053:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b64c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122083:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122088:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122092:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122095:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee77000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.122097:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122101:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122106:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030e00) 00010000:00010000:2.0:1746143846.122108:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143846.122110:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122114:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee77000/0x87925e4cb73b64cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.122149:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b64bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125c6 expref: 19 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.122161:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b64d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125c6 expref: 18 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.122166:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.122169:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143846.122171:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3ce00, rc 0) 00000100:00100000:2.0:1746143846.122226:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2987:x1830963625191808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 632us (1376us total) trans 8589945181 rc 0/0 00000100:00100000:2.0:1746143846.122232:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14091 00000100:00100000:0.0:1746143846.125663:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.125716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.125796:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625191936 00000100:00100000:1.0:1746143846.125806:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625191936 00000100:00100000:1.0:1746143846.125856:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625192064 00000100:00100000:1.0:1746143846.125858:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625192064 00000100:00100000:1.0:1746143846.125874:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17022 00000100:00100000:1.0:1746143846.125881:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625191936:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.125901:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.125946:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125cd expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.125969:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.125972:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.125982:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.125997:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.126009:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381c00, rc 0) 00000100:00100000:1.0:1746143846.126053:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625191936:12345-192.168.202.3@tcp:101:cat.0 Request processed in 172us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.126059:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17022 00000100:00100000:1.0:1746143846.126074:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17023 00000100:00100000:1.0:1746143846.126079:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625192064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.126085:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.126092:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091380800/0x87925e4cb73b64e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125d4 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.126132:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549056:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143846.126193:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00080000:2.0:1746143846.126562:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143846.127312:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.127569:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625192192 00000100:00100000:2.0:1746143846.127574:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625192192 00000100:00100000:2.0:1746143846.127623:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1011 00000100:00100000:2.0:1746143846.127630:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625192192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.127642:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.127662:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b64d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125c6 expref: 18 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.127676:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.127680:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.127713:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625192192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.127718:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1011 00002000:00010000:1.0:1746143846.129049:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143846.129055:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143846.129057:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143845 -> 1746143846 00000100:00100000:1.0:1746143846.129077:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549056:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143846.129324:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091380800/0x87925e4cb73b64e9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125d4 expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.129344:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091380800/0x87925e4cb73b64e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125d4 expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.129369:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380800, rc 0) 00000100:00100000:1.0:1746143846.129799:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625192064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3716us (4079us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143846.129808:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17023 00000100:00100000:0.0:1746143846.147961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.148130:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.148220:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625192448 00000100:00100000:1.0:1746143846.148231:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625192448 00002000:00100000:1.0:1746143846.148281:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094197100 x1830963625192448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.148318:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197100 with x1830963625192448 ext(1048576->2097151) 00002000:00010000:1.0:1746143846.148324:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197100 00000100:00100000:1.0:1746143846.148605:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7433 00000100:00100000:1.0:1746143846.148615:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625192448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.150417:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625192704 00000100:00100000:3.0:1746143846.150426:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625192704 00000100:00100000:3.0:1746143846.150463:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14092 00000100:00100000:3.0:1746143846.150469:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2989:x1830963625192704:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.150488:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.150505:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73b64f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125db expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.150575:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150587:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150597:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150607:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150612:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150616:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150846:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b6505 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150866:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b6505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150877:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b6505 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143846.150888:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143846.150989:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.150995:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151000:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151006:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151011:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.151014:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151020:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151030:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143846.151033:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.151036:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151044:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048e00/0x87925e4cb73b64f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151253:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151259:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151263:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151267:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082049200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.151269:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151274:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151282:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7c00) 00010000:00010000:3.0:1746143846.151284:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.151286:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151302:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049200/0x87925e4cb73b64fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.151345:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049600/0x87925e4cb73b64f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125db expref: 278 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.151356:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b6505 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125db expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.151367:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.151369:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143846.151371:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048600, rc 0) 00000100:00100000:3.0:1746143846.151420:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:2989:x1830963625192704:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 949us (3288us total) trans 8589945182 rc 0/0 00000100:00100000:3.0:1746143846.151427:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14092 00000100:00100000:1.0:1746143846.158238:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625192448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9616us (10323us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143846.158249:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7433 00002000:00100000:1.0:1746143846.158259:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094197100 x1830963625192448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.158268:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094197100 with x1830963625192448 ext(1048576->2097151) 00002000:00010000:1.0:1746143846.158273:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094197100 00000100:00100000:0.0:1746143846.158487:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.158660:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625192832 00000100:00100000:2.0:1746143846.158666:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625192832 00000100:00100000:2.0:1746143846.158697:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1012 00000100:00100000:2.0:1746143846.158702:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+277:2011:x1830963625192832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.158712:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.158730:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048600/0x87925e4cb73b6505 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125db expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.159410:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.159415:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.159447:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+276:2011:x1830963625192832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 744us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.159453:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1012 00000100:00100000:0.0:1746143846.160065:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.160125:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193088 00000100:00100000:2.0:1746143846.160129:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193088 00000100:00100000:2.0:1746143846.160207:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5487 00000100:00100000:2.0:1746143846.160213:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+276:2989:x1830963625193088:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143846.160414:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+277:2989:x1830963625193088:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 200us (349us total) trans 8589945183 rc 0/0 00000100:00100000:2.0:1746143846.160420:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5487 00000100:00100000:2.0:1746143846.170312:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.170406:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193216 00000100:00100000:1.0:1746143846.170417:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193216 00000100:00100000:1.0:1746143846.170465:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17024 00000100:00100000:1.0:1746143846.170473:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2987:x1830963625193216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.170503:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.170524:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125e2 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.171259:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.171268:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.171270:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.171274:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.171316:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.171328:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 30 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.171340:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549184:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.171435:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.176994:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549184:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.177505:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.177531:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380200, rc 0) 00000100:00100000:1.0:1746143846.177711:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2987:x1830963625193216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7237us (7418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.177720:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17024 00000100:00100000:0.0:1746143846.203323:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.206185:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193344 00000100:00100000:1.0:1746143846.206204:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193344 00002000:00100000:1.0:1746143846.206269:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2334720->2682879) req@ffff880093f68700 x1830963625193344/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.206280:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68700 with x1830963625193344 ext(2334720->2682879) 00010000:00010000:1.0:1746143846.206303:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 31 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.206323:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 31 pid: 9585 timeout: 1005 lvb_type: 0 00002000:00010000:1.0:1746143846.206331:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f68700 00000100:00100000:1.0:1746143846.210597:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2724 00000100:00100000:1.0:1746143846.210617:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625193344:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143846.230028:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.230262:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193600 00000100:00100000:3.0:1746143846.230273:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193600 00000100:00100000:3.0:1746143846.230329:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14093 00000100:00100000:3.0:1746143846.230337:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:2993:x1830963625193600:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.230359:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.230375:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b651a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125e9 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.230435:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230445:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230454:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230465:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230471:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230479:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143846.230542:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625193344:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 19930us (27230us total) trans 21474841317 rc 0/0 00010000:00010000:3.0:1746143846.230549:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b652f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746143846.230555:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2724 00010000:00010000:3.0:1746143846.230558:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b652f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230564:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b652f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00002000:00100000:2.0:1746143846.230566:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2334720->2682879) req@ffff880093f68700 x1830963625193344/t21474841317(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000004:00200000:3.0:1746143846.230571:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00002000:00100000:2.0:1746143846.230575:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68700 with x1830963625193344 ext(2334720->2682879) 00010000:00010000:2.0:1746143846.230585:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 33 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.230598:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 33 pid: 9585 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143846.230611:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f68700 00010000:00010000:3.0:1746143846.230623:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230628:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230633:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230638:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230642:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082049c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.230645:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230651:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230661:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143846.230664:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.230668:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230673:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049c00/0x87925e4cb73b6521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230706:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230711:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230715:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230719:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082048a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.230721:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230726:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230731:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7c00) 00010000:00010000:3.0:1746143846.230733:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.230735:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230739:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048a00/0x87925e4cb73b6528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.230769:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082048c00/0x87925e4cb73b651a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e9 expref: 280 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.230778:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b652f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e9 expref: 279 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.230785:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.230786:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143846.230788:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082049000, rc 0) 00000100:00100000:3.0:1746143846.230834:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:2993:x1830963625193600:12345-192.168.202.3@tcp:101:cat.0 Request processed in 499us (817us total) trans 8589945184 rc 0/0 00000100:00100000:3.0:1746143846.230841:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14093 00000100:00100000:0.0:1746143846.234251:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.234329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.234397:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193856 00000100:00100000:1.0:1746143846.234405:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193856 00000100:00100000:1.0:1746143846.234442:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17025 00000100:00100000:1.0:1746143846.234448:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625193856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.234463:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.234477:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091380800/0x87925e4cb73b653d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125f0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.234519:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549312:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143846.234578:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.234665:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193728 00000100:00100000:2.0:1746143846.234668:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193728 00000100:00100000:2.0:1746143846.234737:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1013 00000100:00100000:2.0:1746143846.234742:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:2008:x1830963625193728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.234749:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.234766:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082049000/0x87925e4cb73b652f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e9 expref: 279 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.234784:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.234788:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.234807:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:2008:x1830963625193728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 65us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.234812:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1013 00000100:00100000:2.0:1746143846.237094:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.237458:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.237510:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625193984 00000100:00100000:3.0:1746143846.237518:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625193984 00010000:00010000:3.0:1746143846.237542:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 35 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.237753:0:13430:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88009322f100 x1830963627549312) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 35 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.237778:0:13430:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 35 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.237795:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082048200/0x87925e4cb73b6495 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2682879) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125bf expref: 35 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.238076:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8331 00000100:00100000:3.0:1746143846.238084:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625193984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.238096:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.238098:0:16784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 87925e4cb73b6495) 00010000:00010000:3.0:1746143846.238099:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.238132:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625193984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 49us (1042us total) trans 0 rc 116/116 00000100:00100000:3.0:1746143846.238138:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8331 00000100:00100000:3.0:1746143846.238164:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625194112 00000100:00100000:3.0:1746143846.238167:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625194112 00000100:00100000:3.0:1746143846.238203:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17026 00000100:00100000:3.0:1746143846.238208:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2982:x1830963625194112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.238219:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.238230:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125f7 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.238247:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.238254:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.238259:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.238264:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.238266:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.238269:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3153920->4128767] (req 3153920->4128767) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.238302:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.238312:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.238324:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627549440:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.238375:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.238383:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 11 pid: 1945 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143846.238391:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627549568:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.238414:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.238421:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 35 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.238428:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627549696:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.238442:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00080000:2.0:1746143846.238578:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143846.238842:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549312:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143846.238862:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.238863:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.238870:0:13430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.238877:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.238897:0:13430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.238904:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549824:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143846.238939:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.242472:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627549440:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.242483:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627549568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.242491:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627549696:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.242518:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3153920->4128767] (req 3153920->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 19 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.242534:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082048e00, rc 0) 00000100:00100000:3.0:1746143846.242595:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2982:x1830963625194112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4385us (5135us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.242603:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17026 00000100:00100000:3.0:1746143846.244377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.244415:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627549824:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.244418:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.244471:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625194496 00000100:00100000:2.0:1746143846.244477:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625194496 00002000:00100000:2.0:1746143846.244514:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880091d4d500 x1830963625194496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.244522:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d500 with x1830963625194496 ext(2097152->3145727) 00002000:00010000:2.0:1746143846.244525:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4d500 00000100:00100000:1.0:1746143846.244600:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625194240 00000100:00100000:1.0:1746143846.244605:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625194240 00010000:00010000:1.0:1746143846.244888:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 12 pid: 1945 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.244938:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091380800/0x87925e4cb73b653d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f0 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143846.244950:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091380800/0x87925e4cb73b653d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f0 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143846.244967:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380800, rc 0) 00000100:00100000:0.0:1746143846.245002:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625193856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10553us (10756us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143846.245008:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17025 00000100:00080000:2.0:1746143846.245260:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143846.245308:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7434 00000100:00100000:3.0:1746143846.245317:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625194496:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143846.245682:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8332 00000100:00100000:1.0:1746143846.245689:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625194240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.245699:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.245715:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 12 pid: 1945 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.245724:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 12 pid: 1945 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.245740:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e59fa00/0x87925e4cb73b6399 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412517 expref: 12 pid: 1945 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.245754:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.245771:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625194240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.245777:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8332 00000100:00100000:3.0:1746143846.250542:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.251186:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625194624 00000100:00100000:0.0:1746143846.251194:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625194624 00010000:00010000:0.0:1746143846.251222:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746143846.251250:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8333 00000100:00100000:0.0:1746143846.251256:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625194624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143846.251267:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143846.251283:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143846.251302:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143846.251321:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b62d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124c3 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143846.251333:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143846.251365:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625194624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 110us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143846.251371:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8333 00000100:00100000:3.0:1746143846.254667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.254738:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625194752 00000100:00100000:1.0:1746143846.254745:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625194752 00010000:00010000:1.0:1746143846.254771:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 36 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.254814:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8334 00000100:00100000:1.0:1746143846.255030:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625194752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.255043:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.255061:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 36 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.255071:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 36 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.255088:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97200/0x87925e4cb73b62b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124a7 expref: 36 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.255110:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.255111:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.255117:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.255124:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.255149:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.255160:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627549952:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143846.255210:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.256518:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625194496:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11198us (12095us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143846.256527:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7434 00002000:00100000:3.0:1746143846.256536:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff880091d4d500 x1830963625194496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.256544:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4d500 with x1830963625194496 ext(2097152->3145727) 00002000:00010000:3.0:1746143846.256549:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091d4d500 00000100:00100000:0.0:1746143846.268030:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.268060:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627549952:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143846.268079:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143846.268107:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.268131:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625194752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 13309us (13469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.268141:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8334 00000100:00100000:1.0:1746143846.268204:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625195136 00000100:00100000:1.0:1746143846.268209:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625195136 00000100:00100000:3.0:1746143846.268234:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625195008 00000100:00100000:3.0:1746143846.268238:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625195008 00000100:00100000:1.0:1746143846.268242:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17027 00000100:00100000:1.0:1746143846.268248:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625195136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.268263:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746143846.268273:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3153920->3158015) req@ffff880093f69500 x1830963625195008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143846.268276:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73b654b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484125fe expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746143846.268283:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69500 with x1830963625195008 ext(3153920->3158015) 00002000:00010000:3.0:1746143846.268287:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69500 00000100:00100000:3.0:1746143846.268313:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7435 00000100:00100000:3.0:1746143846.268319:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625195008:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143846.268529:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.268558:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.268573:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625195520 00000100:00100000:0.0:1746143846.268576:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625195520 00002000:00100000:0.0:1746143846.268591:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093f6b100 x1830963625195520/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 504/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.268598:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6b100 with x1830963625195520 ext(3145728->4194303) 00002000:00010000:0.0:1746143846.268601:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f6b100 00000100:00100000:3.0:1746143846.268803:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625195008:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 484us (780us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143846.268810:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7435 00002000:00100000:3.0:1746143846.268816:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3153920->3158015) req@ffff880093f69500 x1830963625195008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.268822:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69500 with x1830963625195008 ext(3153920->3158015) 00002000:00010000:3.0:1746143846.268825:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69500 00000100:00100000:3.0:1746143846.268835:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625195776 00000100:00100000:3.0:1746143846.268838:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625195776 00002000:00100000:3.0:1746143846.268850:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880093f68e00 x1830963625195776/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.268856:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68e00 with x1830963625195776 ext(3145728->4194303) 00002000:00010000:3.0:1746143846.268859:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f68e00 00000100:00100000:3.0:1746143846.268876:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7436 00000100:00100000:3.0:1746143846.268882:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625195520:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143846.269687:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627550080:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143846.269698:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7437 00000100:00100000:0.0:1746143846.269705:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625195776:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143846.269739:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.269971:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.270038:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625195264 00000100:00100000:2.0:1746143846.270041:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625195264 00000100:00100000:2.0:1746143846.270063:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17028 00000100:00100000:2.0:1746143846.270068:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+32:2008:x1830963625195264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.270076:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.270087:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412605 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.270102:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.270104:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.270122:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 33 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.270135:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 33 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.270142:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010c00, rc 0) 00000100:00100000:2.0:1746143846.270163:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625195264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 95us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.270168:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17028 00002000:00010000:1.0:1746143846.281759:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143846.281766:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143846.281768:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime: 1746143845 -> 1746143846 00000100:00100000:1.0:1746143846.281786:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627550080:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143846.281820:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73b654b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125fe expref: 36 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.281833:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73b654b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125fe expref: 36 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143846.282229:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625195520:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13345us (13698us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143846.282238:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7436 00002000:00100000:3.0:1746143846.282246:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093f6b100 x1830963625195520/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 504/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.282255:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6b100 with x1830963625195520 ext(3145728->4194303) 00002000:00010000:3.0:1746143846.282259:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f6b100 00010000:00010000:1.0:1746143846.282388:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380800, rc 0) 00000100:00100000:1.0:1746143846.282522:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625195136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 14272us (14413us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143846.282528:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17027 00000100:00100000:2.0:1746143846.283459:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625195776:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 13752us (14897us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143846.283466:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7437 00002000:00100000:2.0:1746143846.283472:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff880093f68e00 x1830963625195776/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.283479:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68e00 with x1830963625195776 ext(3145728->4194303) 00002000:00010000:2.0:1746143846.283482:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f68e00 00000100:00100000:0.0:1746143846.292986:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.293044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.293072:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625195904 00000100:00100000:3.0:1746143846.293080:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625195904 00000100:00100000:3.0:1746143846.293132:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14094 00000100:00100000:1.0:1746143846.293134:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625196032 00000100:00100000:1.0:1746143846.293138:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625196032 00000100:00100000:3.0:1746143846.293139:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2994:x1830963625195904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143846.293160:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143846.293163:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17029 00000100:00100000:1.0:1746143846.293168:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+35:2993:x1830963625196032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.293175:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73b6559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841260c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.293176:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.293187:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412613 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.293210:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.293217:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.293219:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143846.293221:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.293222:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 36 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.293232:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.293240:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.293247:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.293251:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.293256:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.293258:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 17 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.293260:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143846.293268:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627550208:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.293326:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.293339:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 277 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.293345:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143846.293346:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746143846.293362:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 277 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.293369:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 277 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.293377:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627550336:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.293470:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.295300:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627550208:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.295315:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627550336:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.295325:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 36 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.295329:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.295338:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380400, rc 0) 00000100:00100000:1.0:1746143846.295379:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2993:x1830963625196032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2209us (2334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.295385:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17029 00000100:00100000:0.0:1746143846.297691:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.297833:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625196160 00000100:00100000:1.0:1746143846.297845:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625196160 00010000:00010000:1.0:1746143846.297889:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 278 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746143846.298055:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.298152:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.298236:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8335 00000100:00100000:1.0:1746143846.298246:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:2011:x1830963625196160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.298264:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.298273:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 278 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.298284:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 278 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.298321:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2400/0x87925e4cb73b6487 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125b1 expref: 278 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.298392:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625196672 00000100:00100000:2.0:1746143846.298396:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625196672 00000100:00100000:2.0:1746143846.298422:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5488 00000100:00100000:2.0:1746143846.298426:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e248050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2982:x1830963625196672:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143846.298430:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625196416 00000100:00100000:3.0:1746143846.298442:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625196416 00002000:00100000:3.0:1746143846.298483:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3153920->4128767) req@ffff880093f6aa00 x1830963625196416/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.298492:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6aa00 with x1830963625196416 ext(3153920->4128767) 00010000:00010000:3.0:1746143846.298500:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 18 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.298511:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 18 pid: 13436 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.298517:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f6aa00 00000100:00100000:2.0:1746143846.298625:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e248050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2982:x1830963625196672:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 197us (472us total) trans 8589945185 rc 0/0 00000100:00100000:2.0:1746143846.298631:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5488 00000100:00100000:3.0:1746143846.299304:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2725 00000100:00100000:3.0:1746143846.299314:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625196416:12345-192.168.202.3@tcp:4:multiop.0 00010000:00010000:1.0:1746143846.299667:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143846.299673:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.299688:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.299695:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.299727:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.299760:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+277:2011:x1830963625196160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1515us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.299766:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8335 00010000:00010000:3.0:1746143846.299840:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299849:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143846.299889:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143846.299892:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143846.299906:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299938:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299948:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299954:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299959:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299964:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299969:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.299972:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299978:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.299989:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143846.299992:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.299996:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300001:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b6567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300025:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300030:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300035:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300039:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc3e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.300041:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300045:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300050:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7400) 00010000:00010000:3.0:1746143846.300051:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.300053:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300057:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b656e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.300084:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73b6559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.300093:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.300099:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.300101:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143846.300103:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:3.0:1746143846.300144:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2994:x1830963625195904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7006us (7165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.300151:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14094 00000100:00100000:1.0:1746143846.302348:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.303641:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625196800 00000100:00100000:2.0:1746143846.303651:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625196800 00000100:00100000:2.0:1746143846.303720:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17030 00000100:00100000:2.0:1746143846.303730:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625196800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.303751:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.303771:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b657c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841261a expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143846.303833:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627550464:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143846.303925:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.304635:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.305281:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.305342:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625196928 00000100:00100000:0.0:1746143846.305351:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625196928 00000100:00100000:3.0:1746143846.305381:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625197056 00000100:00100000:3.0:1746143846.305392:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625197056 00000100:00100000:0.0:1746143846.305419:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17031 00000100:00100000:0.0:1746143846.305428:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625196928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143846.305441:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143846.305451:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17032 00000100:00100000:3.0:1746143846.305457:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625197056:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143846.305457:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412621 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.305472:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143846.305476:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143846.305479:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.305486:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412628 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143846.305490:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.305508:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143846.305508:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.305510:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.305517:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143846.305520:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408fc00, rc 0) 00010000:00010000:3.0:1746143846.305529:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 13 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.305537:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2800, rc 0) 00000100:00100000:0.0:1746143846.305566:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625196928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 138us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.305626:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625197056:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 167us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.305632:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17032 00000100:00080000:2.0:1746143846.305658:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143846.306738:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17031 00000100:00100000:0.0:1746143846.308337:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.308379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.308403:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.308603:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627550464:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143846.308635:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b657c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841261a expref: 21 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.308648:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b657c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841261a expref: 21 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.308669:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010600, rc 0) 00000100:00100000:2.0:1746143846.308711:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625196800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4984us (6373us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143846.308718:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17030 00000100:00100000:2.0:1746143846.308738:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625197184 00000100:00100000:2.0:1746143846.308743:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625197184 00000100:00100000:2.0:1746143846.308764:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625197312 00000100:00100000:2.0:1746143846.308765:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625197312 00000100:00100000:2.0:1746143846.308779:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625197440 00000100:00100000:2.0:1746143846.308780:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625197440 00000100:00100000:2.0:1746143846.308793:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17033 00000100:00100000:2.0:1746143846.308798:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625197184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143846.308810:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.308820:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841262f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.308835:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.308837:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.308844:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.308857:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.308866:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b8400, rc 0) 00000100:00100000:2.0:1746143846.308877:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625197184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 80us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.308886:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17033 00000100:00100000:2.0:1746143846.308894:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17034 00000100:00100000:2.0:1746143846.308898:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625197312:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143846.308902:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.308906:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b6598 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412636 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143846.308960:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627550592:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143846.309007:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.309017:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17035 00000100:00100000:2.0:1746143846.309022:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625197440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143846.309028:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.309036:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841263d expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.309046:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.309047:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.309051:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.309060:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.309067:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74200, rc 0) 00000100:00100000:2.0:1746143846.309078:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625197440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 57us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.309084:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17035 00000100:00100000:3.0:1746143846.311889:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625196416:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 12562us (13818us total) trans 17179874050 rc 0/0 00000100:00100000:3.0:1746143846.311903:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2725 00002000:00100000:3.0:1746143846.311983:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3153920->4128767) req@ffff880093f6aa00 x1830963625196416/t17179874050(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.311993:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6aa00 with x1830963625196416 ext(3153920->4128767) 00010000:00010000:3.0:1746143846.312004:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 20 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.312022:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 20 pid: 13436 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.312029:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f6aa00 00000100:00100000:2.0:1746143846.313797:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627550592:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143846.313827:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b6598 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412636 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.313839:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096f6d600/0x87925e4cb73b6598 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412636 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.313849:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096f6d600, rc 0) 00000100:00100000:2.0:1746143846.313887:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625197312:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4987us (5508us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143846.313895:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17034 00000100:00100000:0.0:1746143846.314268:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.314339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.314413:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625197696 00000100:00100000:1.0:1746143846.314422:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625197696 00010000:00010000:1.0:1746143846.314454:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 20 pid: 13436 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.314491:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8336 00000100:00100000:2.0:1746143846.314494:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625197568 00000100:00100000:2.0:1746143846.314500:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625197568 00000100:00100000:1.0:1746143846.314501:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625197696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.314517:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143846.314526:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17036 00000100:00100000:2.0:1746143846.314531:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2987:x1830963625197568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.314536:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 21 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.314544:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.314548:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 21 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.314555:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412644 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.314569:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082048e00/0x87925e4cb73b6544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3153920->4128767) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125f7 expref: 22 pid: 13436 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.314572:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.314574:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.314580:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 22 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.314650:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 21 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.314659:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.314660:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.314664:0:9587:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.314669:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.314691:0:9587:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143846.314701:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627550720:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143846.315026:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.315119:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2480 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.315169:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625197696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 670us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.315175:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8336 00000100:00100000:0.0:1746143846.316582:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.316706:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625198080 00000100:00100000:3.0:1746143846.316714:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625198080 00000100:00100000:3.0:1746143846.316794:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14095 00000100:00100000:3.0:1746143846.316800:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2994:x1830963625198080:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143846.316817:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.316832:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3c00/0x87925e4cb73b65ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841264b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.316955:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.316968:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.316976:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.317005:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.317016:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 10 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.317026:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627550848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.317691:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.319452:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627550720:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143846.319474:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:2.0:1746143846.319533:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2987:x1830963625197568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4998us (5261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.319542:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17036 00000100:00100000:3.0:1746143846.319597:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627550848:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.319614:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143846.319628:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.320042:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625198208 00000100:00100000:1.0:1746143846.320050:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625198208 00010000:00010000:1.0:1746143846.320079:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 11 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.320123:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8337 00000100:00100000:1.0:1746143846.320131:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625198208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.320145:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.320152:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 11 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.320162:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 11 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.320183:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b6575 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841260c expref: 11 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.320197:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143846.320201:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.320210:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.320220:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.320240:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.320267:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625198208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 137us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.320273:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8337 00010000:00010000:2.0:1746143846.320454:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.320460:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.320479:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.320861:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d3c00/0x87925e4cb73b65ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.320876:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.320882:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.320885:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143846.320887:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2600, rc 0) 00000100:00100000:2.0:1746143846.320955:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2994:x1830963625198080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4146us (4366us total) trans 8589945186 rc 0/0 00000100:00100000:2.0:1746143846.320962:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14095 00000100:00100000:0.0:1746143846.326057:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.326108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.326196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.326218:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625198464 00000100:00100000:2.0:1746143846.326218:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625198592 00000100:00100000:3.0:1746143846.326229:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625198464 00000100:00100000:2.0:1746143846.326229:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625198592 00000100:00100000:0.0:1746143846.326251:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.326299:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14096 00000100:00100000:2.0:1746143846.326308:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2994:x1830963625198592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143846.326333:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.326355:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b65c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412652 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.326464:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.326480:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.326487:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.326523:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.326541:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 11 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.326554:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627550976:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.326654:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.326675:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625198848 00000100:00100000:2.0:1746143846.326678:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625198848 00002000:00100000:2.0:1746143846.326703:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff8800921cc380 x1830963625198848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.326712:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963625198848 ext(2097152->4194303) 00002000:00010000:2.0:1746143846.326716:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:2.0:1746143846.326727:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625199104 00000100:00100000:2.0:1746143846.326729:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625199104 00002000:00100000:2.0:1746143846.326738:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800921ce300 x1830963625199104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.326744:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce300 with x1830963625199104 ext(2097152->4194303) 00002000:00010000:2.0:1746143846.326747:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921ce300 00000100:00100000:2.0:1746143846.326756:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7438 00000100:00100000:2.0:1746143846.326760:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625198848:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143846.326958:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800921cea00 x1830963625198464/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.326965:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cea00 with x1830963625198464 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.326969:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cea00 00000100:00100000:3.0:1746143846.326992:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7439 00000100:00100000:3.0:1746143846.326997:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625199104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143846.327035:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7440 00000100:00100000:1.0:1746143846.327042:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625198464:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.331598:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627550976:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.331630:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746143846.332890:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.333880:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625199232 00000100:00100000:3.0:1746143846.333891:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625199232 00000100:00100000:0.0:1746143846.333953:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.333966:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17037 00000100:00100000:3.0:1746143846.333974:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2989:x1830963625199232:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.333993:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.334011:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412659 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.334044:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 21 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.334055:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.334062:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 39 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.334067:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.334069:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.334072:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [1024000->1048575] (req 1024000->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 39 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.334102:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 39 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.334117:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 39 pid: 9585 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143846.334134:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627551104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.334223:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 12 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.334231:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 12 pid: 3135 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143846.334239:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627551232:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.334672:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625198464:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7628us (8620us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143846.334683:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7440 00002000:00100000:1.0:1746143846.334693:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800921cea00 x1830963625198464/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.334707:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cea00 with x1830963625198464 ext(4194304->4853759) 00002000:00010000:1.0:1746143846.334712:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cea00 00010000:00010000:3.0:1746143846.334791:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 19 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.334799:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.334807:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627551360:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.334828:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.334847:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625199360 00000100:00100000:3.0:1746143846.334851:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625199360 00010000:00010000:3.0:1746143846.334870:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 12 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.334899:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8338 00000100:00100000:3.0:1746143846.334905:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625199360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.334929:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.334934:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 12 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.334942:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 12 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.334959:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b65b4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841264b expref: 12 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.334976:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.334981:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.334991:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.334997:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.335011:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.335023:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625199360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 119us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.335028:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8338 00010000:00010000:3.0:1746143846.335046:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.335052:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143846.335106:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143846.335110:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143846.335124:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.335150:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74e00/0x87925e4cb73b65c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.335161:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.335167:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.335170:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143846.335172:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:3.0:1746143846.335187:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2994:x1830963625198592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8882us (9079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.335194:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14096 00000100:00100000:2.0:1746143846.342049:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625198848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15274us (15840us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143846.342063:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7438 00002000:00100000:2.0:1746143846.342075:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff8800921cc380 x1830963625198848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.342090:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc380 with x1830963625198848 ext(2097152->4194303) 00002000:00010000:2.0:1746143846.342096:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc380 00000100:00100000:3.0:1746143846.343478:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627551104:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143846.346051:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.346087:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.346180:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625199488 00000100:00100000:1.0:1746143846.346190:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625199488 00010000:00010000:1.0:1746143846.346229:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 38 pid: 9585 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746143846.346260:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8339 00000100:00100000:1.0:1746143846.346269:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625199488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.346284:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.346311:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 38 pid: 9585 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.346324:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 38 pid: 9585 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.346348:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466a00/0x87925e4cb73b6464 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412595 expref: 38 pid: 9585 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.346368:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.346370:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625199744 00000100:00100000:2.0:1746143846.346374:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625199744 00000100:00100000:1.0:1746143846.346409:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625199488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.346416:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8339 00000100:00100000:2.0:1746143846.346747:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5489 00000100:00100000:2.0:1746143846.346753:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2987:x1830963625199744:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143846.346852:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625199104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19846us (20592us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143846.346863:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7439 00002000:00100000:3.0:1746143846.346873:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800921ce300 x1830963625199104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.346881:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce300 with x1830963625199104 ext(2097152->4194303) 00002000:00010000:3.0:1746143846.346886:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921ce300 00000100:00100000:3.0:1746143846.346968:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627551232:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.346979:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627551360:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.347006:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [1024000->1048575] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 36 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.347019:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3400, rc 0) 00000100:00100000:3.0:1746143846.347035:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2989:x1830963625199232:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13063us (14153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.347040:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17037 00000100:00100000:0.0:1746143846.347343:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.347490:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2987:x1830963625199744:12345-192.168.202.3@tcp:35:cat.0 Request processed in 737us (1401us total) trans 8589945187 rc 0/0 00000100:00100000:2.0:1746143846.347497:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5489 00000100:00100000:1.0:1746143846.347521:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625199872 00000100:00100000:1.0:1746143846.347526:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625199872 00010000:00010000:1.0:1746143846.347541:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 13 pid: 3135 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746143846.347569:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8340 00000100:00100000:1.0:1746143846.347576:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625199872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.347583:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.347595:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 13 pid: 3135 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.347604:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 13 pid: 3135 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.347618:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408fc00/0x87925e4cb73b6583 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412621 expref: 13 pid: 3135 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.347633:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.347649:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625199872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.347654:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8340 00000100:00100000:0.0:1746143846.348427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.349742:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625200000 00000100:00100000:3.0:1746143846.349754:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625200000 00000100:00100000:3.0:1746143846.349809:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17038 00000100:00100000:3.0:1746143846.349816:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625200000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143846.349830:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.349846:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412660 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.349865:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.349867:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.349874:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.349887:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.349898:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:3.0:1746143846.349966:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625200000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 150us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.349972:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17038 00000100:00100000:0.0:1746143846.350872:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.351077:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625200128 00000100:00100000:3.0:1746143846.351084:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625200128 00010000:00010000:3.0:1746143846.351108:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.351142:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8341 00000100:00100000:3.0:1746143846.351148:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625200128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.351158:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.351176:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.351186:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.351207:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b6433 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412580 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.351237:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.351238:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.351243:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.351250:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.351347:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 35 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.351360:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627551488:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.351515:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.353709:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.353787:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625200384 00000100:00100000:3.0:1746143846.353797:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625200384 00002000:00100000:3.0:1746143846.353840:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800921cd180 x1830963625200384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.353848:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd180 with x1830963625200384 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.353853:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cd180 00000100:00100000:3.0:1746143846.354113:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7441 00000100:00100000:3.0:1746143846.354125:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625200384:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143846.358030:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627551488:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.358051:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.358105:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625200128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6956us (7239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.358115:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8341 00000100:00100000:1.0:1746143846.358279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.358413:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625200640 00000100:00100000:3.0:1746143846.358419:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625200640 00000100:00100000:3.0:1746143846.358453:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14097 00000100:00100000:3.0:1746143846.358458:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2994:x1830963625200640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143846.358476:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.358492:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73b65de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412667 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.358575:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358587:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358595:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358605:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358609:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358614:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358618:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090fc2600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.358621:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358627:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358634:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.358636:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143846.358640:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358644:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2600/0x87925e4cb73b65e5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.358665:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73b65de lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412667 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.358671:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc2200/0x87925e4cb73b65de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412667 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.358676:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc2200, rc 0) 00000100:00100000:3.0:1746143846.358706:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2994:x1830963625200640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 248us (433us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143846.358711:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14097 00000100:00100000:2.0:1746143846.358974:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.359024:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625200896 00000100:00100000:0.0:1746143846.359032:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625200896 00002000:00100000:0.0:1746143846.359067:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (1024000->1028095) req@ffff88009610f100 x1830963625200896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.359079:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610f100 with x1830963625200896 ext(1024000->1028095) 00002000:00010000:0.0:1746143846.359084:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610f100 00000100:00100000:0.0:1746143846.359110:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7442 00000100:00100000:0.0:1746143846.359116:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625200896:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143846.359241:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625200896:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 125us (267us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143846.359248:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7442 00002000:00100000:0.0:1746143846.359253:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39c:0x0] (1024000->1028095) req@ffff88009610f100 x1830963625200896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.359260:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610f100 with x1830963625200896 ext(1024000->1028095) 00002000:00010000:0.0:1746143846.359263:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610f100 00000100:00100000:3.0:1746143846.359416:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625200384:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 5293us (5718us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143846.359424:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7441 00002000:00100000:3.0:1746143846.359431:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800921cd180 x1830963625200384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 659456/659456 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.359439:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd180 with x1830963625200384 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.359444:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cd180 00000100:00100000:0.0:1746143846.360669:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.360850:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625201152 00000100:00100000:3.0:1746143846.360858:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625201152 00000100:00100000:3.0:1746143846.360905:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5490 00000100:00100000:3.0:1746143846.360937:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2994:x1830963625201152:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143846.361169:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2994:x1830963625201152:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 256us (504us total) trans 8589945188 rc 0/0 00000100:00100000:3.0:1746143846.361175:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5490 00000100:00100000:0.0:1746143846.362300:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.362385:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625201280 00000100:00100000:3.0:1746143846.362393:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625201280 00000100:00100000:3.0:1746143846.362672:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17039 00000100:00100000:3.0:1746143846.362680:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+33:2989:x1830963625201280:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.362698:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.362716:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841266e expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.362747:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.362755:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.362762:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.362768:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.362769:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.362774:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1048576->1945599] (req 1048576->1945599) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.362807:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.362818:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 21 pid: 1947 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.363213:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627551616:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.363324:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.363333:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.363342:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627551744:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.363371:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 13 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.363379:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 13 pid: 1947 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143846.363387:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627551872:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.363403:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.366619:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.366952:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627551616:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.367030:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625201536 00000100:00100000:2.0:1746143846.367037:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625201536 00000100:00100000:2.0:1746143846.367096:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5491 00000100:00100000:2.0:1746143846.367104:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+277:2993:x1830963625201536:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143846.367216:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627551744:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.367224:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627551872:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.367256:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1048576->1945599] (req 1048576->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.367273:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3e00, rc 0) 00000100:00100000:3.0:1746143846.367329:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2989:x1830963625201280:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4650us (5042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.367580:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17039 00000100:00100000:2.0:1746143846.367677:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:2993:x1830963625201536:12345-192.168.202.3@tcp:35:cat.0 Request processed in 574us (1067us total) trans 8589945189 rc 0/0 00000100:00100000:2.0:1746143846.367684:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5491 00000100:00100000:0.0:1746143846.370087:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.370115:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.370153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.370277:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625201792 00000100:00100000:2.0:1746143846.370285:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625201792 00010000:00010000:2.0:1746143846.370326:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 14 pid: 1947 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143846.370349:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625201664 00000100:00100000:2.0:1746143846.370351:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625201664 00010000:00010000:2.0:1746143846.370360:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.370373:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625201920 00000100:00100000:2.0:1746143846.370375:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625201920 00010000:00010000:2.0:1746143846.370382:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 22 pid: 1947 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.370394:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8342 00000100:00100000:2.0:1746143846.370401:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625201792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.370413:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.370431:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 14 pid: 1947 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143846.370433:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8343 00000100:00100000:3.0:1746143846.370441:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625201664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.370441:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 14 pid: 1947 timeout: 1005 lvb_type: 1 00010000:00010000:3.0:1746143846.370450:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143846.370499:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8344 00000100:00100000:1.0:1746143846.370507:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625201920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.370515:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.370713:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.370724:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.370737:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6218 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412422 expref: 34 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.370758:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143846.370767:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 22 pid: 1947 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.370777:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 22 pid: 1947 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.370788:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e504e00/0x87925e4cb73b61f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412406 expref: 22 pid: 1947 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.370792:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625201664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 353us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.370799:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8343 00010000:00010000:1.0:1746143846.370806:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.370808:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.370814:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.370822:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.370856:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.370869:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627552000:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143846.370947:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746143846.371053:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a44800/0x87925e4cb73b6115 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484123b2 expref: 14 pid: 1947 timeout: 1005 lvb_type: 1 00010000:00010000:2.0:1746143846.371063:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.371081:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625201792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 680us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.371087:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8342 00000100:00100000:1.0:1746143846.375436:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627552000:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143846.376114:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.376184:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625201920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5675us (6028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.376194:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8344 00000100:00100000:0.0:1746143846.377712:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.377777:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625202176 00000100:00100000:3.0:1746143846.377786:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625202176 00002000:00100000:3.0:1746143846.377829:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1941504->1945599) req@ffff8800921cd880 x1830963625202176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.377839:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd880 with x1830963625202176 ext(1941504->1945599) 00002000:00010000:3.0:1746143846.377844:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cd880 00000100:00100000:3.0:1746143846.377874:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7443 00000100:00100000:3.0:1746143846.377880:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625202176:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.378027:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625202176:12345-192.168.202.3@tcp:3:cat.0 Request processed in 147us (323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143846.378033:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7443 00002000:00100000:3.0:1746143846.378038:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1941504->1945599) req@ffff8800921cd880 x1830963625202176/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.378046:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cd880 with x1830963625202176 ext(1941504->1945599) 00002000:00010000:3.0:1746143846.378048:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cd880 00000100:00100000:0.0:1746143846.384794:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.384948:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625202432 00000100:00100000:2.0:1746143846.384960:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625202432 00000100:00100000:2.0:1746143846.385108:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5492 00000100:00100000:2.0:1746143846.385117:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:2989:x1830963625202432:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143846.385789:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+279:2989:x1830963625202432:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 671us (1004us total) trans 8589945190 rc 0/0 00000100:00100000:2.0:1746143846.385796:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5492 00000100:00100000:0.0:1746143846.417660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.417728:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625202688 00000100:00100000:2.0:1746143846.417739:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625202688 00000100:00100000:2.0:1746143846.418023:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14098 00000100:00100000:2.0:1746143846.418033:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:3001:x1830963625202688:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143846.418056:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.418076:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b65f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412675 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.418156:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418170:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418181:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418455:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418463:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418469:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418566:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418580:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418586:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.418595:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.418667:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418674:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418679:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418684:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418690:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.418694:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418699:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418708:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143846.418711:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143846.418714:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418718:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1800/0x87925e4cb73b65fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418742:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418747:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418751:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418755:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.418757:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418761:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418765:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030700) 00010000:00010000:2.0:1746143846.418767:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143846.418943:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418949:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1e00/0x87925e4cb73b6601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.418984:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1400/0x87925e4cb73b65f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.418993:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.418998:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.419000:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143846.419002:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0200, rc 0) 00000100:00100000:2.0:1746143846.419055:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3001:x1830963625202688:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1023us (1405us total) trans 8589945191 rc 0/0 00000100:00100000:2.0:1746143846.419061:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14098 00000100:00100000:0.0:1746143846.463633:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.463752:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625202816 00000100:00100000:3.0:1746143846.463763:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625202816 00000100:00100000:3.0:1746143846.463825:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17040 00000100:00100000:3.0:1746143846.463833:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:3001:x1830963625202816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.463854:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.463872:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841267c expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.463904:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.463953:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.463960:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.463966:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.463968:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.463970:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3600384->4141055] (req 3600384->4141055) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.464002:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.464014:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 35 pid: 13430 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.464026:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552128:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.465116:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.465126:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 12 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:3.0:1746143846.465135:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552256:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.465743:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.465753:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 20 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.465762:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552384:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143846.466278:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.466359:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.466452:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203072 00000100:00100000:2.0:1746143846.466458:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203072 00000100:00100000:2.0:1746143846.466496:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14099 00000100:00100000:2.0:1746143846.466502:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3004:x1830963625203072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.466523:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.466540:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b661d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412683 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.466635:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.466648:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.466659:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.466670:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.466769:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0400/0x87925e4cb73b661d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.466792:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.466799:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.466803:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143846.466805:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1000, rc 0) 00000100:00100000:2.0:1746143846.466836:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3004:x1830963625203072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 332us (558us total) trans 8589945192 rc 0/0 00000100:00100000:2.0:1746143846.466841:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14099 00000100:00100000:3.0:1746143846.469213:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552128:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.472472:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552256:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.472544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.472621:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.472624:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.472654:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143846.472660:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3600384->4141055] (req 3600384->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.472669:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143846.472680:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:1.0:1746143846.472691:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203456 00000100:00100000:1.0:1746143846.472698:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203456 00000100:00100000:3.0:1746143846.472725:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3001:x1830963625202816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8893us (9105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.472732:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17040 00000100:00100000:1.0:1746143846.472738:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203584 00000100:00100000:1.0:1746143846.472740:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203584 00000100:00100000:3.0:1746143846.472751:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17041 00000100:00100000:1.0:1746143846.472756:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17042 00000100:00100000:3.0:1746143846.472757:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625203456:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143846.472761:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625203584:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.472771:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.472771:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.472784:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6632 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841268a expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.472784:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091381000/0x87925e4cb73b6639 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412691 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.472824:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552512:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143846.472825:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627552640:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143846.472873:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.473096:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203200 00000100:00100000:0.0:1746143846.473100:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203200 00010000:00010000:0.0:1746143846.473124:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 13 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746143846.473151:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203328 00000100:00100000:0.0:1746143846.473153:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203328 00010000:00010000:0.0:1746143846.473162:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746143846.473176:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8345 00000100:00100000:0.0:1746143846.473180:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625203200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143846.473189:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143846.473214:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 13 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.473224:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 13 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.473243:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090fc3600/0x87925e4cb73b65d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412660 expref: 13 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.473257:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.473412:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8346 00000100:00100000:1.0:1746143846.473413:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.473418:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625203328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.473425:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.473434:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.473442:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.473454:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b65a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4853759) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412644 expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.473465:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.473478:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625203328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 61us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.473483:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8346 00000100:00100000:3.0:1746143846.473518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.473534:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203712 00000100:00100000:1.0:1746143846.473537:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203712 00000100:00100000:1.0:1746143846.473555:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17043 00000100:00100000:1.0:1746143846.473559:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625203712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.473565:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.473571:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73b6640 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412698 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.473573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143846.473582:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746143846.473583:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625203840 00000100:00100000:3.0:1746143846.473586:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625203840 00010000:00010000:1.0:1746143846.473588:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73b6640 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412698 expref: 22 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.473594:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380800/0x87925e4cb73b6640 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412698 expref: 22 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.473597:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 36 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.473604:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380800, rc 0) 00000100:00100000:3.0:1746143846.473614:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8347 00000100:00100000:1.0:1746143846.473618:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625203712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 58us (100us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143846.473622:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625203840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143846.473623:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17043 00010000:00010000:3.0:1746143846.473627:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.473634:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 36 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.473643:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 36 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.473654:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380400/0x87925e4cb73b6560 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412613 expref: 36 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.473663:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.473664:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.473670:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.473678:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.473695:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 20 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.473702:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627552768:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.473719:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8c180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.474269:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625203200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1085us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.474275:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8345 00000100:00100000:3.0:1746143846.475348:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627552512:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143846.475369:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6632 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841268a expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.475379:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189d200/0x87925e4cb73b6632 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841268a expref: 20 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.475387:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d200, rc 0) 00002000:00010000:1.0:1746143846.475726:0:3135:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143846.475733:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143845 -> 1746143846 00002000:00010000:1.0:1746143846.475735:0:3135:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143845 -> 1746143846 00000100:00100000:1.0:1746143846.475746:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627552640:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143846.475757:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625203456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3000us (3101us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143846.475763:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17041 00010000:00010000:1.0:1746143846.475767:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091381000/0x87925e4cb73b6639 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412691 expref: 22 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.475776:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091381000/0x87925e4cb73b6639 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412691 expref: 22 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.475783:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381000, rc 0) 00000100:00100000:1.0:1746143846.475801:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625203584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3040us (3131us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143846.475807:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17042 00000100:00100000:2.0:1746143846.476249:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627552768:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143846.476260:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.476300:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625203840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2680us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.476308:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8347 00000100:00100000:0.0:1746143846.477213:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.477310:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625204096 00000100:00100000:2.0:1746143846.477316:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625204096 00002000:00100000:2.0:1746143846.477353:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3600384->3604479) req@ffff880135b0b480 x1830963625204096/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.477360:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0b480 with x1830963625204096 ext(3600384->3604479) 00002000:00010000:2.0:1746143846.477363:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0b480 00000100:00100000:2.0:1746143846.477402:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7444 00000100:00100000:2.0:1746143846.477408:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625204096:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143846.477512:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625204096:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 104us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143846.477517:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7444 00002000:00100000:2.0:1746143846.477522:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3600384->3604479) req@ffff880135b0b480 x1830963625204096/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.477528:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b0b480 with x1830963625204096 ext(3600384->3604479) 00002000:00010000:2.0:1746143846.477531:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b0b480 00000100:00100000:0.0:1746143846.478759:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.478808:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625204224 00000100:00100000:1.0:1746143846.478818:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625204224 00000100:00100000:1.0:1746143846.478883:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17044 00000100:00100000:1.0:1746143846.478889:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+19:3004:x1830963625204224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.478902:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.478937:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841269f expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.478962:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.478970:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.478972:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.478975:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.479004:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 34 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.479015:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 34 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.479025:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627552896:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.479251:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.482986:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627552896:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.483024:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.483043:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381200, rc 0) 00000100:00100000:1.0:1746143846.483103:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3004:x1830963625204224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4213us (4347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.483111:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17044 00000100:00100000:0.0:1746143846.483640:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.483785:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625204352 00000100:00100000:3.0:1746143846.483792:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625204352 00002000:00100000:3.0:1746143846.483826:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (1024000->1048575) req@ffff880135b09c00 x1830963625204352/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.483836:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09c00 with x1830963625204352 ext(1024000->1048575) 00010000:00010000:3.0:1746143846.483843:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.483855:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.483861:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b09c00 00000100:00100000:3.0:1746143846.483977:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2726 00000100:00100000:3.0:1746143846.483985:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625204352:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143846.485710:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.485804:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625204608 00000100:00100000:2.0:1746143846.485811:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625204608 00002000:00100000:2.0:1746143846.485840:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4136960->4141055) req@ffff880135b09880 x1830963625204608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.485850:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963625204608 ext(4136960->4141055) 00002000:00010000:2.0:1746143846.485855:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:2.0:1746143846.485871:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7445 00000100:00100000:2.0:1746143846.485877:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625204608:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143846.486173:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625204608:12345-192.168.202.3@tcp:3:cat.0 Request processed in 294us (467us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143846.486180:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7445 00002000:00100000:2.0:1746143846.486185:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4136960->4141055) req@ffff880135b09880 x1830963625204608/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.486192:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09880 with x1830963625204608 ext(4136960->4141055) 00002000:00010000:2.0:1746143846.486194:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09880 00000100:00100000:3.0:1746143846.486323:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625204352:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2338us (2683us total) trans 17179874051 rc 0/0 00000100:00100000:3.0:1746143846.486330:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2726 00002000:00100000:3.0:1746143846.486335:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (1024000->1048575) req@ffff880135b09c00 x1830963625204352/t17179874051(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.486341:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09c00 with x1830963625204352 ext(1024000->1048575) 00010000:00010000:3.0:1746143846.486347:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 37 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.486438:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 37 pid: 9587 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.486447:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b09c00 00000100:00100000:0.0:1746143846.490477:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.490581:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625204736 00000100:00100000:2.0:1746143846.490591:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625204736 00010000:00010000:2.0:1746143846.490808:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 37 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.490850:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8348 00000100:00100000:2.0:1746143846.490858:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625204736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.490876:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.490899:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 37 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.490945:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 37 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.490971:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3400/0x87925e4cb73b65d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1024000->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412659 expref: 37 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.490991:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.490993:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.491001:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 19 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.491010:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 19 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.491047:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 19 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143846.491059:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627553024:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143846.491147:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.493383:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.493650:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625204992 00000100:00100000:2.0:1746143846.493657:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625204992 00000100:00100000:2.0:1746143846.493708:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5493 00000100:00100000:2.0:1746143846.493715:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3001:x1830963625204992:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143846.493851:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627553024:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.493871:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.494395:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3001:x1830963625204992:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 678us (1016us total) trans 8589945193 rc 0/0 00000100:00100000:2.0:1746143846.494405:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5493 00000100:00100000:3.0:1746143846.494598:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625204736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3738us (4131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.494608:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8348 00000100:00100000:0.0:1746143846.496665:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.496875:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625205248 00000100:00100000:3.0:1746143846.496883:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625205248 00002000:00100000:3.0:1746143846.496941:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880135b08000 x1830963625205248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.496950:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08000 with x1830963625205248 ext(0->1048575) 00002000:00010000:3.0:1746143846.496954:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b08000 00000100:00100000:3.0:1746143846.496980:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7446 00000100:00100000:3.0:1746143846.496986:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625205248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.509117:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625205248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12123us (12450us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143846.509127:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7446 00002000:00100000:3.0:1746143846.509137:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880135b08000 x1830963625205248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.509145:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08000 with x1830963625205248 ext(0->1048575) 00002000:00010000:3.0:1746143846.509151:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b08000 00000100:00100000:0.0:1746143846.509699:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.509751:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625205504 00000100:00100000:3.0:1746143846.509757:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625205504 00000100:00100000:3.0:1746143846.510747:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14100 00000100:00100000:3.0:1746143846.510756:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:3006:x1830963625205504:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.510775:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.510790:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189cc00/0x87925e4cb73b664e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126a6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.510846:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.510857:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.510865:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.510876:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.510881:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.510889:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511028:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511038:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511044:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143846.511051:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143846.511107:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511113:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511117:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511121:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511126:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189d000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.511129:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511135:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511143:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143846.511145:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.511149:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511153:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d000/0x87925e4cb73b6655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511173:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511177:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511181:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511184:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189ce00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143846.511186:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511190:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511195:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012fee7100) 00010000:00010000:3.0:1746143846.511197:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143846.511199:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511202:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b665c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.511232:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189cc00/0x87925e4cb73b664e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 282 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.511241:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 281 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.511247:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.511249:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143846.511251:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d600, rc 0) 00000100:00100000:3.0:1746143846.511309:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+281:3006:x1830963625205504:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 555us (1611us total) trans 8589945194 rc 0/0 00000100:00100000:3.0:1746143846.511315:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14100 00000100:00100000:0.0:1746143846.519559:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.519646:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625205632 00000100:00100000:1.0:1746143846.519654:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625205632 00000100:00100000:1.0:1746143846.519704:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17045 00000100:00100000:1.0:1746143846.519711:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3004:x1830963625205632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.519727:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.519742:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126ad expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.519767:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.519778:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.519780:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.519783:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.520482:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 32 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.520495:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 32 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.520506:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627553152:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.521130:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.526108:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.526306:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627553152:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.526335:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.526349:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:3.0:1746143846.526385:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625205760 00000100:00100000:1.0:1746143846.526399:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3004:x1830963625205632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6688us (7192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.526407:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17045 00000100:00100000:3.0:1746143846.526663:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625205760 00002000:00100000:3.0:1746143846.526694:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1945599) req@ffff880135b08700 x1830963625205760/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.526702:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08700 with x1830963625205760 ext(1048576->1945599) 00010000:00010000:3.0:1746143846.526711:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 33 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.526721:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 33 pid: 9587 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.526726:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b08700 00000100:00100000:3.0:1746143846.526753:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2727 00000100:00100000:3.0:1746143846.526759:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625205760:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143846.530521:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.530908:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625205888 00000100:00100000:1.0:1746143846.530933:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625205888 00000100:00100000:1.0:1746143846.530979:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17046 00000100:00100000:1.0:1746143846.530986:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:3006:x1830963625205888:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143846.531034:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.531051:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126b4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.531074:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 19 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.531081:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.531087:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.531092:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.531093:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.531096:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.531117:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.531126:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746143846.531135:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553280:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.531196:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 11 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.531208:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 11 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746143846.531215:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553408:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.531238:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 19 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.531246:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 19 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.531253:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553536:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.531268:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.536169:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553280:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.536181:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553408:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.536187:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553536:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143846.536219:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1851392->2097151] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.536233:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fc00, rc 0) 00000100:00100000:1.0:1746143846.536268:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:3006:x1830963625205888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5283us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.536276:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17046 00000100:00100000:3.0:1746143846.536325:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625205760:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9564us (10222us total) trans 21474841318 rc 0/0 00000100:00100000:3.0:1746143846.536334:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2727 00002000:00100000:3.0:1746143846.536343:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1945599) req@ffff880135b08700 x1830963625205760/t21474841318(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.536352:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08700 with x1830963625205760 ext(1048576->1945599) 00010000:00010000:3.0:1746143846.536360:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.536370:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.536376:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135b08700 00000100:00100000:0.0:1746143846.538899:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.538977:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.539058:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625206144 00000100:00100000:3.0:1746143846.539066:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625206144 00010000:00010000:3.0:1746143846.539093:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.539209:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625206016 00000100:00100000:1.0:1746143846.539213:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625206016 00000100:00100000:3.0:1746143846.539217:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8349 00000100:00100000:3.0:1746143846.539269:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2011:x1830963625206144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.539281:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.539307:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.539317:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.539335:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011de83000/0x87925e4cb73b643a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412587 expref: 20 pid: 9585 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.539360:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.539393:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625206144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 170us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.539399:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8349 00010000:00010000:1.0:1746143846.539435:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 12 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746143846.539467:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8350 00000100:00100000:1.0:1746143846.539473:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625206016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.539479:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.539487:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 12 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746143846.540309:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143846.540390:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 12 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.540403:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b8400/0x87925e4cb73b6591 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841262f expref: 12 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.540415:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.540421:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625206272 00000100:00100000:2.0:1746143846.540426:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625206272 00000100:00100000:1.0:1746143846.540437:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625206016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 965us (1460us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143846.540443:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 1005 lvb_type: 1 00000100:00100000:1.0:1746143846.540443:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8350 00000100:00100000:1.0:1746143846.540456:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8351 00000100:00100000:1.0:1746143846.540461:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625206272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.540468:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.540477:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.540547:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.540558:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d467400/0x87925e4cb73b6472 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125a3 expref: 37 pid: 9587 timeout: 1005 lvb_type: 1 00010000:00010000:1.0:1746143846.540566:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.540567:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.540572:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.540579:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.540605:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.540615:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627553664:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143846.540674:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.541897:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.541943:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625206400 00000100:00100000:3.0:1746143846.541948:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625206400 00010000:00010000:3.0:1746143846.541976:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.542000:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8352 00000100:00100000:3.0:1746143846.542006:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625206400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.542015:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.542027:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.542035:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.542047:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b65ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1945599) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841266e expref: 35 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.542057:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.542058:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.542062:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.542069:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.542104:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.542113:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627553792:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.542154:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746143846.543632:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627553664:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143846.543649:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.543679:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625206272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3217us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.543687:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8351 00000100:00100000:0.0:1746143846.543817:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.543884:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625206656 00000100:00100000:3.0:1746143846.543889:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625206656 00002000:00100000:3.0:1746143846.543939:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1851392->1855487) req@ffff880095cb6a00 x1830963625206656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.543947:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6a00 with x1830963625206656 ext(1851392->1855487) 00002000:00010000:3.0:1746143846.543950:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb6a00 00000100:00100000:3.0:1746143846.543973:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7447 00000100:00100000:3.0:1746143846.543979:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625206656:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143846.544088:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625206656:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 109us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143846.544094:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7447 00002000:00100000:3.0:1746143846.544098:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1851392->1855487) req@ffff880095cb6a00 x1830963625206656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.544104:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6a00 with x1830963625206656 ext(1851392->1855487) 00002000:00010000:3.0:1746143846.544106:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb6a00 00000100:00100000:3.0:1746143846.545301:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627553792:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.545317:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.545342:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625206400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3336us (3447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.545349:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8352 00000100:00100000:0.0:1746143846.547872:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.548127:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625206912 00000100:00100000:3.0:1746143846.548134:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625206912 00002000:00100000:3.0:1746143846.548164:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095cb5180 x1830963625206912/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.548170:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5180 with x1830963625206912 ext(1048576->2097151) 00002000:00010000:3.0:1746143846.548174:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5180 00000100:00100000:3.0:1746143846.548236:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7448 00000100:00100000:3.0:1746143846.548241:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625206912:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143846.552733:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.552819:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207040 00000100:00100000:1.0:1746143846.552827:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207040 00000100:00100000:1.0:1746143846.552877:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17047 00000100:00100000:1.0:1746143846.552884:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:3006:x1830963625207040:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143846.552899:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.552937:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126bb expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.552963:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.552969:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.552970:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143846.552973:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.552998:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 18 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.553008:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 18 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.553019:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553920:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143846.553104:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.554817:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625206912:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6570us (6947us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143846.554827:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7448 00002000:00100000:3.0:1746143846.554835:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095cb5180 x1830963625206912/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.554842:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5180 with x1830963625206912 ext(1048576->2097151) 00002000:00010000:3.0:1746143846.554847:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb5180 00000100:00100000:2.0:1746143846.555153:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627553920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.555176:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->2187263] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.555188:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d7de00, rc 0) 00000100:00100000:2.0:1746143846.555208:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:3006:x1830963625207040:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2325us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.555214:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17047 00000100:00100000:0.0:1746143846.556760:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.556821:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207168 00000100:00100000:3.0:1746143846.556828:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207168 00002000:00100000:3.0:1746143846.556861:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3600384->4141055) req@ffff880095cb6300 x1830963625207168/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.556868:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6300 with x1830963625207168 ext(3600384->4141055) 00010000:00010000:3.0:1746143846.556875:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 19 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.556891:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 19 pid: 9587 timeout: 1005 lvb_type: 0 00002000:00010000:3.0:1746143846.556897:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb6300 00000100:00100000:2.0:1746143846.556952:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2728 00000100:00100000:2.0:1746143846.556966:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625207168:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143846.561540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.561598:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207296 00000100:00100000:3.0:1746143846.561606:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207296 00000100:00100000:3.0:1746143846.561653:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17048 00000100:00100000:3.0:1746143846.561660:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3004:x1830963625207296:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.561676:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.561688:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126c2 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.561712:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.561720:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143846.561721:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143846.561725:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.561749:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.561759:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 36 pid: 3135 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.561773:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627554048:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.561854:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.564266:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.564401:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627554048:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.564410:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625207168:12345-192.168.202.3@tcp:4:cat.0 Request processed in 7445us (7653us total) trans 17179874052 rc 0/0 00000100:00100000:2.0:1746143846.564420:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2728 00010000:00010000:3.0:1746143846.564423:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143846.564429:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3600384->4141055) req@ffff880095cb6300 x1830963625207168/t17179874052(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746143846.564436:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d000, rc 0) 00002000:00100000:2.0:1746143846.564437:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6300 with x1830963625207168 ext(3600384->4141055) 00010000:00010000:2.0:1746143846.564445:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 23 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.564454:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3004:x1830963625207296:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2795us (2923us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143846.564455:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 23 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.564459:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17048 00002000:00010000:2.0:1746143846.564461:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb6300 00000100:00100000:2.0:1746143846.564477:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207424 00000100:00100000:2.0:1746143846.564482:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207424 00002000:00100000:2.0:1746143846.564505:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1851392->2097151) req@ffff880095cb4000 x1830963625207424/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.564511:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4000 with x1830963625207424 ext(1851392->2097151) 00010000:00010000:2.0:1746143846.564515:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 37 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.564522:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 37 pid: 3135 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143846.564527:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb4000 00000100:00100000:2.0:1746143846.564551:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2729 00000100:00100000:2.0:1746143846.564558:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625207424:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143846.567436:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.568564:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207552 00000100:00100000:3.0:1746143846.568573:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207552 00010000:00010000:3.0:1746143846.568601:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.568627:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8353 00000100:00100000:3.0:1746143846.568633:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625207552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.568645:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.568660:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.568669:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.568691:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b6616 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4141055) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841267c expref: 22 pid: 9587 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.568706:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.568707:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.568712:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.568724:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.568752:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.568763:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627554176:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.568823:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.570665:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625207424:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6101us (6399us total) trans 17179874053 rc 0/0 00000100:00100000:2.0:1746143846.570674:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2729 00002000:00100000:2.0:1746143846.570682:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1851392->2097151) req@ffff880095cb4000 x1830963625207424/t17179874053(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.570696:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4000 with x1830963625207424 ext(1851392->2097151) 00010000:00010000:2.0:1746143846.570704:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 39 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.570716:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 39 pid: 3135 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143846.570721:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb4000 00000100:00100000:3.0:1746143846.571970:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627554176:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.571989:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.572020:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625207552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3387us (4591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.572029:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8353 00000100:00100000:0.0:1746143846.572839:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.572999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.573161:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207808 00000100:00100000:2.0:1746143846.573168:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207808 00002000:00100000:2.0:1746143846.573198:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2183168->2187263) req@ffff880095cb5500 x1830963625207808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.573207:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5500 with x1830963625207808 ext(2183168->2187263) 00002000:00010000:2.0:1746143846.573211:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5500 00000100:00100000:2.0:1746143846.573234:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7449 00000100:00100000:2.0:1746143846.573240:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625207808:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143846.573560:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625207936 00000100:00100000:3.0:1746143846.573564:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625207936 00010000:00010000:3.0:1746143846.573579:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 40 pid: 3135 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.573601:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8354 00000100:00100000:3.0:1746143846.573605:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625207936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.573612:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.573623:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 40 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.573633:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 40 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.573650:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84fc00/0x87925e4cb73b6678 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1851392->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126b4 expref: 40 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.573662:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.573664:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.573670:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.573677:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.573702:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 20 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.573712:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627554304:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143846.573838:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625207808:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 597us (1000us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143846.573844:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7449 00002000:00100000:2.0:1746143846.573849:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2183168->2187263) req@ffff880095cb5500 x1830963625207808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.573856:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5500 with x1830963625207808 ext(2183168->2187263) 00002000:00010000:2.0:1746143846.573859:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5500 00000100:00100000:3.0:1746143846.574231:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.576220:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627554304:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.576236:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.576282:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625207936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2675us (3282us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.576299:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8354 00000100:00100000:0.0:1746143846.578304:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.578351:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.578417:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625208192 00000100:00100000:2.0:1746143846.578425:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625208192 00000100:00100000:3.0:1746143846.578547:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625208448 00000100:00100000:3.0:1746143846.578550:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625208448 00000100:00100000:2.0:1746143846.578557:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5494 00000100:00100000:2.0:1746143846.578566:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:3006:x1830963625208192:12345-192.168.202.3@tcp:35:multiop.0 00002000:00100000:3.0:1746143846.578576:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095cb5880 x1830963625208448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.578583:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963625208448 ext(1048576->2097151) 00002000:00010000:3.0:1746143846.578586:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:3.0:1746143846.578598:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7450 00000100:00100000:3.0:1746143846.578602:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625208448:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143846.578739:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:3006:x1830963625208192:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 175us (450us total) trans 8589945195 rc 0/0 00000100:00100000:2.0:1746143846.578745:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5494 00000100:00100000:3.0:1746143846.589843:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625208448:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11233us (11484us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143846.589854:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7450 00002000:00100000:3.0:1746143846.589865:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095cb5880 x1830963625208448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.589873:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5880 with x1830963625208448 ext(1048576->2097151) 00002000:00010000:3.0:1746143846.589878:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5880 00000100:00100000:2.0:1746143846.600887:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.601032:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625208832 00000100:00100000:3.0:1746143846.601040:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625208832 00000100:00100000:3.0:1746143846.601084:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17049 00000100:00100000:0.0:1746143846.601086:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.601091:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3004:x1830963625208832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.601106:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.601120:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126d0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.601143:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.601149:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143846.601151:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143846.601153:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.601177:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.601187:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 37 pid: 3135 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.601198:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627554432:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.601255:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.601544:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625208704 00000100:00100000:2.0:1746143846.601548:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625208704 00000100:00100000:2.0:1746143846.601583:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14101 00000100:00100000:2.0:1746143846.601589:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:3011:x1830963625208704:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.601600:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.601610:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b6694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126c9 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.601678:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.601688:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.601697:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.601705:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.601787:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3e00/0x87925e4cb73b6694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 285 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.601843:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 284 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.601850:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.601852:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143846.601854:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090fc3600, rc 0) 00000100:00100000:2.0:1746143846.601879:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:3011:x1830963625208704:12345-192.168.202.3@tcp:101:cat.0 Request processed in 290us (793us total) trans 8589945196 rc 0/0 00000100:00100000:2.0:1746143846.601885:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14101 00000100:00100000:0.0:1746143846.603762:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.603837:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627554432:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.603837:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625208960 00000100:00100000:2.0:1746143846.603843:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625208960 00010000:00010000:3.0:1746143846.603858:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 22 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.603869:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189cc00, rc 0) 00002000:00100000:2.0:1746143846.603875:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2187263) req@ffff880095cb4380 x1830963625208960/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.603883:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4380 with x1830963625208960 ext(2097152->2187263) 00010000:00010000:2.0:1746143846.603889:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 38 pid: 3135 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.603897:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3004:x1830963625208832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2806us (3015us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143846.603899:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 38 pid: 3135 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.603903:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17049 00002000:00010000:2.0:1746143846.603905:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb4380 00000100:00100000:2.0:1746143846.603941:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2730 00000100:00100000:2.0:1746143846.603988:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625208960:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143846.605722:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.605802:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625209088 00000100:00100000:3.0:1746143846.605808:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625209088 00000100:00100000:3.0:1746143846.605839:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17050 00000100:00100000:3.0:1746143846.605843:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625209088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.605851:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.605861:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126d7 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.605874:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.605875:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.605880:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 41 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.605889:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 41 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143846.605895:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:3.0:1746143846.605937:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625209088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.605941:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17050 00000100:00100000:0.0:1746143846.606407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.606799:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625209216 00000100:00100000:1.0:1746143846.606803:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625209216 00000100:00100000:1.0:1746143846.606846:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17051 00000100:00100000:1.0:1746143846.606851:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625209216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.606862:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.606872:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126de expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.606884:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.606885:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.606890:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.606900:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 35 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.606908:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:1.0:1746143846.606948:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625209216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 96us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.606953:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17051 00000100:00100000:0.0:1746143846.607090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.607128:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625209472 00000100:00100000:2.0:1746143846.607132:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625209472 00000100:00100000:0.0:1746143846.607133:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.607153:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625209344 00000100:00100000:2.0:1746143846.607155:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625209344 00000100:00100000:2.0:1746143846.607174:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17052 00000100:00100000:2.0:1746143846.607179:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625209472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.607186:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143846.607191:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17053 00010000:00010000:2.0:1746143846.607193:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b66b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126ec expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143846.607196:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625209344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143846.607201:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.607206:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126e5 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.607213:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.607214:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.607218:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 44 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143846.607225:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627554560:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143846.607226:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 44 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.607232:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28c00, rc 0) 00000100:00100000:1.0:1746143846.607261:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625209344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.607266:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17053 00000100:00100000:2.0:1746143846.607284:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00002000:00010000:2.0:1746143846.609935:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143846 -> 1746143847 00002000:00010000:2.0:1746143846.609941:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime: 1746143846 -> 1746143847 00000100:00100000:2.0:1746143846.609954:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627554560:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143846.609983:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b66b7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ec expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.609996:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b66b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ec expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.610008:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269c00, rc 0) 00000100:00100000:2.0:1746143846.610059:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625209472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2878us (2973us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143846.610066:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17052 00000100:00100000:2.0:1746143846.610825:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625208960:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6877us (7067us total) trans 17179874054 rc 0/0 00000100:00100000:2.0:1746143846.610833:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2730 00002000:00100000:2.0:1746143846.610841:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2187263) req@ffff880095cb4380 x1830963625208960/t17179874054(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.610854:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4380 with x1830963625208960 ext(2097152->2187263) 00010000:00010000:2.0:1746143846.610861:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 42 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.610871:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 42 pid: 3135 timeout: 1005 lvb_type: 0 00002000:00010000:2.0:1746143846.610876:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb4380 00000100:00100000:0.0:1746143846.613358:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.613564:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625209600 00000100:00100000:3.0:1746143846.613572:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625209600 00010000:00010000:3.0:1746143846.613602:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 42 pid: 3135 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.613626:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8355 00000100:00100000:3.0:1746143846.613632:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625209600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.613643:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.613660:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 42 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.613671:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 42 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.613689:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d7de00/0x87925e4cb73b667f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2187263) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126bb expref: 42 pid: 3135 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.613714:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.613715:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.613722:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.613729:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.613760:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.613770:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627554688:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.613843:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.617251:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627554688:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.617269:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.617327:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121579450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625209600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3694us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.617336:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8355 00000100:00100000:1.0:1746143846.617903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.618000:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.618085:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625209856 00000100:00100000:0.0:1746143846.618091:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625209856 00002000:00100000:0.0:1746143846.618124:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800972e9c00 x1830963625209856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.618133:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9c00 with x1830963625209856 ext(0->1048575) 00002000:00010000:0.0:1746143846.618136:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9c00 00000100:00100000:0.0:1746143846.618156:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625210112 00000100:00100000:0.0:1746143846.618159:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625210112 00002000:00100000:0.0:1746143846.618172:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800972e9880 x1830963625210112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.618179:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9880 with x1830963625210112 ext(1048576->2097151) 00002000:00010000:0.0:1746143846.618182:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9880 00000100:00100000:0.0:1746143846.618193:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7451 00000100:00100000:0.0:1746143846.618199:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625209856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.618447:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7452 00000100:00100000:3.0:1746143846.618454:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625210112:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143846.620396:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.620428:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625210368 00000100:00100000:2.0:1746143846.620436:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625210368 00002000:00100000:2.0:1746143846.620469:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800972e8000 x1830963625210368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.620478:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8000 with x1830963625210368 ext(1048576->2097151) 00002000:00010000:2.0:1746143846.620482:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8000 00000100:00100000:2.0:1746143846.620498:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7453 00000100:00100000:2.0:1746143846.620504:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625210368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143846.621906:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.621954:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625210624 00000100:00100000:3.0:1746143846.621960:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625210624 00002000:00100000:3.0:1746143846.621986:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880087df6a00 x1830963625210624/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.621994:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df6a00 with x1830963625210624 ext(2097152->4194303) 00002000:00010000:3.0:1746143846.621998:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df6a00 00000100:00100000:3.0:1746143846.622013:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7454 00000100:00100000:3.0:1746143846.622019:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625210624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143846.630054:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625209856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11840us (12137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143846.630064:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7451 00002000:00100000:2.0:1746143846.630074:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8800972e9c00 x1830963625209856/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.630082:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9c00 with x1830963625209856 ext(0->1048575) 00002000:00010000:2.0:1746143846.630087:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9c00 00000100:00100000:3.0:1746143846.630530:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625210112:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12075us (12528us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143846.630539:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7452 00002000:00100000:3.0:1746143846.630544:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800972e9880 x1830963625210112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.630551:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9880 with x1830963625210112 ext(1048576->2097151) 00002000:00010000:3.0:1746143846.630554:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e9880 00000100:00100000:2.0:1746143846.637162:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625210368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16649us (19131us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143846.637174:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7453 00002000:00100000:2.0:1746143846.637184:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800972e8000 x1830963625210368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.637193:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8000 with x1830963625210368 ext(1048576->2097151) 00002000:00010000:2.0:1746143846.637198:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e8000 00000100:00100000:3.0:1746143846.645607:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625210624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23580us (23696us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143846.645618:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7454 00002000:00100000:3.0:1746143846.645629:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880087df6a00 x1830963625210624/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.645722:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df6a00 with x1830963625210624 ext(2097152->4194303) 00002000:00010000:3.0:1746143846.645727:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df6a00 00000100:00100000:0.0:1746143846.653635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.653708:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625210752 00000100:00100000:2.0:1746143846.653717:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625210752 00000100:00100000:0.0:1746143846.653732:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.653758:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17054 00000100:00100000:2.0:1746143846.653764:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+41:3011:x1830963625210752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.653779:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.653793:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126f3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.653813:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.653814:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.653820:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 42 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.653829:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625211008 00000100:00100000:3.0:1746143846.653833:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625211008 00010000:00010000:2.0:1746143846.653833:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 42 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.653842:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5ad600, rc 0) 00002000:00100000:3.0:1746143846.653857:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880087df7100 x1830963625211008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.653866:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7100 with x1830963625211008 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.653870:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df7100 00000100:00100000:3.0:1746143846.653884:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7455 00000100:00100000:2.0:1746143846.653888:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:3011:x1830963625210752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 124us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.653889:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625211008:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143846.653893:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17054 00000100:00100000:3.0:1746143846.657261:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625211008:12345-192.168.202.3@tcp:3:cat.0 Request processed in 3364us (3522us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143846.657272:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7455 00002000:00100000:3.0:1746143846.657393:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880087df7100 x1830963625211008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.657402:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7100 with x1830963625211008 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.657407:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df7100 00000100:00100000:0.0:1746143846.661243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.661346:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625211264 00000100:00100000:3.0:1746143846.661354:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625211264 00002000:00100000:3.0:1746143846.661390:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880087df5180 x1830963625211264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.661398:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5180 with x1830963625211264 ext(2097152->4194303) 00002000:00010000:3.0:1746143846.661402:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df5180 00000100:00100000:3.0:1746143846.661803:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7456 00000100:00100000:3.0:1746143846.661810:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625211264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.669828:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625211264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8009us (8583us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143846.669840:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7456 00002000:00100000:3.0:1746143846.669849:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880087df5180 x1830963625211264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.669858:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5180 with x1830963625211264 ext(2097152->4194303) 00002000:00010000:3.0:1746143846.669863:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df5180 00000100:00100000:0.0:1746143846.681364:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.681469:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625211520 00000100:00100000:3.0:1746143846.681477:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625211520 00002000:00100000:3.0:1746143846.681522:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880087df4e00 x1830963625211520/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.681530:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4e00 with x1830963625211520 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.681534:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df4e00 00000100:00100000:3.0:1746143846.681655:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7457 00000100:00100000:3.0:1746143846.681663:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625211520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.686877:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625211520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5202us (5507us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143846.686891:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7457 00002000:00100000:3.0:1746143846.686904:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880087df4e00 x1830963625211520/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.686930:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4e00 with x1830963625211520 ext(4194304->4853759) 00002000:00010000:3.0:1746143846.686936:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df4e00 00000100:00100000:0.0:1746143846.707129:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.707254:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625211776 00000100:00100000:3.0:1746143846.707265:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625211776 00000100:00100000:3.0:1746143846.707335:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14102 00000100:00100000:3.0:1746143846.707342:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:3015:x1830963625211776:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.707369:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.707389:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b66cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484126fa expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.707493:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.707507:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.707515:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.707521:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 285 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.707528:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.707561:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 285 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.707571:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 285 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.707582:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627554816:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.707784:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.707797:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 23 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.707805:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627554944:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.707830:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.708006:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 10 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.708017:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627555072:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.708092:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.710998:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.711120:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627554816:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143846.711131:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627554944:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.711499:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625211904 00000100:00100000:1.0:1746143846.711500:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.711507:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625211904 00010000:00010000:2.0:1746143846.711546:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 286 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746143846.711639:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212032 00000100:00100000:0.0:1746143846.711642:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212032 00010000:00010000:0.0:1746143846.711657:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 24 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:0.0:1746143846.711686:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8356 00000100:00100000:0.0:1746143846.711695:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625212032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143846.711709:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143846.711716:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 24 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143846.711725:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 24 pid: 7244 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143846.711745:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0200/0x87925e4cb73b6608 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412675 expref: 24 pid: 7244 timeout: 1005 lvb_type: 0 00000100:00100000:1.0:1746143846.711749:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.711799:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212160 00000100:00100000:2.0:1746143846.711802:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212160 00010000:00010000:2.0:1746143846.711819:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 11 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.711843:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8357 00000100:00100000:2.0:1746143846.711848:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+286:2009:x1830963625211904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.711855:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.711859:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 286 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.711867:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 286 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.711877:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d600/0x87925e4cb73b6663 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126a6 expref: 286 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:2.0:1746143846.711890:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.711894:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.711903:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143846.711909:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.711926:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8358 00000100:00100000:1.0:1746143846.711934:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625212160:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.711941:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.711946:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 11 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:1.0:1746143846.711956:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 11 pid: 7245 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.711965:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+285:2009:x1830963625211904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (978us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143846.711968:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143846.711971:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143846.711978:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8357 00010000:00010000:1.0:1746143846.711978:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143846.711985:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143846.712002:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.712018:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625212160:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.712024:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8358 00010000:00010000:3.0:1746143846.712097:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b65c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412652 expref: 10 pid: 7245 timeout: 1005 lvb_type: 0 00010000:00010000:0.0:1746143846.712136:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143846.712139:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143846.712159:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625212032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 465us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143846.712164:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8356 00000100:00100000:3.0:1746143846.712494:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627555072:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143846.712520:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.712528:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.712533:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143846.712556:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143846.712684:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ce00/0x87925e4cb73b66cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 286 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.712697:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 285 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.712703:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.712705:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143846.712707:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ca00, rc 0) 00000100:00100000:3.0:1746143846.712743:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:3015:x1830963625211776:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5402us (5627us total) trans 8589945197 rc 0/0 00000100:00100000:3.0:1746143846.712749:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14102 00000100:00100000:0.0:1746143846.724816:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.726419:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212416 00000100:00100000:3.0:1746143846.726432:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212416 00000100:00100000:3.0:1746143846.726508:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14103 00000100:00100000:3.0:1746143846.726517:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3017:x1830963625212416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143846.726545:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.726565:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b66e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412701 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.726671:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.726686:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143846.726697:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143846.726707:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143846.726802:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b66e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 26 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.726837:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 25 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.726845:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.726848:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143846.726851:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:3.0:1746143846.726953:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3017:x1830963625212416:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 437us (2148us total) trans 8589945198 rc 0/0 00000100:00100000:3.0:1746143846.726961:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14103 00000100:00100000:0.0:1746143846.769859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.770142:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212544 00000100:00100000:2.0:1746143846.770152:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212544 00000100:00100000:2.0:1746143846.770212:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17055 00000100:00100000:2.0:1746143846.770221:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3017:x1830963625212544:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143846.770241:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.770261:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412708 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.770309:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.770322:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.770330:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.770336:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.770339:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.770342:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [3751936->4190207] (req 3751936->4190207) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.770376:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 34 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.770387:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 34 pid: 13436 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143846.770400:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.770734:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.770744:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 12 pid: 13430 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143846.770752:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555328:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.770782:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.770790:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 1005 lvb_type: 0 00000100:00100000:2.0:1746143846.770798:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.770814:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.775297:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.775345:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.775372:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212800 00000100:00100000:0.0:1746143846.775380:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212800 00010000:00010000:0.0:1746143846.775417:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 35 pid: 13436 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746143846.775443:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212672 00000100:00100000:0.0:1746143846.775446:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212672 00010000:00010000:0.0:1746143846.775455:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00000100:00100000:0.0:1746143846.775487:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8359 00000100:00100000:0.0:1746143846.775495:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625212800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143846.775509:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143846.775529:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 35 pid: 13436 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.775541:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 35 pid: 13436 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.775565:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143846.775656:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625212800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 160us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143846.775663:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8359 00000100:00100000:0.0:1746143846.775677:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8360 00000100:00100000:0.0:1746143846.775682:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625212672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143846.775688:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143846.775695:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.775703:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 13 pid: 13430 timeout: 1005 lvb_type: 1 00010000:00010000:0.0:1746143846.775714:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143846.775728:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2010:x1830963625212672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143846.775733:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8360 00010000:00010000:2.0:1746143846.775979:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096010c00/0x87925e4cb73b6552 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412605 expref: 34 pid: 13436 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143846.775998:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.776010:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b659f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841263d expref: 12 pid: 13430 timeout: 1005 lvb_type: 1 00000100:00100000:2.0:1746143846.776024:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555328:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.776032:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.776065:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3751936->4190207] (req 3751936->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.776076:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2c00, rc 0) 00000100:00100000:2.0:1746143846.776102:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3017:x1830963625212544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5883us (6255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.776109:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17055 00000100:00100000:0.0:1746143846.783317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.783415:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625212928 00000100:00100000:3.0:1746143846.783425:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625212928 00010000:00010000:3.0:1746143846.783461:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 1005 lvb_type: 0 00000100:00100000:3.0:1746143846.783500:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8361 00000100:00100000:3.0:1746143846.783507:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625212928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.783522:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.783543:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.783556:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.783584:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091380200/0x87925e4cb73b6513 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125e2 expref: 23 pid: 13430 timeout: 1005 lvb_type: 0 00010000:00010000:3.0:1746143846.783603:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.783605:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.783612:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.783620:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.783648:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.783658:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627555584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.783743:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.785133:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.785254:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625213056 00000100:00100000:2.0:1746143846.785261:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625213056 00000100:00100000:2.0:1746143846.785315:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17056 00000100:00100000:2.0:1746143846.785322:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:3015:x1830963625213056:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143846.785339:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.785354:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841270f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.785377:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.785384:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143846.785385:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143846.785388:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2195456->2822143] (req 2195456->2822143) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.785415:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.785425:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.785434:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555712:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.785964:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.787713:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.787750:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625213312 00000100:00100000:0.0:1746143846.787757:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625213312 00002000:00100000:0.0:1746143846.787799:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3751936->3756031) req@ffff880087df4000 x1830963625213312/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143846.787808:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627555584:192.168.202.3@tcp:105: 00002000:00100000:0.0:1746143846.787808:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4000 with x1830963625213312 ext(3751936->3756031) 00010000:00010000:0.0:1746143846.787816:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 23 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.787826:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143846.787827:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 23 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746143846.787833:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df4000 00000100:00100000:3.0:1746143846.787873:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625212928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4366us (4566us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.787882:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8361 00000100:00100000:2.0:1746143846.787885:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627555712:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.787902:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2195456->2822143] (req 2195456->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.787931:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3be00, rc 0) 00000100:00100000:2.0:1746143846.787951:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:3015:x1830963625213056:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2629us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.787957:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17056 00000100:00100000:0.0:1746143846.788176:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2731 00000100:00100000:0.0:1746143846.788183:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625213312:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143846.788310:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625213312:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 127us (603us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143846.788316:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2731 00002000:00100000:0.0:1746143846.788321:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3751936->3756031) req@ffff880087df4000 x1830963625213312/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.788328:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4000 with x1830963625213312 ext(3751936->3756031) 00010000:00010000:0.0:1746143846.788332:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143846.788340:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:0.0:1746143846.788347:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df4000 00000100:00100000:0.0:1746143846.792335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.792423:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625213568 00000100:00100000:2.0:1746143846.792433:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625213568 00002000:00100000:2.0:1746143846.792485:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (4186112->4190207) req@ffff880087df4a80 x1830963625213568/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.792495:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4a80 with x1830963625213568 ext(4186112->4190207) 00010000:00010000:2.0:1746143846.792505:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.792522:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.792528:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df4a80 00000100:00100000:2.0:1746143846.792555:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2732 00000100:00100000:2.0:1746143846.792562:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625213568:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143846.792714:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625213568:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 151us (388us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143846.792720:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2732 00002000:00100000:2.0:1746143846.792725:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (4186112->4190207) req@ffff880087df4a80 x1830963625213568/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.792731:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4a80 with x1830963625213568 ext(4186112->4190207) 00010000:00010000:2.0:1746143846.792735:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.792743:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.792748:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df4a80 00000100:00100000:0.0:1746143846.796789:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.796859:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625213824 00000100:00100000:2.0:1746143846.796870:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625213824 00002000:00100000:2.0:1746143846.796955:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (3751936->4190207) req@ffff880095c3a300 x1830963625213824/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.796964:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a300 with x1830963625213824 ext(3751936->4190207) 00010000:00010000:2.0:1746143846.796974:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.796987:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 22 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.796993:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3a300 00000100:00100000:2.0:1746143846.797018:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2733 00000100:00100000:2.0:1746143846.797025:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625213824:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143846.803058:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625213824:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 6017us (6266us total) trans 21474841319 rc 0/0 00000100:00100000:2.0:1746143846.803073:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2733 00002000:00100000:2.0:1746143846.803086:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (3751936->4190207) req@ffff880095c3a300 x1830963625213824/t21474841319(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143846.803188:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.803369:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625213952 00000100:00100000:3.0:1746143846.803377:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625213952 00000100:00100000:3.0:1746143846.803415:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17057 00000100:00100000:3.0:1746143846.803422:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3020:x1830963625213952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143846.803438:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143846.803456:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412716 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.803483:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143846.803489:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2195456->2822143] (req 2195456->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.803495:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143846.803499:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.803535:0:13436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2195456->2822143] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.803546:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.803556:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:3.0:1746143846.803577:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+26:3020:x1830963625213952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 156us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.803582:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17057 00002000:00100000:2.0:1746143846.803662:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a300 with x1830963625213824 ext(3751936->4190207) 00010000:00010000:2.0:1746143846.803668:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.803679:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.803685:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3a300 00000100:00100000:0.0:1746143846.805540:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.805882:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625214080 00000100:00100000:3.0:1746143846.805891:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625214080 00010000:00010000:3.0:1746143846.805954:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143846.805991:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8362 00000100:00100000:3.0:1746143846.805999:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625214080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.806012:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143846.806028:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143846 -> 1746143847 00002000:00010000:3.0:1746143846.806031:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143846 -> 1746143847 00010000:00010000:3.0:1746143846.806036:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.806047:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.806066:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b66f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3751936->4190207) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412708 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.806092:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.806094:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.806102:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.806110:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.806141:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.806152:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 34 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143846.806170:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627555968:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.806244:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.807849:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627555968:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.807866:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.807895:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625214080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1897us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.807904:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8362 00000100:00100000:0.0:1746143846.808732:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.809049:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625214336 00000100:00100000:2.0:1746143846.809057:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625214336 00002000:00100000:2.0:1746143846.809093:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2195456->2199551) req@ffff880095c38a80 x1830963625214336/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.809108:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38a80 with x1830963625214336 ext(2195456->2199551) 00010000:00010000:2.0:1746143846.809116:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.809177:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.809183:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c38a80 00000100:00100000:2.0:1746143846.809388:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2734 00000100:00100000:2.0:1746143846.809395:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625214336:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143846.809510:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625214336:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 115us (785us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143846.809517:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2734 00002000:00100000:2.0:1746143846.809522:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2195456->2199551) req@ffff880095c38a80 x1830963625214336/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.809528:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c38a80 with x1830963625214336 ext(2195456->2199551) 00010000:00010000:2.0:1746143846.809532:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.809540:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.809546:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c38a80 00000100:00100000:0.0:1746143846.814266:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.814369:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625214592 00000100:00100000:2.0:1746143846.814377:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625214592 00002000:00100000:2.0:1746143846.814414:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2818048->2822143) req@ffff880095c3b480 x1830963625214592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.814423:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b480 with x1830963625214592 ext(2818048->2822143) 00010000:00010000:2.0:1746143846.814430:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.814442:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.814448:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3b480 00000100:00100000:2.0:1746143846.814474:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2735 00000100:00100000:2.0:1746143846.814481:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625214592:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143846.814643:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625214592:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 162us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143846.814649:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2735 00002000:00100000:2.0:1746143846.814655:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2818048->2822143) req@ffff880095c3b480 x1830963625214592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.814662:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b480 with x1830963625214592 ext(2818048->2822143) 00010000:00010000:2.0:1746143846.814666:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.814674:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.814679:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3b480 00000100:00100000:0.0:1746143846.818320:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.818643:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625214848 00000100:00100000:2.0:1746143846.818651:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625214848 00002000:00100000:2.0:1746143846.818692:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2195456->2822143) req@ffff880095c3a680 x1830963625214848/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.818701:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a680 with x1830963625214848 ext(2195456->2822143) 00010000:00010000:2.0:1746143846.818709:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.818721:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 35 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.818727:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3a680 00000100:00100000:2.0:1746143846.818749:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2736 00000100:00100000:2.0:1746143846.818755:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625214848:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143846.824778:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.824855:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625214976 00000100:00100000:2.0:1746143846.824863:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625214976 00000100:00100000:2.0:1746143846.824926:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17058 00000100:00100000:2.0:1746143846.824933:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:3024:x1830963625214976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.824948:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.824964:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841271d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.824991:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143846.824996:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.825005:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 38 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.825014:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3b400, rc 0) 00000100:00100000:2.0:1746143846.825049:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+38:3024:x1830963625214976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 116us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.825054:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17058 00000100:00100000:2.0:1746143846.829160:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625214848:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10396us (10840us total) trans 21474841320 rc 0/0 00000100:00100000:2.0:1746143846.829173:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2736 00002000:00100000:2.0:1746143846.829184:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2195456->2822143) req@ffff880095c3a680 x1830963625214848/t21474841320(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/448 e 0 to 0 dl 1746143857 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143846.829192:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3a680 with x1830963625214848 ext(2195456->2822143) 00010000:00010000:2.0:1746143846.829200:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 38 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.829214:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 38 pid: 13436 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143846.829220:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c3a680 00000100:00100000:0.0:1746143846.832173:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.832269:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625215104 00000100:00100000:3.0:1746143846.832277:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625215104 00010000:00010000:3.0:1746143846.832314:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 38 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143846.832350:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8363 00000100:00100000:3.0:1746143846.832357:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625215104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.832369:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.832385:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 38 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.832395:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 38 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.832414:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3be00/0x87925e4cb73b66fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2195456->2822143) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841270f expref: 38 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.832990:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.832992:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.832999:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.833007:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.833015:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.833016:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143846.833018:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.833024:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143846.833050:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.833061:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627556096:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.833142:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143846.833149:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627556224:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.833166:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143846.835623:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627556096:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143846.835635:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627556224:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143846.835652:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.835728:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963625215104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3369us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.835738:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8363 00000100:00100000:0.0:1746143846.838788:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.839591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.839641:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625215360 00000100:00100000:0.0:1746143846.839647:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625215360 00002000:00100000:0.0:1746143846.839684:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c3b100 x1830963625215360/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.839693:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963625215360 ext(2097152->4194303) 00002000:00010000:0.0:1746143846.839697:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:0.0:1746143846.839722:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625215616 00000100:00100000:0.0:1746143846.839724:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625215616 00002000:00100000:0.0:1746143846.839735:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009322ce00 x1830963625215616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143846.839742:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ce00 with x1830963625215616 ext(2097152->4194303) 00002000:00010000:0.0:1746143846.839745:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ce00 00000100:00100000:0.0:1746143846.839757:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7458 00000100:00100000:0.0:1746143846.839763:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625215360:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.840848:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7459 00000100:00100000:3.0:1746143846.840857:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625215616:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143846.859163:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625215616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18298us (19564us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143846.859175:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7459 00002000:00100000:3.0:1746143846.859185:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009322ce00 x1830963625215616/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.859194:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322ce00 with x1830963625215616 ext(2097152->4194303) 00000100:00100000:1.0:1746143846.859194:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625215360:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19424us (20405us total) trans 0 rc 2097152/2097152 00002000:00010000:3.0:1746143846.859199:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322ce00 00000100:00100000:1.0:1746143846.859205:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7458 00002000:00100000:1.0:1746143846.859214:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c3b100 x1830963625215360/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:242/0 lens 488/440 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143846.859222:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3b100 with x1830963625215360 ext(2097152->4194303) 00002000:00010000:1.0:1746143846.859228:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c3b100 00000100:00100000:0.0:1746143846.881403:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.881677:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625215744 00000100:00100000:2.0:1746143846.881686:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625215744 00000100:00100000:2.0:1746143846.881742:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14104 00000100:00100000:2.0:1746143846.881750:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3028:x1830963625215744:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143846.881844:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.881860:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b200/0x87925e4cb73b6712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412724 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.881943:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.881954:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.881964:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.881975:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.881981:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.881985:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.882039:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.882049:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 284 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.882056:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.882062:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.882087:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.882101:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 24 pid: 7245 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.882111:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556352:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.882945:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 284 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.882955:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 284 pid: 7245 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.882964:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556480:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.883741:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.886315:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.886664:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556352:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.886680:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556480:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.886703:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143846.886963:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216000 00000100:00100000:1.0:1746143846.886976:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216000 00000100:00100000:1.0:1746143846.887035:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5495 00000100:00100000:1.0:1746143846.887042:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:16365:x1830963625216000:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746143846.887281:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:16365:x1830963625216000:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 239us (973us total) trans 8589945199 rc 0/0 00000100:00100000:1.0:1746143846.887295:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5495 00000100:00100000:1.0:1746143846.890081:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.890513:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216256 00000100:00100000:2.0:1746143846.890522:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216256 00000100:00100000:2.0:1746143846.890578:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5496 00000100:00100000:2.0:1746143846.890585:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:30501:x1830963625216256:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143846.891615:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:30501:x1830963625216256:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 1026us (1534us total) trans 8589945200 rc 0/0 00000100:00100000:2.0:1746143846.891624:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5496 00000100:00100000:2.0:1746143846.894809:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.895165:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216384 00000100:00100000:3.0:1746143846.895174:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216384 00010000:00010000:3.0:1746143846.895206:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 26 pid: 7245 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.895792:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.896341:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216512 00000100:00100000:3.0:1746143846.896346:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216512 00010000:00010000:3.0:1746143846.896367:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 286 pid: 7245 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143846.896803:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8364 00000100:00100000:3.0:1746143846.896812:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625216384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143846.896824:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143846.896830:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 26 pid: 7245 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.896841:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 26 pid: 7245 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.896859:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74000/0x87925e4cb73b66e8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412701 expref: 26 pid: 7245 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143846.896888:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143846.896892:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.896900:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.896904:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143846.896909:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143846.896960:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625216384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 148us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143846.896966:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8364 00000100:00100000:1.0:1746143846.897480:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8365 00000100:00100000:1.0:1746143846.897487:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+286:2009:x1830963625216512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.897495:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.897504:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 286 pid: 7245 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.897537:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 286 pid: 7245 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.897548:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ca00/0x87925e4cb73b66d3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126fa expref: 286 pid: 7245 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.897561:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143846.897565:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.897571:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.898417:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.898457:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.898495:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+285:2009:x1830963625216512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1008us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.898502:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8365 00010000:00010000:2.0:1746143846.898823:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898831:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.898874:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143846.898878:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143846.898893:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898902:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898929:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898934:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898939:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898943:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898947:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.898950:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898956:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898968:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143846.898971:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143846.898973:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898978:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2c00/0x87925e4cb73b6719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898987:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898991:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898995:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.898998:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a2200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.899000:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.899004:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.899008:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e030300) 00010000:00010000:2.0:1746143846.899010:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143846.899012:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.899016:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2200/0x87925e4cb73b6720 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.899041:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b200/0x87925e4cb73b6712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.899053:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.899059:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.899060:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143846.899062:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a2000, rc 0) 00000100:00100000:2.0:1746143846.899088:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3028:x1830963625215744:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 17340us (17695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.899093:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14104 00000100:00100000:0.0:1746143846.903199:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.903311:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.903336:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.903356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.903378:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.904299:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216640 00000100:00100000:1.0:1746143846.904309:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216640 00000100:00100000:1.0:1746143846.904345:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216768 00000100:00100000:1.0:1746143846.904347:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216768 00000100:00100000:1.0:1746143846.904360:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625217024 00000100:00100000:1.0:1746143846.904362:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625217024 00000100:00100000:1.0:1746143846.904371:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625216896 00000100:00100000:1.0:1746143846.904373:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625216896 00000100:00100000:1.0:1746143846.904381:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625217152 00000100:00100000:1.0:1746143846.904383:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625217152 00000100:00100000:1.0:1746143846.904396:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17059 00000100:00100000:1.0:1746143846.904402:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625216640:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143846.904417:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.904431:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841272b expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.904451:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904453:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904461:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904476:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904485:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76400, rc 0) 00000100:00100000:1.0:1746143846.904523:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625216640:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 121us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.904529:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17059 00000100:00100000:1.0:1746143846.904541:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17060 00000100:00100000:1.0:1746143846.904546:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625216768:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143846.904552:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.904578:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412732 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.904589:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904591:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904595:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904608:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904615:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76800, rc 0) 00000100:00100000:1.0:1746143846.904633:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625216768:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 87us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.904637:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17060 00000100:00100000:1.0:1746143846.904753:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17061 00000100:00100000:1.0:1746143846.904759:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625217024:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143846.904764:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.904770:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412740 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.904779:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904780:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904784:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904792:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904798:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:1.0:1746143846.904812:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625217024:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 53us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.904816:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17061 00000100:00100000:1.0:1746143846.904826:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17062 00000100:00100000:1.0:1746143846.904830:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625216896:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143846.904835:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.904840:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412739 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.904847:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904848:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904852:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904859:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904866:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:1.0:1746143846.904878:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625216896:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 48us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.904883:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17062 00000100:00100000:1.0:1746143846.904891:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17063 00000100:00100000:1.0:1746143846.904896:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625217152:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143846.904901:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143846.904907:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412747 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143846.904935:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904936:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143846.904941:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904949:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 14 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143846.904955:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76000, rc 0) 00000100:00100000:1.0:1746143846.904969:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625217152:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 73us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.904974:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17063 00000100:00100000:2.0:1746143846.908385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.908439:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625217408 00000100:00100000:0.0:1746143846.908447:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625217408 00000100:00100000:0.0:1746143846.910727:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14105 00000100:00100000:0.0:1746143846.910744:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3028:x1830963625217408:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143846.910762:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143846.910778:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b6751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841274e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143846.910859:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143846.910871:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143846.910879:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746143846.910904:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143846.910937:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 12 pid: 7244 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143846.910953:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556608:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143846.911027:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.912357:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556608:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.912378:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143846.913000:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143846.913077:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625217536 00000100:00100000:1.0:1746143846.913084:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625217536 00010000:00010000:1.0:1746143846.913107:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 13 pid: 7244 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143846.913247:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8366 00000100:00100000:1.0:1746143846.913254:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625217536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.913265:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.913270:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 13 pid: 7244 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.913279:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 13 pid: 7244 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.913307:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a2000/0x87925e4cb73b6727 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412724 expref: 13 pid: 7244 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.913838:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143846.913843:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.913853:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.913863:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.913890:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143846.913956:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625217536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 702us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.913962:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8366 00010000:00010000:2.0:1746143846.914134:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.914141:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.914156:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.914561:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d200/0x87925e4cb73b6751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841274e expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.914588:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841274e expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.914594:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.914597:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143846.914600:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7cc00, rc 0) 00000100:00100000:2.0:1746143846.914622:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3028:x1830963625217408:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3886us (6243us total) trans 8589945201 rc 0/0 00000100:00100000:2.0:1746143846.914632:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14105 00000100:00100000:0.0:1746143846.916170:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.916228:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625217792 00000100:00100000:2.0:1746143846.916235:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625217792 00000100:00100000:2.0:1746143846.916281:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14106 00000100:00100000:2.0:1746143846.916297:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3030:x1830963625217792:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143846.916314:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.916328:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae56000/0x87925e4cb73b6766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412755 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.916398:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.916410:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.916419:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.916427:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.916487:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ae56000/0x87925e4cb73b6766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.916499:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.916506:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.916509:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143846.916511:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d7fa00, rc 0) 00000100:00100000:2.0:1746143846.916559:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3030:x1830963625217792:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 261us (392us total) trans 8589945202 rc 0/0 00000100:00100000:2.0:1746143846.916565:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14106 00000100:00100000:1.0:1746143846.917101:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.917606:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625218048 00000100:00100000:2.0:1746143846.917611:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625218048 00000100:00100000:2.0:1746143846.917671:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14107 00000100:00100000:2.0:1746143846.917677:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3028:x1830963625218048:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143846.917688:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.917690:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143846.917702:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7cc00/0x87925e4cb73b6758 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841274e expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.917711:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.917714:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143846.917720:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73b677b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841275c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.917770:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.917779:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.917784:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.917814:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.917825:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 26 pid: 7244 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.917834:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556736:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.917899:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.920720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.920741:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627556736:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.920759:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143846.920953:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625218176 00000100:00100000:1.0:1746143846.920959:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625218176 00010000:00010000:1.0:1746143846.920986:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 27 pid: 7244 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143846.921068:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8367 00000100:00100000:1.0:1746143846.921076:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2010:x1830963625218176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143846.921087:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143846.921093:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 27 pid: 7244 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.921103:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 27 pid: 7244 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.921121:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b676d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412755 expref: 27 pid: 7244 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143846.921145:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143846.921149:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.921158:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.921163:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143846.921189:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143846.921210:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921216:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143846.921223:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625218176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 148us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143846.921228:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8367 00010000:00010000:2.0:1746143846.921230:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921235:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921240:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921244:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011de82600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143846.921248:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921254:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921265:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.921267:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143846.921270:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921274:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de82600/0x87925e4cb73b6782 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.921316:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73b677b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841275c expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.921323:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011de83000/0x87925e4cb73b677b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841275c expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.921329:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de83000, rc 0) 00000100:00100000:2.0:1746143846.921351:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3028:x1830963625218048:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 3675us (4251us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143846.921357:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14107 00000100:00100000:0.0:1746143846.925305:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.925427:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625218432 00000100:00100000:2.0:1746143846.925438:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625218432 00000100:00100000:2.0:1746143846.925488:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5497 00000100:00100000:2.0:1746143846.925495:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3028:x1830963625218432:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143846.925674:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3028:x1830963625218432:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 179us (392us total) trans 8589945203 rc 0/0 00000100:00100000:2.0:1746143846.925680:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5497 00000100:00100000:0.0:1746143846.944032:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.944474:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625218688 00000100:00100000:2.0:1746143846.944575:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625218688 00000100:00100000:2.0:1746143846.945441:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14108 00000100:00100000:2.0:1746143846.945451:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:3033:x1830963625218688:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143846.946144:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.946161:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b6789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412763 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.946247:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.946259:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143846.946268:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143846.946277:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143846.946360:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368dac00/0x87925e4cb73b6789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 288 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.946386:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 287 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.946393:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143846.946395:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143846.946397:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3be00, rc 0) 00000100:00100000:2.0:1746143846.946457:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+287:3033:x1830963625218688:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1009us (2436us total) trans 8589945204 rc 0/0 00000100:00100000:2.0:1746143846.946463:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14108 00000100:00100000:0.0:1746143846.972742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.972942:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625218816 00000100:00100000:2.0:1746143846.972950:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625218816 00000100:00100000:2.0:1746143846.973003:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17064 00000100:00100000:2.0:1746143846.973010:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:3033:x1830963625218816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143846.973025:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.973038:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841276a expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.973062:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.973069:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.973075:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.973079:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.973081:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143846.973084:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1142784->1552383] (req 1142784->1552383) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 43 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.973108:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.973118:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 43 pid: 9585 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143846.973127:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627556864:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.973214:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143846.973221:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143846.973228:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627556992:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.973251:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 21 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.973258:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 21 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.973264:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557120:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.973277:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143846.978660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.978799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.978845:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143846.978892:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625219072 00000100:00100000:0.0:1746143846.978901:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625219072 00010000:00010000:0.0:1746143846.978963:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143846.978990:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625218944 00000100:00100000:0.0:1746143846.978993:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625218944 00010000:00010000:0.0:1746143846.979004:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 44 pid: 9585 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143846.979016:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625219200 00000100:00100000:0.0:1746143846.979018:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625219200 00010000:00010000:0.0:1746143846.979027:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 22 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143846.979041:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8368 00000100:00100000:0.0:1746143846.979049:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625219072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143846.979065:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143846.979206:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8369 00000100:00100000:2.0:1746143846.979215:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625218944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.979223:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.979237:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 44 pid: 9585 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746143846.979248:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 44 pid: 9585 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746143846.979275:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.979331:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625218944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.979338:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8369 00000100:00100000:2.0:1746143846.979354:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8370 00000100:00100000:2.0:1746143846.979359:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625219200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143846.979364:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143846.979370:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 22 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.979377:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 22 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143846.979387:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.979399:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625219200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 41us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.979404:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8370 00010000:00010000:2.0:1746143846.979444:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b66be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126e5 expref: 43 pid: 9585 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143846.979462:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627556864:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143846.979472:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627556992:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.979486:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189d000/0x87925e4cb73b6686 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c2 expref: 21 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143846.979494:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557120:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143846.979525:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1142784->1552383] (req 1142784->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 42 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143846.979535:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82400, rc 0) 00000100:00100000:2.0:1746143846.979553:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:3033:x1830963625218816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6544us (6819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.979560:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17064 00010000:00010000:0.0:1746143846.979580:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143846.979607:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143846.979630:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77800/0x87925e4cb73b6743 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412739 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143846.979659:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143846.979661:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143846.979668:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143846.979675:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143846.979713:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143846.979725:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627557248:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143846.979791:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143846.982600:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627557248:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143846.982621:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143846.982675:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625219072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3625us (4025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143846.982685:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8368 00000100:00100000:0.0:1746143846.982783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.983122:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625219456 00000100:00100000:3.0:1746143846.983130:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625219456 00002000:00100000:3.0:1746143846.984120:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1142784->1146879) req@ffff880092b48700 x1830963625219456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.984140:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963625219456 ext(1142784->1146879) 00002000:00010000:3.0:1746143846.984146:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48700 00000100:00100000:3.0:1746143846.984186:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7460 00000100:00100000:3.0:1746143846.984201:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625219456:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143846.984372:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625219456:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 175us (1588us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143846.984378:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7460 00002000:00100000:3.0:1746143846.984384:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1142784->1146879) req@ffff880092b48700 x1830963625219456/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.984390:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48700 with x1830963625219456 ext(1142784->1146879) 00002000:00010000:3.0:1746143846.984392:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48700 00010000:00010000:3.0:1746143846.987256:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143846.990799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143846.990953:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625219712 00000100:00100000:3.0:1746143846.990964:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625219712 00002000:00100000:3.0:1746143846.991012:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1548288->1552383) req@ffff880092b4bb80 x1830963625219712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/0 e 0 to 0 dl 1746143857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.991022:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4bb80 with x1830963625219712 ext(1548288->1552383) 00002000:00010000:3.0:1746143846.991027:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4bb80 00000100:00100000:3.0:1746143846.992019:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7461 00000100:00100000:3.0:1746143846.992029:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625219712:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143846.992751:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625219712:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 721us (1960us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143846.992758:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7461 00002000:00100000:3.0:1746143846.992767:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1548288->1552383) req@ffff880092b4bb80 x1830963625219712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:242/0 lens 488/4536 e 0 to 0 dl 1746143857 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143846.992775:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4bb80 with x1830963625219712 ext(1548288->1552383) 00002000:00010000:3.0:1746143846.992779:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4bb80 00000100:00100000:0.0:1746143846.997868:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143846.998035:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625219840 00000100:00100000:2.0:1746143846.998045:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625219840 00000100:00100000:2.0:1746143846.998104:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17065 00000100:00100000:2.0:1746143846.998111:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625219840:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143846.998130:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143846.998148:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b67a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412771 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143846.998210:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557376:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143846.998305:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00002000:00010000:2.0:1746143847.000196:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143846 -> 1746143847 00002000:00010000:2.0:1746143847.000203:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143846 -> 1746143847 00002000:00010000:2.0:1746143847.000205:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143846 -> 1746143847 00000100:00100000:2.0:1746143847.000227:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557376:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.000258:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b67a5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412771 expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.000273:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b67a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412771 expref: 22 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.000804:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d800, rc 0) 00000100:00100000:2.0:1746143847.000861:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2010:x1830963625219840:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2749us (3005us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.000870:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17065 00000100:00100000:0.0:1746143847.003505:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.003599:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220096 00000100:00100000:3.0:1746143847.003608:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220096 00002000:00100000:3.0:1746143847.003711:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b4b800 x1830963625220096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 504/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.003722:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b800 with x1830963625220096 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.003728:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4b800 00000100:00100000:3.0:1746143847.003762:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7462 00000100:00100000:3.0:1746143847.003771:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625220096:12345-192.168.202.3@tcp:3:cat.0 00000100:00080000:2.0:1746143847.004021:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143847.009492:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625220096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5715us (5988us total) trans 0 rc 638976/638976 00000100:00100000:3.0:1746143847.009499:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7462 00002000:00100000:3.0:1746143847.009509:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b4b800 x1830963625220096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 504/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 638976/638976 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.009516:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b800 with x1830963625220096 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.009521:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4b800 00000100:00100000:0.0:1746143847.010142:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.010426:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220224 00000100:00100000:2.0:1746143847.010437:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220224 00000100:00100000:2.0:1746143847.010499:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17066 00000100:00100000:2.0:1746143847.010506:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3038:x1830963625220224:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.010525:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.010544:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412778 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.010575:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.010584:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.010586:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.010589:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.010621:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 41 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.010632:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 41 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.010644:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557504:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.010729:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.012676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.012738:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220352 00000100:00100000:3.0:1746143847.012745:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220352 00002000:00100000:3.0:1746143847.012790:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1142784->1552383) req@ffff880092b4ad80 x1830963625220352/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.012799:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4ad80 with x1830963625220352 ext(1142784->1552383) 00000100:00100000:2.0:1746143847.012804:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557504:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.012807:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 42 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.012818:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 42 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.013091:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b4ad80 00000100:00100000:3.0:1746143847.013124:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2737 00000100:00100000:3.0:1746143847.013132:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625220352:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:2.0:1746143847.013489:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.013503:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7de00, rc 0) 00000100:00100000:2.0:1746143847.013532:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3038:x1830963625220224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3027us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.013539:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17066 00000100:00100000:3.0:1746143847.019520:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625220352:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6379us (6843us total) trans 17179874055 rc 0/0 00000100:00100000:3.0:1746143847.019532:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2737 00002000:00100000:3.0:1746143847.019543:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1142784->1552383) req@ffff880092b4ad80 x1830963625220352/t17179874055(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.019552:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4ad80 with x1830963625220352 ext(1142784->1552383) 00010000:00010000:3.0:1746143847.019561:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 44 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.019573:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 44 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.019579:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b4ad80 00000100:00100000:0.0:1746143847.020761:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.020848:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220480 00000100:00100000:2.0:1746143847.020860:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220480 00000100:00100000:2.0:1746143847.020957:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17067 00000100:00100000:2.0:1746143847.020966:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625220480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.020984:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.021001:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b67b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841277f expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143847.021059:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557632:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143847.022019:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.024373:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.024492:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627557632:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.024528:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b67b3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841277f expref: 45 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.024543:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b67b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841277f expref: 45 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.024560:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d400, rc 0) 00000100:00100000:2.0:1746143847.024607:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625220480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3643us (3849us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.024617:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17067 00000100:00100000:3.0:1746143847.024875:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220608 00000100:00100000:3.0:1746143847.024884:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220608 00010000:00010000:3.0:1746143847.024935:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 44 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.024968:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8371 00000100:00100000:3.0:1746143847.024975:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625220608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.024987:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.024996:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 44 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.025006:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 44 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.025024:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011de82400/0x87925e4cb73b679e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1142784->1552383) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841276a expref: 44 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.025039:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.025041:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.025049:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.025057:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.025087:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.025098:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627557760:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.025167:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.027669:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.027690:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627557760:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.027709:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.027743:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220736 00000100:00100000:2.0:1746143847.027750:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220736 00000100:00100000:3.0:1746143847.027759:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625220608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2784us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.027768:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8371 00000100:00100000:2.0:1746143847.027789:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17068 00000100:00100000:2.0:1746143847.028033:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625220736:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.028051:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.028066:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412786 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.028086:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.028088:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.028096:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 44 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.028110:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 44 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.028120:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c400, rc 0) 00000100:00100000:2.0:1746143847.028153:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625220736:12345-192.168.202.3@tcp:101:cat.0 Request processed in 125us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.028354:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17068 00000100:00100000:0.0:1746143847.031102:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.031172:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625220992 00000100:00100000:3.0:1746143847.031181:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625220992 00002000:00100000:3.0:1746143847.031227:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b49180 x1830963625220992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.031236:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963625220992 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.031240:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b49180 00000100:00100000:3.0:1746143847.031276:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7463 00000100:00100000:3.0:1746143847.031295:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625220992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143847.039830:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625220992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8534us (8724us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143847.039845:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7463 00002000:00100000:3.0:1746143847.039858:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880092b49180 x1830963625220992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.039867:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49180 with x1830963625220992 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.039873:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b49180 00000100:00100000:0.0:1746143847.071279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.071591:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625221120 00000100:00100000:2.0:1746143847.071601:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625221120 00000100:00100000:2.0:1746143847.071663:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17069 00000100:00100000:2.0:1746143847.071672:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3030:x1830963625221120:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.071692:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.071711:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841278d expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.071747:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.071757:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.071765:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.071772:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.071774:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.071777:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2916352->3145727] (req 2916352->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.071811:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.071829:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 36 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.071842:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627557888:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.071974:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.071983:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143847.071991:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627558016:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.072017:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.072025:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.072033:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627558144:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.072049:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.073580:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627558016:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.073591:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627558144:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143847.074420:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.075471:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627557888:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.075507:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2916352->3145727] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.075525:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c600, rc 0) 00000100:00100000:2.0:1746143847.075575:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3030:x1830963625221120:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3905us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.075585:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17069 00000100:00100000:3.0:1746143847.075680:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625221248 00000100:00100000:3.0:1746143847.075687:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625221248 00010000:00010000:3.0:1746143847.075712:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143847.075752:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8372 00000100:00100000:3.0:1746143847.075759:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625221248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.075772:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.075793:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.075802:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.075824:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76000/0x87925e4cb73b674a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412747 expref: 14 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.075839:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.075856:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625221248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.075862:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8372 00000100:00100000:0.0:1746143847.078827:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.078880:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.078953:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625221376 00000100:00100000:3.0:1746143847.078957:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625221504 00000100:00100000:3.0:1746143847.078963:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625221504 00000100:00100000:2.0:1746143847.078963:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625221376 00010000:00010000:3.0:1746143847.078996:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.078996:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.079031:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8373 00000100:00100000:2.0:1746143847.079039:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625221376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143847.079053:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143847.079077:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.079087:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00080000:0.0:1746143847.079092:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746143847.079172:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b6704 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412716 expref: 25 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.079229:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8374 00000100:00100000:3.0:1746143847.079237:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625221504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.079245:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.079257:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.079267:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.079279:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3b400/0x87925e4cb73b670b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841271d expref: 37 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.079322:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.079324:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.079332:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.079340:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.079373:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.079386:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627558272:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143847.079413:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.079506:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625221376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 467us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.079513:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8373 00000100:00100000:3.0:1746143847.080618:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.082106:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627558272:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.082123:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.082161:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625221504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2925us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.082169:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8374 00000100:00100000:0.0:1746143847.082479:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.082544:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625221760 00000100:00100000:3.0:1746143847.082550:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625221760 00002000:00100000:3.0:1746143847.082581:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2916352->2920447) req@ffff880092b49c00 x1830963625221760/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.082591:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49c00 with x1830963625221760 ext(2916352->2920447) 00002000:00010000:3.0:1746143847.082596:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49c00 00000100:00100000:3.0:1746143847.084228:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7464 00000100:00100000:3.0:1746143847.084241:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625221760:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.084402:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625221760:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 165us (1924us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143847.084412:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7464 00002000:00100000:3.0:1746143847.084419:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2916352->2920447) req@ffff880092b49c00 x1830963625221760/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.084430:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49c00 with x1830963625221760 ext(2916352->2920447) 00002000:00010000:3.0:1746143847.084435:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49c00 00000100:00100000:0.0:1746143847.087826:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.087937:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625221888 00000100:00100000:2.0:1746143847.087947:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625221888 00000100:00100000:2.0:1746143847.088007:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17070 00000100:00100000:2.0:1746143847.088016:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3030:x1830963625221888:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.088032:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.088050:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412794 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.088085:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.088094:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.088101:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.088106:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.088108:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.088110:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->3829759] (req 3145728->3829759) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.088140:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 43 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.088151:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 43 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.088165:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627558400:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.088267:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.088276:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 12 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143847.088293:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627558528:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.088317:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.088325:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.088333:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627558656:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.088347:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.092303:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.092419:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627558400:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.092431:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627558528:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.092438:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627558656:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.092470:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->3829759] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.092493:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7cc00, rc 0) 00000100:00100000:2.0:1746143847.092540:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3030:x1830963625221888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4526us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.092549:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17070 00000100:00100000:3.0:1746143847.092639:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625222016 00000100:00100000:3.0:1746143847.092646:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625222016 00010000:00010000:3.0:1746143847.092672:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143847.092711:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8375 00000100:00100000:3.0:1746143847.092718:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625222016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.092731:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.092750:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.092763:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.093125:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b673c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412740 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.093149:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.093168:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625222016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 451us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.093173:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8375 00000100:00100000:0.0:1746143847.093318:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.093362:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.093406:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625222144 00000100:00100000:1.0:1746143847.093410:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625222144 00010000:00010000:1.0:1746143847.093424:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.093440:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625222272 00000100:00100000:1.0:1746143847.093442:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625222272 00010000:00010000:1.0:1746143847.093455:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 44 pid: 13436 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.093469:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8376 00000100:00100000:1.0:1746143847.093474:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625222144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143847.093482:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143847.093497:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8377 00000100:00100000:2.0:1746143847.093505:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625222272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143847.093513:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143847.093522:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 44 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.093531:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 44 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.093543:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5ad600/0x87925e4cb73b66c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126f3 expref: 44 pid: 13436 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.093558:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.093575:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625222272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.093582:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8377 00010000:00010000:1.0:1746143847.093814:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.093824:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.093837:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189cc00/0x87925e4cb73b668d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d0 expref: 23 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.093849:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.093851:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.093857:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.093865:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.093894:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.093927:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009322c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627558784:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143847.094000:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.095304:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009322c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627558784:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143847.095321:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143847.095348:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625222144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1873us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.095356:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8376 00000100:00100000:0.0:1746143847.099152:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.099334:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625222528 00000100:00100000:3.0:1746143847.099343:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625222528 00002000:00100000:3.0:1746143847.099385:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3825664->3829759) req@ffff88009e491180 x1830963625222528/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.099394:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491180 with x1830963625222528 ext(3825664->3829759) 00002000:00010000:3.0:1746143847.099398:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491180 00000100:00100000:3.0:1746143847.099415:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7465 00000100:00100000:3.0:1746143847.099421:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625222528:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.099552:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625222528:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 131us (409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143847.099557:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7465 00002000:00100000:3.0:1746143847.099562:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3825664->3829759) req@ffff88009e491180 x1830963625222528/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.099568:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491180 with x1830963625222528 ext(3825664->3829759) 00002000:00010000:3.0:1746143847.099571:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491180 00000100:00100000:0.0:1746143847.103243:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.103460:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625222784 00000100:00100000:2.0:1746143847.103471:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625222784 00000100:00100000:2.0:1746143847.103543:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5498 00000100:00100000:2.0:1746143847.103553:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:3030:x1830963625222784:12345-192.168.202.3@tcp:35:multiop.0 00000100:00080000:0.0:1746143847.103877:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143847.104679:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3030:x1830963625222784:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 1125us (1444us total) trans 8589945205 rc 0/0 00000100:00100000:2.0:1746143847.104687:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5498 00000100:00100000:0.0:1746143847.135790:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.135887:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625222912 00000100:00100000:2.0:1746143847.136161:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625222912 00000100:00100000:2.0:1746143847.136222:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17071 00000100:00100000:2.0:1746143847.136230:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:3044:x1830963625222912:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.136250:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.136269:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841279b expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.136392:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.136402:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.136408:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 37 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.136415:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.136417:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.136420:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1171456->1630207] (req 1171456->1630207) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 37 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.136454:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 37 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.136471:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 37 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143847.136484:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627558912:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.137973:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 12 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.137984:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 12 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143847.137995:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.138420:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 23 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.138429:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 23 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.138437:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559168:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143847.140620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.140958:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.140999:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627558912:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.141010:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559040:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143847.141165:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625223040 00000100:00100000:0.0:1746143847.141172:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625223040 00000100:00100000:2.0:1746143847.141198:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143847.141208:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 38 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143847.141317:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625223168 00000100:00100000:0.0:1746143847.141320:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625223168 00010000:00010000:0.0:1746143847.141334:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143847.141350:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8378 00000100:00100000:0.0:1746143847.141796:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625223040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143847.141811:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143847.141955:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8379 00000100:00100000:2.0:1746143847.141965:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625223168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143847.141973:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143847.141982:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746143847.141992:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746143847.142020:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76800/0x87925e4cb73b6735 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412732 expref: 13 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.142031:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 38 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:2.0:1746143847.142042:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.142079:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625223168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.142086:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8379 00010000:00010000:0.0:1746143847.142146:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 38 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.142159:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b66b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126de expref: 38 pid: 9587 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.142172:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143847.142192:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625223040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 400us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143847.142198:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8378 00000100:00100000:3.0:1746143847.142385:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.142415:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1171456->1630207] (req 1171456->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 36 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.142426:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d000, rc 0) 00000100:00100000:3.0:1746143847.142452:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:3044:x1830963625222912:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6223us (6674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.142459:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17071 00000100:00100000:0.0:1746143847.145110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.145817:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625223296 00000100:00100000:2.0:1746143847.145828:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625223296 00010000:00010000:2.0:1746143847.145867:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 24 pid: 3135 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.145898:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8380 00000100:00100000:2.0:1746143847.145906:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625223296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143847.145940:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143847.145960:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 24 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.145978:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 24 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.146000:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512400/0x87925e4cb73b6671 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126ad expref: 24 pid: 3135 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.146016:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.146018:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.146025:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.146034:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.146069:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143847.146082:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627559296:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143847.146166:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.150873:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627559296:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143847.150873:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143847.150895:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.150970:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625223296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5064us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.150981:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8380 00000100:00100000:1.0:1746143847.151006:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625223552 00000100:00100000:1.0:1746143847.151015:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625223552 00002000:00100000:1.0:1746143847.151057:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1171456->1175551) req@ffff88009e490a80 x1830963625223552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.151073:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963625223552 ext(1171456->1175551) 00002000:00010000:1.0:1746143847.151077:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490a80 00000100:00100000:1.0:1746143847.151109:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7466 00000100:00100000:1.0:1746143847.151116:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625223552:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143847.151254:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625223552:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 137us (386us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143847.151259:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7466 00002000:00100000:1.0:1746143847.151265:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1171456->1175551) req@ffff88009e490a80 x1830963625223552/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.151271:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490a80 with x1830963625223552 ext(1171456->1175551) 00002000:00010000:1.0:1746143847.151274:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490a80 00000100:00100000:0.0:1746143847.155534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.155631:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625223808 00000100:00100000:3.0:1746143847.155642:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625223808 00002000:00100000:3.0:1746143847.155689:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1626112->1630207) req@ffff88009e491500 x1830963625223808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.155699:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491500 with x1830963625223808 ext(1626112->1630207) 00002000:00010000:3.0:1746143847.155704:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491500 00000100:00100000:3.0:1746143847.155847:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7467 00000100:00100000:3.0:1746143847.155856:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625223808:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.156275:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625223808:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 418us (752us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143847.156294:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7467 00002000:00100000:3.0:1746143847.156301:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1626112->1630207) req@ffff88009e491500 x1830963625223808/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.156308:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491500 with x1830963625223808 ext(1626112->1630207) 00002000:00010000:3.0:1746143847.156311:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e491500 00000100:00100000:0.0:1746143847.233306:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.233686:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224064 00000100:00100000:2.0:1746143847.233694:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224064 00000100:00100000:2.0:1746143847.233748:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14109 00000100:00100000:2.0:1746143847.233756:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3048:x1830963625224064:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.233778:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.233794:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73b67d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127a2 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.234990:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143847.235006:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143847.235015:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143847.235025:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143847.235105:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d400/0x87925e4cb73b67d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 30 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.235136:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.235143:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143847.235146:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143847.235148:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ce00, rc 0) 00000100:00100000:2.0:1746143847.235196:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3048:x1830963625224064:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1441us (1898us total) trans 8589945206 rc 0/0 00000100:00100000:2.0:1746143847.235203:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14109 00000100:00100000:0.0:1746143847.239889:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627559424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746143847.239950:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143847.240090:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627559424 00000100:00100000:2.0:1746143847.240098:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627559424 00000100:00100000:2.0:1746143847.240138:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1746143847.240144:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963627559424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746143847.240163:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1160650816 pending 5644288 free 3906142208 avail 3674619904 00000100:00100000:2.0:1746143847.240196:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963627559424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.240203:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1746143847.240268:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627559424:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1746143847.241129:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143847.256019:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.256696:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224192 00000100:00100000:3.0:1746143847.256704:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224192 00000100:00100000:3.0:1746143847.256752:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17072 00000100:00100000:3.0:1746143847.256759:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3048:x1830963625224192:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143847.256774:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.256788:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127a9 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.256813:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.256821:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.256827:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.256833:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.256834:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.256837:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [2060288->2097151] (req 2060288->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.256862:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.256872:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143847.256888:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559552:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.257588:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.257597:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 11 pid: 13436 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143847.257605:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559680:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.257789:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.257797:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 35 pid: 9585 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.257805:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143847.257824:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.258936:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.259025:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.259087:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224320 00000100:00100000:2.0:1746143847.259094:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224320 00000100:00100000:2.0:1746143847.259124:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224448 00000100:00100000:2.0:1746143847.259127:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224448 00000100:00100000:2.0:1746143847.259142:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17073 00000100:00100000:2.0:1746143847.259148:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625224320:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143847.259222:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17074 00000100:00100000:3.0:1746143847.259228:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625224448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.259244:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.259256:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b67f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127b7 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.259307:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.259317:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b67f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127b0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143847.259347:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627559936:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143847.259423:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627560064:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143847.259613:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.259666:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.262555:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559552:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143847.262567:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559680:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143847.262574:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627559808:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.262603:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [2060288->2097151] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.262618:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ca00, rc 0) 00000100:00100000:3.0:1746143847.262654:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3048:x1830963625224192:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5894us (6643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.262661:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17072 00002000:00010000:2.0:1746143847.262856:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143846 -> 1746143847 00000100:00100000:2.0:1746143847.262872:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627559936:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.262893:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b67f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127b0 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.262903:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b67f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127b0 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.262954:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d400, rc 0) 00000100:00100000:2.0:1746143847.262972:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625224320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3824us (4064us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.262978:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17073 00000100:00100000:0.0:1746143847.263372:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.263412:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.263464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.263481:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224704 00000100:00100000:0.0:1746143847.263486:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224704 00010000:00010000:0.0:1746143847.263509:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 38 pid: 9585 timeout: 1006 lvb_type: 0 00000100:00100000:0.0:1746143847.263526:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224576 00000100:00100000:0.0:1746143847.263528:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224576 00010000:00010000:0.0:1746143847.263536:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 12 pid: 13436 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143847.263545:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625224832 00000100:00100000:0.0:1746143847.263546:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625224832 00010000:00010000:0.0:1746143847.263553:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 1006 lvb_type: 1 00000100:00100000:0.0:1746143847.263563:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8381 00000100:00100000:0.0:1746143847.263568:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625224704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143847.263577:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143847.263588:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 38 pid: 9585 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143847.263595:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 38 pid: 9585 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143847.263615:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6479 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125aa expref: 38 pid: 9585 timeout: 1006 lvb_type: 0 00010000:00010000:0.0:1746143847.263627:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143847.263646:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625224704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143847.263651:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8381 00000100:00100000:0.0:1746143847.263661:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8382 00000100:00100000:0.0:1746143847.263665:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625224576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143847.263671:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143847.263678:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 12 pid: 13436 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.263684:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 12 pid: 13436 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.263693:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090fc2800/0x87925e4cb73b658a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412628 expref: 12 pid: 13436 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.263699:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143847.263711:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625224576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143847.263716:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8382 00000100:00100000:0.0:1746143847.263723:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8383 00000100:00100000:0.0:1746143847.263728:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625224832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143847.263733:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143847.263739:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.263746:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.263756:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091381c00/0x87925e4cb73b64e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484125cd expref: 24 pid: 13430 timeout: 1006 lvb_type: 1 00010000:00010000:0.0:1746143847.263764:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143847.263766:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143847.263770:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.263777:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.263804:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143847.263813:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627560192:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143847.263848:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a840 going to sleep for 11 seconds 00002000:00010000:0.0:1746143847.263964:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143846 -> 1746143847 00000100:00100000:0.0:1746143847.263972:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627560064:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143847.263985:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b67f2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127b7 expref: 36 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143847.263993:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b67f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127b7 expref: 36 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143847.264001:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74200, rc 0) 00000100:00100000:0.0:1746143847.264023:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625224448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4796us (4998us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143847.264029:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17074 00000100:00100000:2.0:1746143847.267086:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627560192:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143847.267102:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.267138:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012157b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625224832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3404us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.267147:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8383 00000100:00100000:1.0:1746143847.267416:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.267690:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625225088 00000100:00100000:3.0:1746143847.267696:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625225088 00002000:00100000:3.0:1746143847.267723:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (2060288->2064383) req@ffff88009322c000 x1830963625225088/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.267732:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c000 with x1830963625225088 ext(2060288->2064383) 00002000:00010000:3.0:1746143847.267736:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322c000 00000100:00100000:3.0:1746143847.267747:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7468 00000100:00100000:3.0:1746143847.267752:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625225088:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.267841:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625225088:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 88us (425us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143847.267846:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7468 00002000:00100000:3.0:1746143847.267850:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (2060288->2064383) req@ffff88009322c000 x1830963625225088/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.267862:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322c000 with x1830963625225088 ext(2060288->2064383) 00002000:00010000:3.0:1746143847.267864:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322c000 00000100:00100000:0.0:1746143847.274424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.274483:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625225344 00000100:00100000:1.0:1746143847.274490:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625225344 00000100:00100000:0.0:1746143847.274503:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143847.274529:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009e490000 x1830963625225344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 504/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.274538:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490000 with x1830963625225344 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.274542:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490000 00000100:00100000:1.0:1746143847.274572:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7469 00000100:00100000:1.0:1746143847.274623:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625225344:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143847.274666:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625225472 00000100:00100000:2.0:1746143847.274669:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625225472 00000100:00100000:2.0:1746143847.274700:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17075 00000100:00100000:2.0:1746143847.274704:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3048:x1830963625225472:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.274713:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.274726:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127be expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.274745:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.274752:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 42 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.274757:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.274759:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.274762:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.274786:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 42 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.274795:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 42 pid: 13430 timeout: 1006 lvb_type: 1 00000100:00100000:2.0:1746143847.274804:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627560320:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.274870:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.274877:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.274884:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627560448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.274901:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.277485:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627560448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.278195:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627560320:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.278221:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.278236:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ca00, rc 0) 00000100:00100000:2.0:1746143847.278269:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3048:x1830963625225472:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3564us (3764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.278295:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17075 00000100:00100000:1.0:1746143847.278968:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625225344:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4346us (4548us total) trans 0 rc 589824/589824 00000100:00100000:1.0:1746143847.278976:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7469 00002000:00100000:1.0:1746143847.278983:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009e490000 x1830963625225344/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 504/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 589824/589824 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.278991:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490000 with x1830963625225344 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.279001:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490000 00000100:00100000:0.0:1746143847.279397:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.279448:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.280147:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625225728 00000100:00100000:2.0:1746143847.280154:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625225728 00010000:00010000:2.0:1746143847.280181:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.280202:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625225600 00000100:00100000:2.0:1746143847.280204:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625225600 00010000:00010000:2.0:1746143847.280214:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 43 pid: 13430 timeout: 1006 lvb_type: 1 00000100:00100000:3.0:1746143847.280290:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8384 00000100:00100000:3.0:1746143847.280298:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625225728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.280309:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.280325:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.280334:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.280353:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7de00/0x87925e4cb73b67ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412778 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.280370:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.280395:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625225728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 99us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.280401:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8384 00000100:00100000:3.0:1746143847.280414:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8385 00000100:00100000:3.0:1746143847.280419:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+43:2011:x1830963625225600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.280424:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.280430:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 43 pid: 13430 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.280443:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 43 pid: 13430 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.280453:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b67ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412786 expref: 43 pid: 13430 timeout: 1006 lvb_type: 1 00010000:00010000:3.0:1746143847.280461:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.280463:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.280467:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.280474:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.280498:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.280507:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627560576:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.280545:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.284757:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627560576:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.284776:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.284827:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625225600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4405us (5376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.284837:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8385 00000100:00100000:0.0:1746143847.285664:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.285702:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.285778:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226112 00000100:00100000:2.0:1746143847.285784:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226112 00000100:00100000:1.0:1746143847.285857:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625225984 00000100:00100000:1.0:1746143847.285861:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625225984 00002000:00100000:1.0:1746143847.285888:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1380352->1384447) req@ffff88009e491f80 x1830963625225984/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.285898:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491f80 with x1830963625225984 ext(1380352->1384447) 00002000:00010000:1.0:1746143847.285902:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491f80 00000100:00100000:2.0:1746143847.285953:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17076 00000100:00100000:2.0:1746143847.285960:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:3052:x1830963625226112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.285972:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.285984:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127c5 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.286005:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.286012:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.286013:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.286016:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.286040:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 22 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.286052:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 22 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.286062:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627560704:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.286106:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.286314:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7470 00000100:00100000:1.0:1746143847.286321:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625225984:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143847.286409:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625225984:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 88us (745us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143847.286414:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7470 00002000:00100000:1.0:1746143847.286419:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1380352->1384447) req@ffff88009e491f80 x1830963625225984/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.286425:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491f80 with x1830963625225984 ext(1380352->1384447) 00002000:00010000:1.0:1746143847.286429:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491f80 00000100:00100000:2.0:1746143847.289903:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627560704:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.289946:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 36 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.289957:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28a00, rc 0) 00000100:00100000:2.0:1746143847.289986:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:3052:x1830963625226112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4027us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.289992:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17076 00000100:00100000:0.0:1746143847.295049:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.295257:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226240 00000100:00100000:3.0:1746143847.295266:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226240 00002000:00100000:3.0:1746143847.295329:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (2060288->2097151) req@ffff880091bdd500 x1830963625226240/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.295339:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd500 with x1830963625226240 ext(2060288->2097151) 00010000:00010000:3.0:1746143847.295347:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.295360:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 23 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.295366:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bdd500 00000100:00100000:3.0:1746143847.295491:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2738 00000100:00100000:3.0:1746143847.295499:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2009:x1830963625226240:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143847.295955:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.296415:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.297042:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226368 00000100:00100000:3.0:1746143847.297047:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226368 00000100:00100000:3.0:1746143847.297297:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226496 00000100:00100000:3.0:1746143847.297300:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226496 00000100:00100000:3.0:1746143847.297327:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17077 00000100:00100000:3.0:1746143847.297334:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625226368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.297346:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.297360:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73b680e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127cc expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.297404:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627560832:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143847.297469:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.297488:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17078 00000100:00100000:3.0:1746143847.297493:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963625226496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.297499:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.297506:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b6815 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127d3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.297526:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627560960:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143847.297549:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00002000:00010000:3.0:1746143847.299363:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143846 -> 1746143847 00002000:00010000:3.0:1746143847.299368:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143846 -> 1746143847 00002000:00010000:3.0:1746143847.299370:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143846 -> 1746143847 00000100:00100000:3.0:1746143847.299380:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627560960:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143847.299401:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b6815 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127d3 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.299411:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b6815 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127d3 expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143847.299411:0:9839:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143846 -> 1746143847 00002000:00010000:2.0:1746143847.299414:0:9839:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143846 -> 1746143847 00002000:00010000:2.0:1746143847.299416:0:9839:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143846 -> 1746143847 00010000:00010000:3.0:1746143847.299424:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189cc00, rc 0) 00000100:00100000:2.0:1746143847.299425:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627560832:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.299442:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73b680e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127cc expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.299450:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74000/0x87925e4cb73b680e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127cc expref: 29 pid: 9839 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143847.299555:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625226496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2061us (3139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143847.299563:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17078 00000100:00100000:3.0:1746143847.299607:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625226240:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4110us (4566us total) trans 21474841321 rc 0/0 00000100:00100000:3.0:1746143847.299614:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2738 00002000:00100000:3.0:1746143847.299621:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (2060288->2097151) req@ffff880091bdd500 x1830963625226240/t21474841321(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.299634:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd500 with x1830963625226240 ext(2060288->2097151) 00010000:00010000:3.0:1746143847.299640:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 26 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.299651:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 26 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.299657:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bdd500 00010000:00010000:2.0:1746143847.300049:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:2.0:1746143847.300102:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625226368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2768us (4147us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.300107:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17077 00000100:00100000:0.0:1746143847.308309:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.308385:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226624 00000100:00100000:3.0:1746143847.308402:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226624 00010000:00010000:3.0:1746143847.308433:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 25 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.308471:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8386 00000100:00100000:3.0:1746143847.308477:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625226624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.308489:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.308505:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 25 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.308515:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 25 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.308536:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189ca00/0x87925e4cb73b67eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a9 expref: 25 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.308571:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.308573:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.308579:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.308586:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.308616:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 35 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.308625:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627561088:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143847.309578:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.310108:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226752 00000100:00100000:2.0:1746143847.310114:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226752 00000100:00100000:2.0:1746143847.310158:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17079 00000100:00100000:2.0:1746143847.310164:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3055:x1830963625226752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.310179:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.310192:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127da expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.310211:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.310216:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.310218:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.310220:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.310239:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 35 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.310249:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 35 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.310259:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627561216:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.310316:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.310420:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.311312:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627561088:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.311326:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.311361:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963625226624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2883us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.311369:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8386 00000100:00100000:2.0:1746143847.312051:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627561216:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.312069:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.312190:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:2.0:1746143847.312216:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3055:x1830963625226752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2052us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.312221:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17079 00000100:00100000:0.0:1746143847.313181:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.313701:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.314576:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625226880 00000100:00100000:3.0:1746143847.314584:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625226880 00002000:00100000:3.0:1746143847.314620:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1171456->1630207) req@ffff880091bdf480 x1830963625226880/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.314628:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf480 with x1830963625226880 ext(1171456->1630207) 00010000:00010000:3.0:1746143847.314636:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 36 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.314652:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 36 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.314658:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bdf480 00000100:00100000:3.0:1746143847.314687:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625227136 00000100:00100000:3.0:1746143847.314690:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625227136 00002000:00100000:3.0:1746143847.314700:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880091bddc00 x1830963625227136/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.314706:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963625227136 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.314709:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bddc00 00000100:00100000:3.0:1746143847.314721:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2739 00000100:00100000:3.0:1746143847.314726:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625226880:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143847.314895:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7471 00000100:00100000:1.0:1746143847.314902:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625227136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143847.328006:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625226880:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13271us (14818us total) trans 21474841322 rc 0/0 00000100:00100000:3.0:1746143847.328016:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2739 00002000:00100000:3.0:1746143847.328027:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bd:0x0] (1171456->1630207) req@ffff880091bdf480 x1830963625226880/t21474841322(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.328036:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdf480 with x1830963625226880 ext(1171456->1630207) 00010000:00010000:3.0:1746143847.328045:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 40 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.328058:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 40 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.328069:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bdf480 00000100:00100000:1.0:1746143847.328463:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625227136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13559us (14761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143847.328470:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7471 00002000:00100000:1.0:1746143847.328475:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880091bddc00 x1830963625227136/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.328483:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddc00 with x1830963625227136 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.328486:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bddc00 00000100:00100000:0.0:1746143847.331785:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.332489:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625227264 00000100:00100000:3.0:1746143847.332497:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625227264 00010000:00010000:3.0:1746143847.332532:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 38 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.332598:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8387 00000100:00100000:3.0:1746143847.332606:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625227264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.332617:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.332636:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 38 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.332647:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 38 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.332666:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d000/0x87925e4cb73b67cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1630207) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841279b expref: 38 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.332897:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.332899:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.332906:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.332928:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.332964:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.332974:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627561344:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.333467:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.335766:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.335882:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625227392 00000100:00100000:2.0:1746143847.335891:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625227392 00000100:00100000:2.0:1746143847.335961:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17080 00000100:00100000:2.0:1746143847.335967:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:3052:x1830963625227392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.335984:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.335999:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127e1 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.336025:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.336030:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.336031:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.336034:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 43 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.336057:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 21 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.336065:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 21 pid: 9839 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.336074:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627561472:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.336141:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801338fbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.336535:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627561344:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.336550:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.336581:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625227264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3975us (4802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.336590:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8387 00000100:00100000:0.0:1746143847.338884:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.339148:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625227648 00000100:00100000:1.0:1746143847.339160:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625227648 00002000:00100000:1.0:1746143847.339204:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880091bde300 x1830963625227648/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.339214:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde300 with x1830963625227648 ext(1048576->2097151) 00000100:00100000:3.0:1746143847.339362:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627561472:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.339389:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 43 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.339405:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00000100:00100000:3.0:1746143847.339439:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:3052:x1830963625227392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3472us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.339447:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17080 00002000:00010000:1.0:1746143847.340410:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bde300 00000100:00100000:1.0:1746143847.340449:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7472 00000100:00100000:1.0:1746143847.340459:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625227648:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143847.341147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.342105:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625227776 00000100:00100000:2.0:1746143847.342115:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625227776 00002000:00100000:2.0:1746143847.342156:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1384447) req@ffff880091bdd880 x1830963625227776/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.342165:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963625227776 ext(1048576->1384447) 00010000:00010000:2.0:1746143847.342174:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 22 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.342188:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 22 pid: 9839 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143847.342195:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdd880 00000100:00100000:2.0:1746143847.342221:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2740 00000100:00100000:2.0:1746143847.342228:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625227776:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143847.349989:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625227648:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9524us (11104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143847.350000:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7472 00002000:00100000:1.0:1746143847.350010:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880091bde300 x1830963625227648/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.350018:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde300 with x1830963625227648 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.350022:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bde300 00000100:00100000:3.0:1746143847.351829:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625227776:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9591us (10675us total) trans 17179874056 rc 0/0 00000100:00100000:3.0:1746143847.351843:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2740 00002000:00100000:3.0:1746143847.351855:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1384447) req@ffff880091bdd880 x1830963625227776/t17179874056(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.351870:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdd880 with x1830963625227776 ext(1048576->1384447) 00010000:00010000:3.0:1746143847.351881:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 24 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.351901:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 24 pid: 9839 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.351908:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdd880 00000100:00100000:0.0:1746143847.353883:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.354004:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625227904 00000100:00100000:3.0:1746143847.354013:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625227904 00010000:00010000:3.0:1746143847.354049:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 24 pid: 9839 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.354084:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8388 00000100:00100000:3.0:1746143847.354091:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2010:x1830963625227904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.354105:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.354124:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 24 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.354136:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 24 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.354160:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6800 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127be expref: 24 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.354231:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.354234:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.354242:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 42 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.354250:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 42 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.354298:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 42 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.354312:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627561600:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.355117:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.358722:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.358935:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625228032 00000100:00100000:3.0:1746143847.358943:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625228032 00000100:00100000:2.0:1746143847.359033:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627561600:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143847.359055:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.359112:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963625227904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5019us (5234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.359123:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8388 00000100:00100000:3.0:1746143847.360003:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17081 00000100:00100000:3.0:1746143847.360013:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3055:x1830963625228032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.360032:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.360050:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127e8 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.360079:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.360081:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.360087:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.360103:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.360117:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408cc00, rc 0) 00000100:00100000:3.0:1746143847.360150:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:3055:x1830963625228032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 139us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.360156:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17081 00000100:00100000:0.0:1746143847.364802:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.364948:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625228288 00000100:00100000:3.0:1746143847.364959:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625228288 00002000:00100000:3.0:1746143847.365007:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880091bdca80 x1830963625228288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.365016:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdca80 with x1830963625228288 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.365022:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdca80 00000100:00100000:3.0:1746143847.365055:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7473 00000100:00100000:3.0:1746143847.365063:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625228288:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143847.369013:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.369202:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625228544 00000100:00100000:2.0:1746143847.369211:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625228544 00002000:00100000:2.0:1746143847.369257:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880091bddf80 x1830963625228544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.369268:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963625228544 ext(1048576->2097151) 00002000:00010000:2.0:1746143847.369274:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bddf80 00000100:00100000:2.0:1746143847.369314:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7474 00000100:00100000:2.0:1746143847.369322:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625228544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143847.380517:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.380644:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.380686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.380705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.380787:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625228672 00000100:00100000:0.0:1746143847.380797:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625228672 00000100:00100000:2.0:1746143847.381073:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 243 00000100:00100000:2.0:1746143847.381084:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a42ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2008:x1830963625228672:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143847.381148:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a42ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2008:x1830963625228672:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 68us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.381155:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 243 00000100:00100000:2.0:1746143847.381187:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625228800 00000100:00100000:2.0:1746143847.381191:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625228800 00000100:00080000:2.0:1746143847.381210:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143847.381231:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625228544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11901us (12220us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.381233:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229056 00000100:00100000:2.0:1746143847.381235:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229056 00000100:00080000:2.0:1746143847.381242:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746143847.381242:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7474 00002000:00100000:0.0:1746143847.381252:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880091bddf80 x1830963625228544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143847.381259:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625228928 00002000:00100000:0.0:1746143847.381260:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bddf80 with x1830963625228544 ext(1048576->2097151) 00000100:00100000:2.0:1746143847.381261:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625228928 00002000:00010000:0.0:1746143847.381265:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bddf80 00000100:00100000:2.0:1746143847.381291:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1221 00000100:00100000:2.0:1746143847.381296:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963625228800:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143847.381326:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+20:2008:x1830963625228800:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.381332:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1221 00000100:00100000:2.0:1746143847.381343:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1222 00000100:00100000:2.0:1746143847.381347:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2008:x1830963625229056:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143847.381377:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2008:x1830963625229056:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.381381:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1222 00000100:00100000:2.0:1746143847.381389:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1223 00000100:00100000:2.0:1746143847.381392:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2008:x1830963625228928:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143847.381414:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2008:x1830963625228928:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.381419:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1223 00000100:00080000:2.0:1746143847.381440:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746143847.381535:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625228288:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16473us (16745us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.381547:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7473 00002000:00100000:2.0:1746143847.381555:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880091bdca80 x1830963625228288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.381562:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdca80 with x1830963625228288 ext(1048576->2097151) 00002000:00010000:2.0:1746143847.381566:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdca80 00000100:00100000:1.0:1746143847.389197:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.389226:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.389252:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.389274:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229184 00000100:00100000:1.0:1746143847.389292:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229184 00000100:00100000:1.0:1746143847.389330:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229312 00000100:00100000:1.0:1746143847.389331:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229312 00000100:00100000:1.0:1746143847.389342:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229440 00000100:00100000:1.0:1746143847.389343:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229440 00000100:00100000:1.0:1746143847.389369:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17082 00000100:00100000:1.0:1746143847.389376:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625229184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.389395:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.389413:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127ef expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.389436:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.389438:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.389446:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 38 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.389462:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 38 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.389473:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849a00, rc 0) 00000100:00100000:1.0:1746143847.389515:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625229184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.389521:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17082 00000100:00100000:1.0:1746143847.389534:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17083 00000100:00100000:1.0:1746143847.389538:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3055:x1830963625229312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.389545:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.389553:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127f6 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.389567:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.389568:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.389572:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.389581:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 24 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.389588:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848600, rc 0) 00000100:00100000:3.0:1746143847.389593:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17084 00000100:00100000:1.0:1746143847.389600:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3055:x1830963625229312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.389603:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625229440:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143847.389605:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17083 00010000:00010000:3.0:1746143847.389612:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.389621:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b683f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484127fd expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.389653:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.389666:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229568 00000100:00100000:1.0:1746143847.389669:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229568 00000100:00100000:3.0:1746143847.389670:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627561728:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143847.389683:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17085 00000100:00100000:1.0:1746143847.389687:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625229568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.389693:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.389700:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d848000/0x87925e4cb73b6846 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412804 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.389723:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627561856:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143847.389730:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.389746:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.394767:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627561728:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143847.394798:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627561856:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143847.394806:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b683f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127fd expref: 44 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.394822:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d848000/0x87925e4cb73b6846 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412804 expref: 39 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.394825:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b683f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127fd expref: 44 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.394832:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d848000/0x87925e4cb73b6846 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412804 expref: 39 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.394841:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c200, rc 0) 00010000:00010000:1.0:1746143847.394846:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848000, rc 0) 00000100:00100000:3.0:1746143847.396398:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625229440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6786us (7134us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143847.396418:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17084 00000100:00100000:1.0:1746143847.396451:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625229568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6759us (6794us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143847.396458:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17085 00000100:00100000:0.0:1746143847.397219:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.397560:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229824 00000100:00100000:2.0:1746143847.397569:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229824 00002000:00100000:2.0:1746143847.397607:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012b1dad80 x1830963625229824/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.397616:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963625229824 ext(1048576->2097151) 00002000:00010000:2.0:1746143847.397621:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1dad80 00000100:00100000:2.0:1746143847.397649:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7475 00000100:00100000:2.0:1746143847.397657:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625229824:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143847.402199:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.402290:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625229952 00000100:00100000:1.0:1746143847.402300:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625229952 00000100:00100000:1.0:1746143847.402348:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17086 00000100:00100000:1.0:1746143847.402356:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:3052:x1830963625229952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.402375:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.402393:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841280b expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.402422:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.402430:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.402432:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.402436:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.402468:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 25 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.402485:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 25 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.402498:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627561984:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143847.402602:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.405294:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625229824:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7616us (8057us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.405307:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7475 00002000:00100000:2.0:1746143847.405318:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88012b1dad80 x1830963625229824/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.405328:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1dad80 with x1830963625229824 ext(1048576->2097151) 00002000:00010000:2.0:1746143847.405333:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1dad80 00000100:00100000:0.0:1746143847.409167:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.409541:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625230080 00000100:00100000:2.0:1746143847.409550:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625230080 00000100:00100000:1.0:1746143847.409651:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627561984:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143847.409683:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.409701:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:1.0:1746143847.409762:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:3052:x1830963625229952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7406us (7576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.409770:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17086 00002000:00100000:2.0:1746143847.409826:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3829759) req@ffff88012b1d8700 x1830963625230080/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.409836:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8700 with x1830963625230080 ext(3145728->3829759) 00010000:00010000:2.0:1746143847.409842:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 24 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.409854:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 24 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143847.409860:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1d8700 00000100:00100000:2.0:1746143847.409876:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2741 00000100:00100000:2.0:1746143847.409882:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2009:x1830963625230080:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143847.417742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.417947:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625230208 00000100:00100000:1.0:1746143847.417957:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625230208 00000100:00100000:1.0:1746143847.418018:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17087 00000100:00100000:1.0:1746143847.418026:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+26:3055:x1830963625230208:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.418048:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.418067:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412812 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.418752:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.418758:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.418772:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.418781:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107c00, rc 0) 00000100:00100000:1.0:1746143847.418838:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3055:x1830963625230208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 813us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.418844:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17087 00000100:00100000:2.0:1746143847.425906:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963625230080:12345-192.168.202.3@tcp:4:cat.0 Request processed in 16007us (16732us total) trans 17179874057 rc 0/0 00000100:00100000:2.0:1746143847.425942:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2741 00002000:00100000:2.0:1746143847.425955:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3829759) req@ffff88012b1d8700 x1830963625230080/t17179874057(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.425965:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d8700 with x1830963625230080 ext(3145728->3829759) 00010000:00010000:2.0:1746143847.425975:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.425991:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:2.0:1746143847.425998:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1d8700 00000100:00100000:0.0:1746143847.432029:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.433155:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625230336 00000100:00100000:2.0:1746143847.433166:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625230336 00010000:00010000:2.0:1746143847.433208:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.433245:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8389 00000100:00100000:2.0:1746143847.433253:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963625230336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143847.433267:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143847.433301:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.433312:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.433341:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7cc00/0x87925e4cb73b67c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3829759) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412794 expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.433368:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.433370:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.433378:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 43 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.433386:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 43 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.433394:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.433395:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.433398:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.433405:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.433435:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143847.433447:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627562112:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143847.433547:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 43 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143847.433559:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627562240:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143847.433578:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.435390:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627562112:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.435404:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627562240:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.435422:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.435466:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625230336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2213us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.435476:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8389 00000100:00100000:0.0:1746143847.442712:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.442870:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625230592 00000100:00100000:2.0:1746143847.442879:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625230592 00002000:00100000:2.0:1746143847.442948:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012b1da300 x1830963625230592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.442957:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963625230592 ext(2097152->3145727) 00002000:00010000:2.0:1746143847.442962:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:2.0:1746143847.443578:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7476 00000100:00100000:2.0:1746143847.443587:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625230592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143847.457393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.457457:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.457531:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625230848 00000100:00100000:3.0:1746143847.457544:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625230848 00002000:00100000:3.0:1746143847.457592:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880092b48e00 x1830963625230848/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.457602:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48e00 with x1830963625230848 ext(2097152->4194303) 00002000:00010000:3.0:1746143847.457607:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48e00 00000100:00100000:3.0:1746143847.457632:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625231104 00000100:00100000:3.0:1746143847.457635:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625231104 00002000:00100000:3.0:1746143847.457648:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b49500 x1830963625231104/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 504/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.457656:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49500 with x1830963625231104 ext(2097152->4194303) 00002000:00010000:3.0:1746143847.457660:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b49500 00000100:00100000:3.0:1746143847.457672:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7477 00000100:00100000:3.0:1746143847.457679:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625230848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143847.457862:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7478 00000100:00100000:0.0:1746143847.457874:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625231104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143847.466741:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625230592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23148us (24027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.466753:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7476 00002000:00100000:2.0:1746143847.466764:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88012b1da300 x1830963625230592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.466773:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da300 with x1830963625230592 ext(2097152->3145727) 00002000:00010000:2.0:1746143847.466778:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1da300 00000100:00100000:3.0:1746143847.470218:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625230848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12526us (12818us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143847.470231:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7477 00002000:00100000:3.0:1746143847.470243:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880092b48e00 x1830963625230848/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.470254:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48e00 with x1830963625230848 ext(2097152->4194303) 00002000:00010000:3.0:1746143847.470261:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b48e00 00000100:00100000:0.0:1746143847.473171:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.473224:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625231232 00000100:00100000:1.0:1746143847.473234:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625231232 00000100:00100000:1.0:1746143847.473302:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17088 00000100:00100000:1.0:1746143847.473313:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+38:3052:x1830963625231232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.473329:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.473762:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412819 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.473789:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.473796:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.473797:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.473801:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.473827:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.473838:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.473848:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627562368:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143847.474620:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.478478:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627562368:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143847.478505:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2009:x1830963625231104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20626us (21038us total) trans 0 rc 1867776/1867776 00010000:00010000:2.0:1746143847.478515:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.478517:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7478 00002000:00100000:1.0:1746143847.478527:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b49500 x1830963625231104/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 504/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1867776/1867776 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143847.478532:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513600, rc 0) 00002000:00100000:1.0:1746143847.478535:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b49500 with x1830963625231104 ext(2097152->4194303) 00010000:00010000:1.0:1746143847.478544:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 26 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.478556:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 26 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143847.478562:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b49500 00000100:00100000:2.0:1746143847.478567:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:3052:x1830963625231232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5258us (5405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.478576:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17088 00000100:00100000:0.0:1746143847.479950:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.479988:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.480775:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625231488 00000100:00100000:2.0:1746143847.480783:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625231488 00000100:00100000:1.0:1746143847.480808:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625231360 00000100:00100000:1.0:1746143847.480819:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625231360 00000100:00100000:2.0:1746143847.480841:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17089 00000100:00100000:2.0:1746143847.480849:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3055:x1830963625231488:12345-192.168.202.3@tcp:101:cat.0 00002000:00100000:1.0:1746143847.480858:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2916352->3145727) req@ffff88012b1db100 x1830963625231360/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143847.480865:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746143847.480867:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db100 with x1830963625231360 ext(2916352->3145727) 00010000:00010000:1.0:1746143847.480876:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.480882:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412820 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.480888:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 27 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143847.480894:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1db100 00010000:00010000:2.0:1746143847.480905:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.480947:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.480960:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.480961:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2742 00000100:00100000:1.0:1746143847.480968:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625231360:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:2.0:1746143847.480969:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97e00, rc 0) 00000100:00100000:2.0:1746143847.481005:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3055:x1830963625231488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 158us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.481011:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17089 00000100:00100000:1.0:1746143847.486630:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625231360:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5650us (6671us total) trans 21474841323 rc 0/0 00000100:00100000:1.0:1746143847.486644:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2742 00002000:00100000:1.0:1746143847.486656:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2916352->3145727) req@ffff88012b1db100 x1830963625231360/t21474841323(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.486666:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db100 with x1830963625231360 ext(2916352->3145727) 00010000:00010000:1.0:1746143847.486676:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 29 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.486691:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 29 pid: 13430 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143847.486698:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1db100 00000100:00100000:0.0:1746143847.498546:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.498823:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625231616 00000100:00100000:3.0:1746143847.498835:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625231616 00010000:00010000:3.0:1746143847.498877:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 29 pid: 13430 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.498969:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8390 00000100:00100000:3.0:1746143847.498993:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625231616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.499009:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.499035:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 29 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.499048:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 29 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.499072:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b67c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2916352->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841278d expref: 29 pid: 13430 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.499095:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.499098:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.499105:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 38 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.499114:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 38 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.499121:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.499122:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.499125:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.499130:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.499165:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.499178:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627562496:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.499296:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 38 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.499304:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627562624:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.499322:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.502441:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627562496:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.502456:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627562624:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.502476:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.502536:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880121578050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625231616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3558us (3997us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.502548:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8390 00000100:00100000:0.0:1746143847.507613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.507644:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.509965:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625231872 00000100:00100000:1.0:1746143847.509971:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625232128 00000100:00100000:2.0:1746143847.509979:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625231872 00000100:00100000:1.0:1746143847.509979:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625232128 00000100:00100000:0.0:1746143847.510016:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143847.510026:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1da680 x1830963625231872/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.510027:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1d9180 x1830963625232128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.510036:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963625231872 ext(2097152->4194303) 00002000:00100000:1.0:1746143847.510036:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9180 with x1830963625232128 ext(2097152->4194303) 00002000:00010000:2.0:1746143847.510042:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1da680 00002000:00010000:1.0:1746143847.510042:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9180 00000100:00100000:2.0:1746143847.511205:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625232384 00000100:00100000:2.0:1746143847.511211:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625232384 00000100:00100000:3.0:1746143847.511219:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7479 00000100:00100000:3.0:1746143847.511230:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963625231872:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143847.511235:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012b1db800 x1830963625232384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.511242:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db800 with x1830963625232384 ext(3145728->4194303) 00002000:00010000:2.0:1746143847.511246:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1db800 00000100:00100000:2.0:1746143847.511267:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7480 00000100:00100000:2.0:1746143847.511273:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625232128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143847.511327:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7481 00000100:00100000:2.0:1746143847.511332:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625232384:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143847.527372:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625232384:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16025us (17344us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143847.527385:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7481 00002000:00100000:1.0:1746143847.527398:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012b1db800 x1830963625232384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.527407:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1db800 with x1830963625232384 ext(3145728->4194303) 00002000:00010000:1.0:1746143847.527413:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1db800 00000100:00100000:2.0:1746143847.534849:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625232128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23565us (27193us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143847.534861:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7480 00002000:00100000:2.0:1746143847.534872:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1d9180 x1830963625232128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.534882:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9180 with x1830963625232128 ext(2097152->4194303) 00002000:00010000:2.0:1746143847.534888:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9180 00000100:00100000:3.0:1746143847.539437:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963625231872:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27553us (31176us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143847.539452:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7479 00002000:00100000:3.0:1746143847.539466:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1da680 x1830963625231872/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.539475:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1da680 with x1830963625231872 ext(2097152->4194303) 00002000:00010000:3.0:1746143847.539481:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1da680 00000100:00100000:0.0:1746143847.546118:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.547945:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.548327:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625232512 00000100:00100000:3.0:1746143847.548339:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625232512 00000100:00100000:2.0:1746143847.550382:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625232768 00000100:00100000:2.0:1746143847.550394:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625232768 00002000:00100000:2.0:1746143847.550452:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012b1daa00 x1830963625232768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.550462:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963625232768 ext(4194304->4853759) 00002000:00010000:2.0:1746143847.550468:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1daa00 00000100:00100000:3.0:1746143847.550478:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17090 00000100:00100000:3.0:1746143847.550489:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:3058:x1830963625232512:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:2.0:1746143847.550497:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7482 00000100:00100000:2.0:1746143847.550501:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625232768:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143847.550505:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.550523:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412827 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.550548:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.550560:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.550566:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.550568:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.550571:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.550599:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.550610:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 27 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.550621:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627562752:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.550729:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.550740:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.550748:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627562880:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143847.550765:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.553332:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.555221:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233024 00000100:00100000:0.0:1746143847.555231:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233024 00002000:00100000:0.0:1746143847.555326:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880092b4a680 x1830963625233024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143847.555335:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4a680 with x1830963625233024 ext(4194304->4853759) 00002000:00010000:0.0:1746143847.555339:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4a680 00000100:00100000:0.0:1746143847.555358:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7483 00000100:00100000:0.0:1746143847.555365:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625233024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143847.556369:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627562752:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143847.556382:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627562880:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.556404:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 40 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.556418:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ce00, rc 0) 00000100:00100000:3.0:1746143847.556496:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:3058:x1830963625232512:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6009us (10386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.556503:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17090 00000100:00100000:1.0:1746143847.556598:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.557242:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625232768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6739us (9303us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143847.557250:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7482 00002000:00100000:1.0:1746143847.557258:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88012b1daa00 x1830963625232768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.557266:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1daa00 with x1830963625232768 ext(4194304->4853759) 00002000:00010000:1.0:1746143847.557270:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1daa00 00000100:00100000:3.0:1746143847.557849:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233152 00000100:00100000:3.0:1746143847.557855:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233152 00010000:00010000:3.0:1746143847.557876:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.557897:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8391 00000100:00100000:3.0:1746143847.557902:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625233152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.557937:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.557951:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.557960:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.557980:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513600/0x87925e4cb73b685b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412819 expref: 40 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.557997:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.558017:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625233152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 115us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.558023:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8391 00000100:00100000:0.0:1746143847.567951:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.568093:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.568953:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625233024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13586us (15625us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143847.568962:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7483 00002000:00100000:2.0:1746143847.568971:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880092b4a680 x1830963625233024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.568980:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4a680 with x1830963625233024 ext(4194304->4853759) 00002000:00010000:2.0:1746143847.568985:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4a680 00000100:00100000:0.0:1746143847.575272:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.576701:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233408 00000100:00100000:2.0:1746143847.576714:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233408 00000100:00100000:2.0:1746143847.576762:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233536 00000100:00100000:2.0:1746143847.576764:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233536 00000100:00100000:2.0:1746143847.576791:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17091 00000100:00100000:2.0:1746143847.576798:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625233408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.576812:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.576827:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b6870 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841282e expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.576847:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.576857:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b6870 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841282e expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.576867:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b6870 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841282e expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.576886:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:2.0:1746143847.576952:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625233408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 155us (8859us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.576958:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17091 00000100:00100000:2.0:1746143847.576971:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17092 00000100:00100000:2.0:1746143847.576975:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625233536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.576981:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.576986:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b6877 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412835 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.576996:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.577000:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b6877 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412835 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.577007:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96a00/0x87925e4cb73b6877 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412835 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.577014:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96a00, rc 0) 00000100:00100000:2.0:1746143847.577025:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625233536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 49us (1765us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.577029:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17092 00000100:00100000:1.0:1746143847.579237:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233280 00000100:00100000:1.0:1746143847.579247:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233280 00010000:00010000:1.0:1746143847.579288:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.579324:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8392 00000100:00100000:1.0:1746143847.579330:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625233280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143847.579340:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143847.579357:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.579366:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.579382:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97e00/0x87925e4cb73b6862 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412820 expref: 28 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.579400:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.579402:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143847.579407:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.579414:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.579440:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.579449:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627563008:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143847.579513:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.582206:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.582307:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.582385:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233664 00000100:00100000:1.0:1746143847.582395:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233664 00000100:00100000:1.0:1746143847.582442:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625233792 00000100:00100000:1.0:1746143847.582445:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625233792 00000100:00100000:1.0:1746143847.582465:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17093 00000100:00100000:1.0:1746143847.582471:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625233664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.582489:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.582503:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b687e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841283c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.582545:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627563136:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143847.582621:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.582651:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17094 00000100:00100000:1.0:1746143847.582658:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625233792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.582664:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.582670:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b6885 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412843 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.582690:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627563264:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143847.582708:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.583713:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627563008:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143847.583720:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143847.583730:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143847.583761:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625233280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4430us (15857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.583769:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8392 00000100:00100000:2.0:1746143847.583803:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234048 00000100:00100000:2.0:1746143847.583825:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234048 00002000:00100000:2.0:1746143847.583880:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2445312->2449407) req@ffff880090e78000 x1830963625234048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.583897:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78000 with x1830963625234048 ext(2445312->2449407) 00002000:00010000:2.0:1746143847.583902:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e78000 00000100:00100000:2.0:1746143847.583960:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7484 00000100:00100000:2.0:1746143847.583970:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625234048:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143847.584466:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625234048:12345-192.168.202.3@tcp:3:cat.0 Request processed in 495us (746us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143847.584473:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7484 00002000:00100000:2.0:1746143847.584481:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2445312->2449407) req@ffff880090e78000 x1830963625234048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.584498:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e78000 with x1830963625234048 ext(2445312->2449407) 00002000:00010000:2.0:1746143847.584502:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e78000 00002000:00010000:1.0:1746143847.590996:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143847 -> 1746143848 00002000:00010000:1.0:1746143847.591004:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143847 -> 1746143848 00002000:00010000:1.0:1746143847.591006:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143847 -> 1746143848 00000100:00100000:1.0:1746143847.591024:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627563136:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143847.591054:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b687e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841283c expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.591072:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b687e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841283c expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.591104:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7600, rc 0) 00000100:00100000:1.0:1746143847.591159:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963625233664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 8687us (8965us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143847.591166:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17093 00000100:00100000:2.0:1746143847.592418:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627563264:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.592458:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b6885 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412843 expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.592474:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7c00/0x87925e4cb73b6885 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412843 expref: 40 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.592513:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7c00, rc 0) 00000100:00100000:2.0:1746143847.593145:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625233792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10485us (10837us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.593155:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17094 00000100:00100000:0.0:1746143847.608512:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.608617:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234176 00000100:00100000:2.0:1746143847.608628:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234176 00000100:00100000:2.0:1746143847.608693:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17095 00000100:00100000:2.0:1746143847.608702:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:3058:x1830963625234176:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.608723:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.608740:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841284a expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.608774:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.608782:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.608787:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.608789:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.608792:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3379199] (req 3145728->3379199) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.608820:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.608832:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 25 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.608843:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627563392:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.610693:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.610714:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.610726:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627563520:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.610772:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.615803:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627563392:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.615820:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627563520:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.615854:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3379199] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.615878:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96a00, rc 0) 00000100:00100000:2.0:1746143847.616406:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:3058:x1830963625234176:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7703us (7903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.616415:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17095 00000100:00100000:0.0:1746143847.621321:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.621368:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.621450:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234432 00000100:00100000:1.0:1746143847.621460:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234432 00010000:00010000:1.0:1746143847.621497:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.621534:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234304 00000100:00100000:1.0:1746143847.621536:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234304 00010000:00010000:1.0:1746143847.621548:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.621564:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8393 00000100:00100000:1.0:1746143847.621571:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2011:x1830963625234432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143847.621588:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143847.621608:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.621619:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.621623:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8394 00000100:00100000:3.0:1746143847.621640:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963625234304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143847.621647:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107c00/0x87925e4cb73b6854 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412812 expref: 26 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.621658:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143847.621669:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143847.621679:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.621693:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.621710:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625234432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 140us (399us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143847.621713:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b684d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841280b expref: 45 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:1.0:1746143847.621717:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8393 00010000:00010000:3.0:1746143847.621738:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.621739:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.621746:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.621753:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.621784:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.621795:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627563648:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.621966:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.628515:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627563648:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.628532:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.629352:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625234304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7716us (7978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.629361:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8394 00000100:00100000:0.0:1746143847.631573:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.631639:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234688 00000100:00100000:2.0:1746143847.631650:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234688 00002000:00100000:2.0:1746143847.631703:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3375104->3379199) req@ffff880090e79880 x1830963625234688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.631713:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79880 with x1830963625234688 ext(3375104->3379199) 00002000:00010000:2.0:1746143847.631718:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e79880 00000100:00100000:1.0:1746143847.633954:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7485 00000100:00100000:1.0:1746143847.633977:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625234688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143847.634170:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625234688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 205us (2605us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143847.634178:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7485 00002000:00100000:1.0:1746143847.634187:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3375104->3379199) req@ffff880090e79880 x1830963625234688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.634196:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79880 with x1830963625234688 ext(3375104->3379199) 00002000:00010000:1.0:1746143847.634203:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e79880 00000100:00100000:0.0:1746143847.720852:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.721999:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234816 00000100:00100000:2.0:1746143847.722010:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234816 00000100:00100000:2.0:1746143847.722070:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17096 00000100:00100000:2.0:1746143847.722079:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3061:x1830963625234816:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.722101:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.722119:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412851 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.722152:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.722160:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.722162:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.722165:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3088384->3145727] (req 3088384->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.722199:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 38 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.722210:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 38 pid: 9839 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.722221:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627563776:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.722324:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.726868:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627563776:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.726902:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3088384->3145727] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.726955:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96800, rc 0) 00000100:00100000:2.0:1746143847.727007:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3061:x1830963625234816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4928us (6164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.727017:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17096 00000100:00100000:0.0:1746143847.727248:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.727436:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625234944 00000100:00100000:3.0:1746143847.727443:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625234944 00002000:00100000:3.0:1746143847.727478:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2445312->3145727) req@ffff880090e7b100 x1830963625234944/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.727487:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b100 with x1830963625234944 ext(2445312->3145727) 00010000:00010000:3.0:1746143847.727493:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 39 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.727505:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 39 pid: 9839 timeout: 1006 lvb_type: 0 00002000:00010000:3.0:1746143847.727511:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e7b100 00000100:00100000:1.0:1746143847.728088:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2743 00000100:00100000:1.0:1746143847.728098:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625234944:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143847.745644:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625234944:12345-192.168.202.3@tcp:4:cat.0 Request processed in 17534us (18382us total) trans 21474841324 rc 0/0 00000100:00100000:1.0:1746143847.745659:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2743 00002000:00100000:1.0:1746143847.745672:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2445312->3145727) req@ffff880090e7b100 x1830963625234944/t21474841324(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.745688:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7b100 with x1830963625234944 ext(2445312->3145727) 00010000:00010000:1.0:1746143847.745698:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 41 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.745714:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 41 pid: 9839 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143847.745720:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e7b100 00000100:00100000:0.0:1746143847.747993:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.748156:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625235072 00000100:00100000:2.0:1746143847.748167:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625235072 00000100:00100000:2.0:1746143847.748796:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17097 00000100:00100000:2.0:1746143847.748805:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625235072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.748825:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.748843:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b689a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412858 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143847.748900:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627563904:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143847.749017:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.749430:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.749547:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625235200 00000100:00100000:3.0:1746143847.749553:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625235200 00010000:00010000:3.0:1746143847.749573:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 43 pid: 9839 timeout: 1006 lvb_type: 0 00000100:00100000:3.0:1746143847.749594:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8395 00000100:00100000:3.0:1746143847.749598:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625235200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.749606:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.749625:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 43 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.749636:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 43 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:3.0:1746143847.749656:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.749658:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.749665:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.750561:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.750594:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.750604:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627564032:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.750938:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143847.752408:0:12327:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff88009610ed80 x1830963627563904) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 43 pid: 9839 timeout: 1006 lvb_type: 0 00010000:00010000:2.0:1746143847.752439:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b6869 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412827 expref: 43 pid: 9839 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.752468:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627563904:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.752498:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b689a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412858 expref: 42 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.752509:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b689a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412858 expref: 42 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.752516:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97800, rc 0) 00000100:00100000:2.0:1746143847.752570:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625235072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3762us (4580us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.752578:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17097 00000100:00100000:0.0:1746143847.755056:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.755163:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627564032:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143847.755168:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625235456 00000100:00100000:1.0:1746143847.755174:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625235456 00010000:00010000:3.0:1746143847.755181:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746143847.755216:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3088384->3092479) req@ffff880090e79180 x1830963625235456/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746143847.755218:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625235200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5618us (5790us total) trans 0 rc 0/0 00002000:00100000:1.0:1746143847.755224:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79180 with x1830963625235456 ext(3088384->3092479) 00000100:00100000:3.0:1746143847.755227:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8395 00002000:00010000:1.0:1746143847.755228:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e79180 00000100:00100000:1.0:1746143847.755256:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7486 00000100:00100000:1.0:1746143847.755262:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625235456:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143847.756019:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625235456:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 756us (971us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143847.756025:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7486 00002000:00100000:1.0:1746143847.756030:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3088384->3092479) req@ffff880090e79180 x1830963625235456/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.756037:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79180 with x1830963625235456 ext(3088384->3092479) 00002000:00010000:1.0:1746143847.756040:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e79180 00000100:00100000:0.0:1746143847.758463:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.758581:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625235712 00000100:00100000:1.0:1746143847.758590:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625235712 00002000:00100000:1.0:1746143847.758632:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880090e79500 x1830963625235712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.758641:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79500 with x1830963625235712 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.758645:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e79500 00000100:00100000:1.0:1746143847.758663:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7487 00000100:00100000:1.0:1746143847.758669:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625235712:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143847.764676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.764874:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625235840 00000100:00100000:2.0:1746143847.764885:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625235840 00000100:00100000:2.0:1746143847.766029:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17098 00000100:00100000:2.0:1746143847.766039:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3061:x1830963625235840:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.766058:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.766076:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841285f expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.766110:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 43 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.766117:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.766119:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.766123:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4108287] (req 3145728->4108287) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.766155:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 43 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.766166:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 43 pid: 12327 timeout: 1006 lvb_type: 0 00000100:00100000:2.0:1746143847.766179:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627564160:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.766272:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.769810:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627564160:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143847.769841:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4108287] (req 3145728->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.769860:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625235712:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11188us (11402us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746143847.769865:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97000, rc 0) 00000100:00100000:1.0:1746143847.769871:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7487 00002000:00100000:1.0:1746143847.769881:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880090e79500 x1830963625235712/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.770845:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e79500 with x1830963625235712 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.770850:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e79500 00000100:00100000:3.0:1746143847.771311:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+26:3061:x1830963625235840:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5271us (6643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.771320:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17098 00000100:00100000:0.0:1746143847.771405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.771513:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625235968 00000100:00100000:1.0:1746143847.771520:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625235968 00002000:00100000:1.0:1746143847.771556:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3379199) req@ffff880092b45880 x1830963625235968/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.771562:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45880 with x1830963625235968 ext(3145728->3379199) 00010000:00010000:1.0:1746143847.771569:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 44 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.771581:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 44 pid: 12327 timeout: 1006 lvb_type: 0 00002000:00010000:1.0:1746143847.771591:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b45880 00000100:00100000:1.0:1746143847.771743:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2744 00000100:00100000:1.0:1746143847.771750:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625235968:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143847.785133:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625235968:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13371us (13716us total) trans 17179874058 rc 0/0 00000100:00100000:1.0:1746143847.785147:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2744 00002000:00100000:1.0:1746143847.785159:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3379199) req@ffff880092b45880 x1830963625235968/t17179874058(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.785169:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45880 with x1830963625235968 ext(3145728->3379199) 00010000:00010000:1.0:1746143847.785852:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 46 pid: 12327 timeout: 1006 lvb_type: 0 00010000:00010000:1.0:1746143847.785871:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746143847.785879:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b45880 00000100:00100000:0.0:1746143847.790619:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.791609:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625236096 00000100:00100000:3.0:1746143847.791629:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625236096 00010000:00010000:3.0:1746143847.791677:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.791754:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8396 00000100:00100000:3.0:1746143847.791774:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625236096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.791803:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143847.791823:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143847 -> 1746143848 00002000:00010000:3.0:1746143847.791826:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143847 -> 1746143848 00010000:00010000:3.0:1746143847.791831:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.791844:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.791869:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96a00/0x87925e4cb73b688c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3379199) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841284a expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.791904:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.791906:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.791947:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.791955:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.792409:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.792423:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627564288:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.792567:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.794599:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.794717:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625236224 00000100:00100000:3.0:1746143847.794724:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625236224 00000100:00100000:1.0:1746143847.795135:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17099 00000100:00100000:1.0:1746143847.795145:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625236224:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143847.795371:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.795448:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625236352 00000100:00100000:3.0:1746143847.795451:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625236352 00000100:00100000:3.0:1746143847.795675:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17100 00000100:00100000:3.0:1746143847.795682:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625236352:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.795699:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.795716:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b68a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841286d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.795799:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.795810:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b68af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412866 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.795843:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627564416:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143847.796392:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627564544:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143847.797025:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.797267:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bd80 going to sleep for 11 seconds 00002000:00010000:1.0:1746143847.802112:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143847 -> 1746143848 00000100:00100000:1.0:1746143847.802146:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627564416:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143847.802181:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b68af lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412866 expref: 47 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.802195:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7e00/0x87925e4cb73b68af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412866 expref: 47 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.802211:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7e00, rc 0) 00000100:00100000:1.0:1746143847.802261:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625236224:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7116us (7672us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143847.802269:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17099 00000100:00100000:3.0:1746143847.802420:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627564288:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.802433:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.802454:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963625236096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10693us (11847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.802465:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8396 00000100:00100000:2.0:1746143847.802555:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627564544:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143847.802572:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b68a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841286d expref: 41 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.802580:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ce00/0x87925e4cb73b68a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841286d expref: 41 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.802592:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ce00, rc 0) 00000100:00100000:2.0:1746143847.802610:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625236352:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6928us (7239us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143847.802616:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17100 00000100:00100000:0.0:1746143847.804357:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.804527:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625236480 00000100:00100000:2.0:1746143847.804534:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625236480 00000100:00100000:2.0:1746143847.804579:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17101 00000100:00100000:2.0:1746143847.804585:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:3067:x1830963625236480:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.804601:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.804614:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412874 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.804640:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.804647:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.804649:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143847.804652:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.804682:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.804693:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 25 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143847.804703:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627564672:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.804770:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143847.806544:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627564672:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.806565:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.806578:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96600, rc 0) 00000100:00100000:2.0:1746143847.806610:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+46:3067:x1830963625236480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2024us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.806617:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17101 00000100:00100000:0.0:1746143847.814492:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.814592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.814693:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625236864 00000100:00100000:1.0:1746143847.814704:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625236864 00002000:00100000:1.0:1746143847.814749:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4104192->4108287) req@ffff880092b44380 x1830963625236864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.814759:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44380 with x1830963625236864 ext(4104192->4108287) 00010000:00010000:1.0:1746143847.814768:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143847.814782:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746143847.814789:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b44380 00000100:00100000:1.0:1746143847.814819:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2745 00000100:00100000:1.0:1746143847.814826:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625236864:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143847.814993:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625236864:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 167us (400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143847.814999:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2745 00002000:00100000:1.0:1746143847.815004:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4104192->4108287) req@ffff880092b44380 x1830963625236864/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.815011:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44380 with x1830963625236864 ext(4104192->4108287) 00010000:00010000:1.0:1746143847.815015:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143847.815023:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746143847.815028:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b44380 00000100:00100000:2.0:1746143847.815530:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625236608 00000100:00100000:2.0:1746143847.815534:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625236608 00000100:00100000:2.0:1746143847.815561:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17102 00000100:00100000:2.0:1746143847.815566:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:3069:x1830963625236608:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.815576:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.815590:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841287b expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.815617:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.815625:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.815631:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.815633:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.815636:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1777664->2097151] (req 1777664->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.815665:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143847.815674:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143847.815685:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627564800:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.815752:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.815760:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 27 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143847.815767:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627564928:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.815786:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff880082199240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.821863:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.821899:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.822033:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627564800:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.822044:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627564928:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.822068:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1777664->2097151] (req 1777664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.822081:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:2.0:1746143847.822115:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:3069:x1830963625236608:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6549us (7633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.822122:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17102 00000100:00100000:2.0:1746143847.822158:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625237248 00000100:00100000:2.0:1746143847.822167:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625237248 00010000:00010000:2.0:1746143847.822187:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143847.822205:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8397 00000100:00100000:2.0:1746143847.822210:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625237248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143847.822218:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143847.822233:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143847.822240:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143847.822257:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849a00/0x87925e4cb73b6831 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127ef expref: 41 pid: 12327 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143847.822269:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143847.822316:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e96050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625237248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.822321:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8397 00000100:00100000:3.0:1746143847.822423:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625237120 00000100:00100000:3.0:1746143847.822427:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625237120 00002000:00100000:3.0:1746143847.822451:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4108287) req@ffff880092b44000 x1830963625237120/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.822459:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44000 with x1830963625237120 ext(3145728->4108287) 00010000:00010000:3.0:1746143847.822465:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.822474:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143847.822479:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b44000 00000100:00100000:3.0:1746143847.822491:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2746 00000100:00100000:3.0:1746143847.822496:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2008:x1830963625237120:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143847.823518:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.823591:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625237376 00000100:00100000:3.0:1746143847.823595:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625237376 00010000:00010000:3.0:1746143847.823610:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.823636:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8398 00000100:00100000:3.0:1746143847.823642:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625237376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.823650:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.823659:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.823671:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.823747:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b681c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127da expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.823761:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.823762:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.823767:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.823774:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.823799:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.823808:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627565056:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.823867:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.832196:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627565056:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.832213:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.832261:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2010:x1830963625237376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8617us (8744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.832270:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8398 00000100:00100000:1.0:1746143847.833878:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.834008:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625237632 00000100:00100000:3.0:1746143847.834018:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625237632 00002000:00100000:3.0:1746143847.834063:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1777664->1781759) req@ffff88012e358a80 x1830963625237632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.834074:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963625237632 ext(1777664->1781759) 00002000:00010000:3.0:1746143847.834079:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358a80 00000100:00100000:3.0:1746143847.834102:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7488 00000100:00100000:3.0:1746143847.834108:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625237632:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.834250:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2009:x1830963625237632:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 141us (379us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143847.834257:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7488 00002000:00100000:3.0:1746143847.834263:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1777664->1781759) req@ffff88012e358a80 x1830963625237632/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.834271:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358a80 with x1830963625237632 ext(1777664->1781759) 00002000:00010000:3.0:1746143847.834273:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e358a80 00000100:00100000:2.0:1746143847.841002:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625237120:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 18411us (19052us total) trans 17179874059 rc 0/0 00000100:00100000:2.0:1746143847.841016:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2746 00002000:00100000:2.0:1746143847.841032:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4108287) req@ffff880092b44000 x1830963625237120/t17179874059(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.841042:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44000 with x1830963625237120 ext(3145728->4108287) 00010000:00010000:2.0:1746143847.841054:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143847.841072:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143847.841079:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b44000 00000100:00100000:0.0:1746143847.842603:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.842669:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625237760 00000100:00100000:2.0:1746143847.842678:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625237760 00000100:00100000:2.0:1746143847.842841:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17103 00000100:00100000:2.0:1746143847.842849:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+40:3069:x1830963625237760:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143847.842868:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.842886:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412882 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.843122:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.843132:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.843138:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.843140:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.843144:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.843175:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 26 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.843185:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 26 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143847.843198:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627565184:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143847.844052:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.844068:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143847.844078:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627565312:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143847.844165:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.849056:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.849091:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.849125:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.849144:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625237888 00000100:00100000:3.0:1746143847.849155:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625237888 00010000:00010000:3.0:1746143847.849194:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.849231:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8399 00000100:00100000:3.0:1746143847.849238:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625237888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.849251:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.849267:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.849294:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143847.849300:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238016 00000100:00100000:1.0:1746143847.849307:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238016 00010000:00010000:3.0:1746143847.849315:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97000/0x87925e4cb73b68a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4108287) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841285f expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.849332:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.849333:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143847.849337:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238144 00000100:00100000:1.0:1746143847.849338:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238144 00010000:00010000:3.0:1746143847.849339:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.849346:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143847.849360:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17104 00000100:00100000:1.0:1746143847.849367:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963625238016:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143847.849369:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17105 00000100:00100000:3.0:1746143847.849375:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625238144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.849384:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.849388:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.849396:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412890 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.849399:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b6000/0x87925e4cb73b68d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412889 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.849409:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.849410:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.849414:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.849424:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.849432:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408dc00, rc 0) 00000100:00100000:1.0:1746143847.849450:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627565440:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143847.849482:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625238144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.849487:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17105 00000100:00100000:1.0:1746143847.849516:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00010000:00010000:3.0:1746143847.849524:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.849534:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627565568:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.849568:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746143847.851831:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime: 1746143847 -> 1746143848 00002000:00010000:1.0:1746143847.851838:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime: 1746143847 -> 1746143848 00002000:00010000:1.0:1746143847.851840:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime: 1746143847 -> 1746143848 00000100:00100000:1.0:1746143847.851859:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627565440:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143847.851889:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b6000/0x87925e4cb73b68d2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412889 expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.851901:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b6000/0x87925e4cb73b68d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412889 expref: 28 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143847.851941:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6000, rc 0) 00000100:00100000:1.0:1746143847.851976:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963625238016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2609us (2883us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143847.851984:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17104 00000100:00100000:0.0:1746143847.852112:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627565184:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143847.852121:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627565312:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143847.852141:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->1179647] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.852153:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96200, rc 0) 00000100:00100000:0.0:1746143847.852171:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:3069:x1830963625237760:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9324us (9574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143847.852177:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17103 00000100:00100000:3.0:1746143847.853779:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627565568:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.853797:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.854506:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625237888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5266us (5457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.854517:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8399 00000100:00100000:0.0:1746143847.854795:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.854863:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238400 00000100:00100000:3.0:1746143847.854869:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238400 00010000:00010000:3.0:1746143847.854894:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.855401:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8400 00000100:00100000:3.0:1746143847.855409:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625238400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.855422:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.855441:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.855462:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.855483:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28a00/0x87925e4cb73b6807 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127c5 expref: 41 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.855497:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.855535:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625238400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 128us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.855541:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8400 00000100:00100000:0.0:1746143847.856778:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.856866:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.857012:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238272 00000100:00100000:3.0:1746143847.857020:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238272 00010000:00010000:3.0:1746143847.857040:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 27 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.857061:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8401 00000100:00100000:3.0:1746143847.857067:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625238272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.857076:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.857087:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 27 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.857096:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 27 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.857113:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b682a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e8 expref: 27 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.857126:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.857128:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.857135:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.857143:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.857171:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.857182:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627565696:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143847.857302:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238656 00000100:00100000:2.0:1746143847.857313:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238656 00002000:00100000:2.0:1746143847.857360:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880095cb5f80 x1830963625238656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.857371:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5f80 with x1830963625238656 ext(2097152->3145727) 00002000:00010000:2.0:1746143847.857376:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5f80 00000100:00100000:2.0:1746143847.857405:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7489 00000100:00100000:2.0:1746143847.857412:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625238656:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.858470:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.859036:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.859644:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238784 00000100:00100000:0.0:1746143847.859652:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238784 00000100:00100000:0.0:1746143847.859693:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17106 00000100:00100000:0.0:1746143847.859700:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3073:x1830963625238784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143847.859716:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143847.859732:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412897 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.859757:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.859764:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143847.859766:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143847.859769:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.859794:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 39 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.859804:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 39 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143847.859814:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627565824:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143847.860376:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.862945:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627565696:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.862968:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.863025:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625238272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5956us (6254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.863036:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8401 00000100:00100000:0.0:1746143847.863375:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627565824:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143847.863398:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 27 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143847.863415:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466a00, rc 0) 00000100:00100000:0.0:1746143847.863437:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3073:x1830963625238784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3738us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143847.863444:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17106 00000100:00100000:0.0:1746143847.865161:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.865198:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.865745:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625238912 00000100:00100000:3.0:1746143847.865757:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625238912 00002000:00100000:3.0:1746143847.865810:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1777664->2097151) req@ffff880095cb7b80 x1830963625238912/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.865821:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7b80 with x1830963625238912 ext(1777664->2097151) 00010000:00010000:3.0:1746143847.865831:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 40 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.865847:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 40 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143847.865853:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb7b80 00000100:00100000:3.0:1746143847.865891:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625239168 00000100:00100000:3.0:1746143847.865894:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625239168 00002000:00100000:3.0:1746143847.865905:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1175552->1179647) req@ffff880095cb4700 x1830963625239168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.865938:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4700 with x1830963625239168 ext(1175552->1179647) 00002000:00010000:3.0:1746143847.865941:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4700 00000100:00100000:3.0:1746143847.865955:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2747 00000100:00100000:3.0:1746143847.865963:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625238912:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143847.866059:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7490 00000100:00100000:1.0:1746143847.866066:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625239168:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143847.866186:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625239168:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 119us (987us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143847.866192:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7490 00002000:00100000:1.0:1746143847.866209:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3be:0x0] (1175552->1179647) req@ffff880095cb4700 x1830963625239168/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/4536 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.866216:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4700 with x1830963625239168 ext(1175552->1179647) 00002000:00010000:1.0:1746143847.866218:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cb4700 00000100:00100000:2.0:1746143847.874194:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625238656:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 16776us (17322us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.874203:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7489 00002000:00100000:2.0:1746143847.874213:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880095cb5f80 x1830963625238656/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.874222:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5f80 with x1830963625238656 ext(2097152->3145727) 00002000:00010000:2.0:1746143847.874227:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cb5f80 00000100:00100000:0.0:1746143847.874522:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625238912:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8559us (9367us total) trans 21474841325 rc 0/0 00000100:00100000:0.0:1746143847.874528:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2747 00002000:00100000:0.0:1746143847.874533:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bd:0x0] (1777664->2097151) req@ffff880095cb7b80 x1830963625238912/t21474841325(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143847.874540:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb7b80 with x1830963625238912 ext(1777664->2097151) 00010000:00010000:0.0:1746143847.874547:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143847.874560:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:0.0:1746143847.874565:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb7b80 00000100:00100000:0.0:1746143847.879547:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.880297:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625239296 00000100:00100000:3.0:1746143847.880308:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625239296 00010000:00010000:3.0:1746143847.880349:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.880780:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8402 00000100:00100000:3.0:1746143847.880790:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625239296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.880806:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.880827:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.880840:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.880863:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b68bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1777664->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841287b expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.880898:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.880900:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.880908:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.880946:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.880981:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.880994:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627565952:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143847.881845:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.881969:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.882369:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625239424 00000100:00100000:1.0:1746143847.882377:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625239424 00000100:00100000:1.0:1746143847.882426:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17107 00000100:00100000:1.0:1746143847.882432:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:3067:x1830963625239424:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.882448:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.882461:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841289e expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.882485:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.882492:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.882494:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.882497:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 43 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.882521:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.882533:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 26 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143847.882542:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627566080:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143847.882583:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.884293:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627565952:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.884315:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.884354:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625239296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3565us (4817us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.884364:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8402 00000100:00100000:0.0:1746143847.886562:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.886690:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625239552 00000100:00100000:2.0:1746143847.886699:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625239552 00002000:00100000:2.0:1746143847.886748:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3088384->3145727) req@ffff880095cb6680 x1830963625239552/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.886757:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6680 with x1830963625239552 ext(3088384->3145727) 00010000:00010000:2.0:1746143847.886765:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 27 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143847.886778:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 27 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143847.886786:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb6680 00000100:00100000:2.0:1746143847.886815:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2748 00000100:00100000:2.0:1746143847.886821:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2010:x1830963625239552:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143847.887030:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627566080:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143847.887057:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 42 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.887076:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7000, rc 0) 00000100:00100000:1.0:1746143847.887100:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:3067:x1830963625239424:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4668us (5258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.887107:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17107 00000100:00100000:0.0:1746143847.887547:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.887634:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625239808 00000100:00100000:3.0:1746143847.887639:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625239808 00002000:00100000:3.0:1746143847.887660:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800921ced80 x1830963625239808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.887673:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ced80 with x1830963625239808 ext(1048576->2097151) 00002000:00010000:3.0:1746143847.887677:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921ced80 00000100:00100000:3.0:1746143847.887691:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7491 00000100:00100000:3.0:1746143847.887696:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625239808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143847.899282:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625239808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11484us (11633us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.899357:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7491 00002000:00100000:2.0:1746143847.899369:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8800921ced80 x1830963625239808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.899438:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ced80 with x1830963625239808 ext(1048576->2097151) 00002000:00010000:2.0:1746143847.899518:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921ced80 00000100:00100000:3.0:1746143847.900526:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625239552:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13688us (13957us total) trans 21474841326 rc 0/0 00000100:00100000:3.0:1746143847.900536:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2748 00002000:00100000:3.0:1746143847.900545:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3088384->3145727) req@ffff880095cb6680 x1830963625239552/t21474841326(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.900553:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb6680 with x1830963625239552 ext(3088384->3145727) 00010000:00010000:3.0:1746143847.900563:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.900579:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143847.900585:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb6680 00000100:00100000:0.0:1746143847.905533:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.905682:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625239936 00000100:00100000:3.0:1746143847.905694:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625239936 00010000:00010000:3.0:1746143847.905739:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.905787:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8403 00000100:00100000:3.0:1746143847.905796:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625239936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.905811:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143847.905832:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.905843:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.905866:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96800/0x87925e4cb73b6893 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3088384->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412851 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.905897:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.905900:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.905908:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.905942:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.905976:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.905989:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627566208:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.906080:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143847.907661:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.907743:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625240064 00000100:00100000:1.0:1746143847.907751:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625240064 00000100:00100000:1.0:1746143847.907809:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17108 00000100:00100000:1.0:1746143847.907817:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3073:x1830963625240064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143847.907834:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143847.908031:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128a5 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.908059:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.908066:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.908067:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143847.908070:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.908095:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 41 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.908106:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 41 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143847.908122:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627566336:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143847.908315:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627566208:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.908328:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143847.908433:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143847.908568:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963625239936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2773us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.908578:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8403 00000100:00100000:1.0:1746143847.910694:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e358e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627566336:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143847.910723:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143847.910745:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7600, rc 0) 00000100:00100000:1.0:1746143847.910783:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3073:x1830963625240064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2966us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143847.910791:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17108 00000100:00100000:0.0:1746143847.911136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.911333:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625240192 00000100:00100000:3.0:1746143847.911341:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625240192 00002000:00100000:3.0:1746143847.911381:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1179647) req@ffff8800921cdc00 x1830963625240192/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.911390:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cdc00 with x1830963625240192 ext(1048576->1179647) 00010000:00010000:3.0:1746143847.911397:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.911409:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 42 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143847.911415:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921cdc00 00000100:00100000:3.0:1746143847.911433:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2749 00000100:00100000:3.0:1746143847.911439:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625240192:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143847.912980:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.913004:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625240448 00000100:00100000:0.0:1746143847.913012:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625240448 00002000:00100000:0.0:1746143847.913046:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800921cc700 x1830963625240448/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143847.913056:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963625240448 ext(2097152->4194303) 00002000:00010000:0.0:1746143847.913060:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:0.0:1746143847.913078:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7492 00000100:00100000:0.0:1746143847.913084:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625240448:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143847.915366:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.915390:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625240704 00000100:00100000:1.0:1746143847.915397:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625240704 00002000:00100000:1.0:1746143847.915433:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012e358e00 x1830963625240704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.915444:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358e00 with x1830963625240704 ext(3145728->4194303) 00002000:00010000:1.0:1746143847.915448:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358e00 00000100:00100000:1.0:1746143847.915473:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7493 00000100:00100000:1.0:1746143847.915480:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963625240704:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143847.919626:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625240192:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 8174us (8479us total) trans 21474841327 rc 0/0 00000100:00100000:3.0:1746143847.919641:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2749 00002000:00100000:3.0:1746143847.919653:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1179647) req@ffff8800921cdc00 x1830963625240192/t21474841327(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/448 e 0 to 0 dl 1746143858 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143847.919663:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cdc00 with x1830963625240192 ext(1048576->1179647) 00010000:00010000:3.0:1746143847.919673:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.919691:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143847.919698:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800921cdc00 00000100:00100000:0.0:1746143847.931448:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143847.931721:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625240832 00000100:00100000:3.0:1746143847.931732:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625240832 00010000:00010000:3.0:1746143847.931772:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143847.931990:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8404 00000100:00100000:3.0:1746143847.931999:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963625240832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143847.932050:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143847.932067:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143847 -> 1746143848 00002000:00010000:3.0:1746143847.932070:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143847 -> 1746143848 00010000:00010000:3.0:1746143847.932076:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.932089:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.932113:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96200/0x87925e4cb73b68c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1179647) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412882 expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143847.932130:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.932132:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.932140:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.932147:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.932180:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143847.932192:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627566464:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143847.933211:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143847.934631:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963625240704:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 19145us (19269us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143847.934642:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7493 00002000:00100000:1.0:1746143847.934654:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88012e358e00 x1830963625240704/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.934664:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e358e00 with x1830963625240704 ext(3145728->4194303) 00002000:00010000:1.0:1746143847.934670:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e358e00 00000100:00100000:1.0:1746143847.934771:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625240448:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 21687us (21798us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143847.934777:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7492 00002000:00100000:1.0:1746143847.934782:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800921cc700 x1830963625240448/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.934789:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc700 with x1830963625240448 ext(2097152->4194303) 00002000:00010000:1.0:1746143847.934793:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cc700 00000100:00100000:3.0:1746143847.936355:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627566464:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143847.936374:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143847.936402:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625240832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4405us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.936412:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8404 00000100:00100000:0.0:1746143847.944600:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.944648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143847.944674:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625241216 00000100:00100000:1.0:1746143847.944685:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625241216 00000100:00100000:0.0:1746143847.944692:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:1.0:1746143847.944735:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800921cdf80 x1830963625241216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.944750:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cdf80 with x1830963625241216 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.944756:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cdf80 00000100:00100000:1.0:1746143847.944779:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7494 00000100:00100000:1.0:1746143847.944787:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625241216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143847.945098:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625240960 00000100:00100000:3.0:1746143847.945102:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625240960 00000100:00100000:3.0:1746143847.945125:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625241344 00000100:00100000:3.0:1746143847.945126:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625241344 00000100:00100000:3.0:1746143847.945140:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17109 00000100:00100000:3.0:1746143847.945144:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625240960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.945154:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.945171:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128ac expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.945190:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.945192:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.945200:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.945215:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.945225:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c600, rc 0) 00000100:00100000:3.0:1746143847.945266:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963625240960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 120us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.945271:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17109 00000100:00100000:3.0:1746143847.945297:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17110 00000100:00100000:3.0:1746143847.945301:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625241344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143847.945306:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143847.945311:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128b3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143847.945319:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.945320:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143847.945323:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.945330:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 45 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143847.945336:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ca00, rc 0) 00000100:00100000:3.0:1746143847.945347:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963625241344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 47us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143847.945355:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17110 00000100:00100000:0.0:1746143847.950090:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.950381:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625241600 00000100:00100000:2.0:1746143847.950394:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625241600 00002000:00100000:2.0:1746143847.950448:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800921ce680 x1830963625241600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.950458:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce680 with x1830963625241600 ext(4194304->4853759) 00002000:00010000:2.0:1746143847.950463:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921ce680 00000100:00100000:2.0:1746143847.950507:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7495 00000100:00100000:2.0:1746143847.950515:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625241600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143847.951550:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625241216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6761us (6959us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143847.951561:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7494 00002000:00100000:1.0:1746143847.951570:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff8800921cdf80 x1830963625241216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.951579:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cdf80 with x1830963625241216 ext(1048576->2097151) 00002000:00010000:1.0:1746143847.951584:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800921cdf80 00000100:00100000:2.0:1746143847.957454:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625241600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6929us (7360us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143847.957466:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7495 00002000:00100000:2.0:1746143847.957478:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800921ce680 x1830963625241600/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.957488:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921ce680 with x1830963625241600 ext(4194304->4853759) 00002000:00010000:2.0:1746143847.957498:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921ce680 00000100:00100000:0.0:1746143847.965203:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.965322:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625241856 00000100:00100000:2.0:1746143847.965332:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625241856 00002000:00100000:2.0:1746143847.965381:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800921cc000 x1830963625241856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.965392:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc000 with x1830963625241856 ext(2097152->3145727) 00002000:00010000:2.0:1746143847.965398:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc000 00000100:00100000:2.0:1746143847.965432:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7496 00000100:00100000:2.0:1746143847.965440:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625241856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143847.972656:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625241856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7202us (7451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143847.972674:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7496 00002000:00100000:2.0:1746143847.972775:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8800921cc000 x1830963625241856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.972785:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cc000 with x1830963625241856 ext(2097152->3145727) 00002000:00010000:2.0:1746143847.972791:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cc000 00000100:00100000:0.0:1746143847.977196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.977293:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625241984 00000100:00100000:2.0:1746143847.977304:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625241984 00000100:00100000:2.0:1746143847.977364:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17111 00000100:00100000:2.0:1746143847.977372:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3073:x1830963625241984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143847.977391:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143847.977410:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128ba expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.977438:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.977440:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143847.977447:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.977461:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143847.977472:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fe00, rc 0) 00000100:00100000:2.0:1746143847.977859:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+30:3073:x1830963625241984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 487us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143847.977865:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17111 00010000:00010000:3.0:1746143847.989422:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143847.991343:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143847.991563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143847.991643:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625242240 00000100:00100000:1.0:1746143847.991644:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625242496 00000100:00100000:2.0:1746143847.991652:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625242240 00000100:00100000:1.0:1746143847.991652:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625242496 00002000:00100000:2.0:1746143847.991698:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880093f6ad80 x1830963625242240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143847.991698:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093f69f80 x1830963625242496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/0 e 0 to 0 dl 1746143858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143847.991708:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6ad80 with x1830963625242240 ext(2097152->4194303) 00002000:00100000:1.0:1746143847.991708:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69f80 with x1830963625242496 ext(3145728->4194303) 00002000:00010000:2.0:1746143847.991713:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6ad80 00002000:00010000:1.0:1746143847.991713:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69f80 00000100:00100000:2.0:1746143847.991745:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7497 00000100:00100000:2.0:1746143847.991753:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625242240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143847.991892:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7498 00000100:00100000:1.0:1746143847.991897:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963625242496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143848.002837:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2009:x1830963625242496:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10925us (11260us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143848.002851:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7498 00002000:00100000:1.0:1746143848.002866:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093f69f80 x1830963625242496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143848.002875:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69f80 with x1830963625242496 ext(3145728->4194303) 00002000:00010000:1.0:1746143848.002881:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69f80 00000100:00100000:2.0:1746143848.011229:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625242240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 19465us (19885us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143848.011243:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7497 00002000:00100000:2.0:1746143848.011255:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880093f6ad80 x1830963625242240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:243/0 lens 488/440 e 0 to 0 dl 1746143858 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.011270:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6ad80 with x1830963625242240 ext(2097152->4194303) 00002000:00010000:2.0:1746143848.011286:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6ad80 00000100:00100000:0.0:1746143848.022844:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.022937:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625242752 00000100:00100000:2.0:1746143848.022948:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625242752 00000100:00080000:0.0:1746143848.022977:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1746143848.023002:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f69c00 x1830963625242752/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.023012:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69c00 with x1830963625242752 ext(4194304->4853759) 00002000:00010000:2.0:1746143848.023017:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69c00 00000100:00100000:2.0:1746143848.023050:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7499 00000100:00100000:2.0:1746143848.023059:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625242752:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143848.035140:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625242752:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12070us (12295us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143848.035155:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7499 00002000:00100000:2.0:1746143848.035168:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f69c00 x1830963625242752/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.035178:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f69c00 with x1830963625242752 ext(4194304->4853759) 00002000:00010000:2.0:1746143848.035184:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f69c00 00000100:00100000:0.0:1746143848.078193:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.078358:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625242880 00000100:00100000:3.0:1746143848.078372:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625242880 00000100:00100000:3.0:1746143848.079149:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17112 00000100:00100000:3.0:1746143848.079158:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3079:x1830963625242880:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143848.079178:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.079197:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128c1 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.079227:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.079236:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.079242:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.079243:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.079247:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1863680->2097151] (req 1863680->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.079284:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.079294:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.079312:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627566592:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.080544:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.082333:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.082351:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627566720:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.083826:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.084732:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.084806:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627566592:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.084849:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625243008 00000100:00100000:2.0:1746143848.084856:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625243008 00010000:00010000:2.0:1746143848.084892:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.085234:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8405 00000100:00100000:2.0:1746143848.085245:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625243008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.085262:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.085302:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.085315:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.085339:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d848600/0x87925e4cb73b6838 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127f6 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.087471:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.087555:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625243008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2309us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.087565:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8405 00000100:00100000:1.0:1746143848.088183:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.088292:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625243136 00000100:00100000:2.0:1746143848.088300:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625243136 00010000:00010000:2.0:1746143848.088328:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.088360:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8406 00000100:00100000:2.0:1746143848.088366:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625243136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.088380:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.088399:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.088410:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.088432:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.088434:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.088442:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.088451:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.088482:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.088495:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627566848:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143848.088958:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143848.088962:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96e00/0x87925e4cb73b6823 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127e1 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.088983:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627566720:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.089015:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.089026:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717a00, rc 0) 00000100:00100000:3.0:1746143848.089071:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3079:x1830963625242880:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9914us (10892us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.089078:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17112 00000100:00100000:2.0:1746143848.090756:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627566848:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143848.090771:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.090800:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963625243136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2433us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.090809:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8406 00000100:00100000:1.0:1746143848.092111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.092182:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625243392 00000100:00100000:2.0:1746143848.092190:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625243392 00002000:00100000:2.0:1746143848.092241:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1863680->1867775) req@ffff88012e35b100 x1830963625243392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.092257:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b100 with x1830963625243392 ext(1863680->1867775) 00002000:00010000:2.0:1746143848.092261:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35b100 00000100:00100000:2.0:1746143848.092290:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7500 00000100:00100000:2.0:1746143848.092298:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625243392:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.092465:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625243392:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 165us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.092472:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7500 00002000:00100000:2.0:1746143848.092479:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1863680->1867775) req@ffff88012e35b100 x1830963625243392/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.092505:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35b100 with x1830963625243392 ext(1863680->1867775) 00002000:00010000:2.0:1746143848.092509:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35b100 00000100:00100000:0.0:1746143848.098584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.098720:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625243520 00000100:00100000:3.0:1746143848.098728:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625243520 00000100:00100000:3.0:1746143848.098781:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17113 00000100:00100000:3.0:1746143848.098788:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3079:x1830963625243520:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143848.098802:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.098817:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128c8 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.098840:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.098848:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.098853:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.098854:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.098857:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2183167] (req 2097152->2183167) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.098883:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.098892:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.098902:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627566976:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.099020:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 44 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.099032:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 44 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.099039:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627567104:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.099055:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.109444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.109966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.110343:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627566976:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.110360:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627567104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.110396:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2183167] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 29 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.110418:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e0de00, rc 0) 00000100:00100000:3.0:1746143848.110505:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3079:x1830963625243520:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 11714us (11925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.110515:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17113 00000100:00100000:1.0:1746143848.110629:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625243648 00000100:00100000:1.0:1746143848.110639:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625243648 00010000:00010000:1.0:1746143848.110676:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.110724:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625243776 00000100:00100000:1.0:1746143848.110729:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625243776 00010000:00010000:1.0:1746143848.110744:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.110767:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8407 00000100:00100000:1.0:1746143848.110775:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625243648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.110789:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.110815:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.110826:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.110851:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408dc00/0x87925e4cb73b68cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412890 expref: 29 pid: 1945 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.110871:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.110897:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625243648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.110903:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8407 00000100:00100000:2.0:1746143848.110948:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8408 00000100:00100000:2.0:1746143848.110967:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963625243776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.110983:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.111006:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.111019:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.111039:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96600/0x87925e4cb73b68b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412874 expref: 45 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.111061:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.111064:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.111069:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.111080:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.111110:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.111121:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627567232:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143848.111188:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800821990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.114146:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627567232:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143848.114173:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.114243:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625243776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3281us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.114255:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8408 00000100:00100000:0.0:1746143848.114695:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.114747:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244032 00000100:00100000:2.0:1746143848.114753:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244032 00002000:00100000:2.0:1746143848.114788:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2179072->2183167) req@ffff88009eb84700 x1830963625244032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.114798:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84700 with x1830963625244032 ext(2179072->2183167) 00002000:00010000:2.0:1746143848.114802:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb84700 00000100:00100000:2.0:1746143848.115186:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7501 00000100:00100000:2.0:1746143848.115193:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625244032:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.115324:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625244032:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 131us (633us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.115333:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7501 00002000:00100000:2.0:1746143848.115338:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2179072->2183167) req@ffff88009eb84700 x1830963625244032/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.115345:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb84700 with x1830963625244032 ext(2179072->2183167) 00002000:00010000:2.0:1746143848.115347:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb84700 00000100:00100000:0.0:1746143848.130462:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.130661:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244160 00000100:00100000:3.0:1746143848.130672:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244160 00000100:00100000:3.0:1746143848.130727:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17114 00000100:00100000:3.0:1746143848.130736:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:3077:x1830963625244160:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143848.130756:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.130776:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128cf expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.130808:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.130820:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.130827:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.130829:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.130832:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3551232->4194303] (req 3551232->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 46 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.130865:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 29 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.130877:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.130890:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627567360:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.131529:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.131537:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.131545:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627567488:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.131569:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.134266:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627567360:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.134289:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627567488:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.134323:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3551232->4194303] (req 3551232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 46 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.134341:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717e00, rc 0) 00000100:00100000:3.0:1746143848.134381:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+46:3077:x1830963625244160:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3646us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.134389:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17114 00000100:00100000:0.0:1746143848.137892:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.138131:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.139319:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244288 00000100:00100000:3.0:1746143848.139330:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244288 00010000:00010000:3.0:1746143848.139384:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.139410:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244416 00000100:00100000:3.0:1746143848.139413:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244416 00010000:00010000:3.0:1746143848.139426:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.139442:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8409 00000100:00100000:3.0:1746143848.139450:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2009:x1830963625244288:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.139466:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.139488:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.139498:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.139526:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b68fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ba expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.139546:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.139590:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2009:x1830963625244288:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 141us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.139596:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8409 00000100:00100000:3.0:1746143848.139611:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8410 00000100:00100000:3.0:1746143848.139615:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625244416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.139621:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.139626:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.139633:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.139643:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7000/0x87925e4cb73b68e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841289e expref: 46 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.139650:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.139651:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.139658:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.139665:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.139693:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.139704:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627567616:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143848.139747:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00080000:0.0:1746143848.139979:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143848.141337:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.141421:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627567616:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143848.141437:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.141461:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963625244416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1844us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.141468:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8410 00000100:00100000:1.0:1746143848.141662:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244672 00000100:00100000:1.0:1746143848.141669:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244672 00002000:00100000:1.0:1746143848.141706:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3551232->3555327) req@ffff88011e30a300 x1830963625244672/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143848.141715:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a300 with x1830963625244672 ext(3551232->3555327) 00002000:00010000:1.0:1746143848.141719:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e30a300 00000100:00100000:1.0:1746143848.141747:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7502 00000100:00100000:1.0:1746143848.141753:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963625244672:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143848.141880:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963625244672:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 126us (546us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143848.141890:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7502 00002000:00100000:1.0:1746143848.141895:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3551232->3555327) req@ffff88011e30a300 x1830963625244672/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143848.141904:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30a300 with x1830963625244672 ext(3551232->3555327) 00002000:00010000:1.0:1746143848.141907:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e30a300 00000100:00100000:0.0:1746143848.147844:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.148058:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244800 00000100:00100000:3.0:1746143848.148068:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244800 00000100:00100000:3.0:1746143848.148187:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17115 00000100:00100000:3.0:1746143848.148196:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:3077:x1830963625244800:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143848.148216:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.148235:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128d6 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.148264:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.148281:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.148283:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.148287:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4194304->4431871] (req 4194304->4431871) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.148322:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 27 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.148332:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 27 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.148345:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627567744:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.148804:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.150267:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627567744:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.150305:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4194304->4431871] (req 4194304->4431871) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 45 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.150321:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093717800, rc 0) 00000100:00100000:3.0:1746143848.150360:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+45:3077:x1830963625244800:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2164us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.150368:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17115 00000100:00100000:0.0:1746143848.150874:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.151390:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625244928 00000100:00100000:2.0:1746143848.151398:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625244928 00002000:00100000:2.0:1746143848.151440:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2183167) req@ffff88011e30b100 x1830963625244928/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.151450:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b100 with x1830963625244928 ext(2097152->2183167) 00010000:00010000:2.0:1746143848.151457:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.151469:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143848.151475:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e30b100 00000100:00100000:2.0:1746143848.151497:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2750 00000100:00100000:2.0:1746143848.151504:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625244928:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143848.155002:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625244928:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 3490us (4120us total) trans 17179874060 rc 0/0 00000100:00100000:2.0:1746143848.155014:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2750 00002000:00100000:2.0:1746143848.155025:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2183167) req@ffff88011e30b100 x1830963625244928/t17179874060(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.155039:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e30b100 with x1830963625244928 ext(2097152->2183167) 00010000:00010000:2.0:1746143848.155047:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.155062:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143848.155068:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e30b100 00000100:00100000:0.0:1746143848.158513:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.158637:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625245056 00000100:00100000:3.0:1746143848.158647:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625245056 00010000:00010000:3.0:1746143848.158688:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.159255:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8411 00000100:00100000:3.0:1746143848.159264:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963625245056:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.159289:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.159312:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.159325:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.159349:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b690a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c8 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.159377:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.159379:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.159386:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.159394:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.159434:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.159447:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627567872:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143848.159535:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.161173:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627567872:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143848.161191:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.161224:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625245056:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1962us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.161234:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8411 00000100:00100000:0.0:1746143848.164080:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.164335:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625245312 00000100:00100000:2.0:1746143848.164345:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625245312 00002000:00100000:2.0:1746143848.164394:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4427776->4431871) req@ffff88011e308a80 x1830963625245312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.164404:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308a80 with x1830963625245312 ext(4427776->4431871) 00002000:00010000:2.0:1746143848.164409:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308a80 00000100:00100000:2.0:1746143848.164443:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7503 00000100:00100000:2.0:1746143848.164451:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963625245312:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.164605:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963625245312:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 154us (535us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.164612:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7503 00002000:00100000:2.0:1746143848.164618:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39f:0x0] (4427776->4431871) req@ffff88011e308a80 x1830963625245312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.164625:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308a80 with x1830963625245312 ext(4427776->4431871) 00002000:00010000:2.0:1746143848.164628:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308a80 00000100:00100000:0.0:1746143848.173826:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.173899:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625245440 00000100:00100000:1.0:1746143848.173946:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625245440 00000100:00100000:1.0:1746143848.174023:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14110 00000100:00100000:1.0:1746143848.174031:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3082:x1830963625245440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143848.174059:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143848.174079:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b691f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128dd expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.174144:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.174157:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.174167:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.174181:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.174186:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.174194:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00080000:0.0:1746143848.174398:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746143848.175266:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.175298:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.175304:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.175309:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.175343:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.175354:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 28 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.175366:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568000:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143848.178040:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143848.179015:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.179044:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 286 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.179059:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568128:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.181811:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625245696 00000100:00100000:2.0:1746143848.181823:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625245696 00000100:00100000:0.0:1746143848.181845:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.182018:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625245952 00000100:00100000:1.0:1746143848.182022:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625245952 00000100:00100000:1.0:1746143848.182072:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5499 00000100:00080000:0.0:1746143848.182077:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143848.182079:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+287:30523:x1830963625245952:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143848.182081:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5500 00000100:00100000:2.0:1746143848.182086:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:26342:x1830963625245696:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746143848.182262:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:26342:x1830963625245696:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 176us (4230us total) trans 8589945208 rc 0/0 00000100:00100000:1.0:1746143848.182262:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7448e42d-373a-41e0-9678-9a18291c6700+288:30523:x1830963625245952:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 183us (424us total) trans 8589945207 rc 0/0 00000100:00100000:2.0:1746143848.182268:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5500 00000100:00100000:1.0:1746143848.182279:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5499 00000100:00100000:0.0:1746143848.182418:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.182451:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e35ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568000:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143848.182459:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568128:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143848.182492:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:0.0:1746143848.183468:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.183848:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246080 00000100:00100000:3.0:1746143848.183854:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246080 00010000:00010000:3.0:1746143848.183882:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 30 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.183941:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8412 00000100:00100000:3.0:1746143848.183947:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625246080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.183958:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.183964:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 30 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.183973:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 30 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.183989:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ce00/0x87925e4cb73b67dd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484127a2 expref: 30 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.184015:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.184018:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.184025:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.184029:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.184034:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.184075:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625246080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 128us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.184083:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8412 00000100:00100000:0.0:1746143848.184263:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.184553:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246208 00000100:00100000:3.0:1746143848.184557:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246208 00010000:00010000:3.0:1746143848.184570:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.184594:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8413 00000100:00100000:3.0:1746143848.184600:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:2009:x1830963625246208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.184605:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.184609:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.184617:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.184627:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3be00/0x87925e4cb73b6790 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412763 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.184636:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.184638:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.184644:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.184651:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.184671:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.184690:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:2009:x1830963625246208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 91us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.184696:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8413 00010000:00010000:0.0:1746143848.184736:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184745:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143848.184807:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:0.0:1746143848.184812:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143848.184831:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184843:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184854:0:10936:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184860:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184865:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184871:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184875:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143848.184879:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184885:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184896:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143848.184899:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143848.184902:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184906:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634200/0x87925e4cb73b6926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184957:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184963:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184967:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184971:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143848.184973:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184978:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184984:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600bc00) 00010000:00010000:0.0:1746143848.184986:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143848.184988:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.184992:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f634800/0x87925e4cb73b692d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.185025:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635400/0x87925e4cb73b691f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.185039:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 13 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.185045:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.185047:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143848.185049:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635800, rc 0) 00000100:00100000:0.0:1746143848.185085:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:3082:x1830963625245440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 11056us (11269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.185093:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14110 00000100:00100000:0.0:1746143848.191118:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.191156:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.191182:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.191307:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246464 00000100:00100000:0.0:1746143848.191311:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.191315:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246464 00000100:00100000:0.0:1746143848.191332:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.191364:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246720 00000100:00100000:2.0:1746143848.191367:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246720 00000100:00080000:1.0:1746143848.191375:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143848.191378:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143848.191382:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246336 00000100:00100000:2.0:1746143848.191384:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246336 00000100:00100000:2.0:1746143848.191392:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246592 00000100:00100000:2.0:1746143848.191394:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246592 00000100:00100000:2.0:1746143848.191400:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625246848 00000100:00100000:2.0:1746143848.191401:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625246848 00000100:00100000:1.0:1746143848.191405:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17116 00000100:00100000:1.0:1746143848.191415:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625246464:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143848.191431:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143848.191445:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128eb expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.191463:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.191465:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.191473:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 14 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.191486:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 14 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.191494:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634000, rc 0) 00000100:00100000:1.0:1746143848.191530:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625246464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 119us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.191672:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17117 00000100:00100000:0.0:1746143848.191677:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17118 00000100:00100000:2.0:1746143848.191678:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625246720:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:0.0:1746143848.191682:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625246336:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.191685:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143848.191687:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.191694:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880124512400/0x87925e4cb73b6949 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128f9 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.191694:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128e4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.191703:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.191705:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.191709:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143848.191717:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143848.191723:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24000, rc 0) 00000100:00100000:2.0:1746143848.191726:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627568256:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143848.191740:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625246336:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 58us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.191745:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17118 00000100:00100000:0.0:1746143848.191758:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17119 00000100:00100000:2.0:1746143848.191760:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122666900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.191762:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625246592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143848.191767:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143848.191772:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b6950 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484128f2 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.191773:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17120 00000100:00100000:2.0:1746143848.191777:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625246848:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.191782:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.191787:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73b6957 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412900 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143848.191790:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627568384:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143848.191805:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627568512:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143848.191807:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.191820:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143848.192992:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17116 00002000:00010000:1.0:1746143848.195711:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143847 -> 1746143848 00002000:00010000:1.0:1746143848.195717:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143847 -> 1746143848 00002000:00010000:1.0:1746143848.195719:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143847 -> 1746143848 00000100:00100000:3.0:1746143848.195738:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627568512:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143848.195738:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627568384:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143848.195763:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73b6957 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412900 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.195763:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b6950 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128f2 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.195775:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880124512a00/0x87925e4cb73b6957 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412900 expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.195775:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b6950 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128f2 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.195784:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512a00, rc 0) 00010000:00010000:1.0:1746143848.195786:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00000100:00100000:1.0:1746143848.195817:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625246592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4053us (4504us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143848.195825:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17119 00000100:00100000:2.0:1746143848.195869:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627568256:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143848.195885:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880124512400/0x87925e4cb73b6949 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128f9 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.195892:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880124512400/0x87925e4cb73b6949 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128f9 expref: 13 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.195901:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880124512400, rc 0) 00000100:00100000:3.0:1746143848.195959:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625246848:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4180us (4625us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143848.195965:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17120 00000100:00100000:2.0:1746143848.196016:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625246720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4337us (4858us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143848.196021:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17117 00000100:00100000:0.0:1746143848.199536:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.199683:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247104 00000100:00100000:2.0:1746143848.199693:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247104 00000100:00100000:2.0:1746143848.199746:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14111 00000100:00100000:2.0:1746143848.199754:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:3082:x1830963625247104:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.199771:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.199787:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b695e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412907 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.199864:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.199875:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.199882:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.199906:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.199950:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 14 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.199960:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568640:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.200032:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.204219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.204290:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247232 00000100:00100000:3.0:1746143848.204296:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247232 00010000:00010000:3.0:1746143848.204324:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 15 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.204361:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8414 00000100:00100000:3.0:1746143848.204368:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625247232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.204379:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.204384:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 15 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.204392:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 15 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.204415:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.204419:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.204427:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.204432:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.204445:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.204475:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625247232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.204481:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8414 00010000:00010000:3.0:1746143848.204517:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88007f635800/0x87925e4cb73b6934 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128dd expref: 14 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.204529:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568640:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.204542:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.204548:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.204553:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:3.0:1746143848.204567:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143848.204659:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b695e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 15 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.204674:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.204679:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.204681:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143848.204683:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5200, rc 0) 00000100:00100000:3.0:1746143848.204703:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3082:x1830963625247104:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4951us (5328us total) trans 8589945209 rc 0/0 00000100:00100000:3.0:1746143848.204708:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14111 00000100:00100000:0.0:1746143848.209536:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.209607:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247360 00000100:00100000:2.0:1746143848.209615:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247360 00000100:00100000:2.0:1746143848.209654:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14112 00000100:00100000:2.0:1746143848.209661:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3082:x1830963625247360:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.209680:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.209696:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73b6973 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841290e expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.209763:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.209775:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 15 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.209781:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.209809:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 15 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.209819:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 15 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.209829:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568768:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.209898:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.213990:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.214074:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627568768:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143848.214094:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143848.215660:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247488 00000100:00100000:1.0:1746143848.215668:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247488 00010000:00010000:1.0:1746143848.215698:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 16 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.215734:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8415 00000100:00100000:1.0:1746143848.215741:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625247488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.215752:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.215756:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 16 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.215767:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 16 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.215790:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6965 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412907 expref: 16 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.215814:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.215818:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.215826:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.215833:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.215860:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.215897:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625247488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 156us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.215903:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8415 00010000:00010000:0.0:1746143848.215960:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.215966:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:0.0:1746143848.216004:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:0.0:1746143848.216008:0:10936:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143848.216022:0:10936:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143848.216045:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428e00/0x87925e4cb73b6973 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841290e expref: 15 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.216070:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841290e expref: 14 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.216080:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.216082:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143848.216084:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:0.0:1746143848.216105:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3082:x1830963625247360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6446us (6576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.216111:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14112 00000100:00100000:0.0:1746143848.222015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.222078:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247616 00000100:00100000:2.0:1746143848.222086:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247616 00000100:00100000:2.0:1746143848.222130:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17121 00000100:00100000:2.0:1746143848.222137:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625247616:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.222153:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.222165:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429a00/0x87925e4cb73b6981 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412915 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.222209:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627568896:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143848.222292:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.222627:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.222662:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.222699:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247744 00000100:00100000:1.0:1746143848.222703:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247744 00000100:00100000:1.0:1746143848.222732:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625247872 00000100:00100000:1.0:1746143848.222734:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625247872 00000100:00100000:1.0:1746143848.222757:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17122 00000100:00100000:1.0:1746143848.222762:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625247744:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143848.222769:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143848.222777:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635800/0x87925e4cb73b6988 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841291c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.222799:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627569024:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143848.222826:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.222874:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17123 00000100:00100000:2.0:1746143848.222880:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625247872:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.222887:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.222895:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b698f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412923 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.222933:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627569152:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143848.222961:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.225100:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627568896:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143848.225122:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429a00/0x87925e4cb73b6981 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412915 expref: 15 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.225132:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d429a00/0x87925e4cb73b6981 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412915 expref: 15 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143848.225188:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627569152:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143848.225199:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b698f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412923 expref: 14 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.225207:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d429600/0x87925e4cb73b698f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412923 expref: 14 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.225221:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429600, rc 0) 00000100:00100000:3.0:1746143848.225248:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625247872:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2368us (2585us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143848.225254:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17123 00010000:00010000:2.0:1746143848.225465:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429a00, rc 0) 00000100:00100000:2.0:1746143848.225485:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2010:x1830963625247616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3349us (3477us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143848.225489:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17121 00000100:00100000:1.0:1746143848.227424:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627569024:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143848.227448:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635800/0x87925e4cb73b6988 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841291c expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.227459:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635800/0x87925e4cb73b6988 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841291c expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.227479:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635800, rc 0) 00000100:00100000:1.0:1746143848.227517:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625247744:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4754us (4889us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143848.227523:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17122 00000100:00100000:0.0:1746143848.230804:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.230962:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248128 00000100:00100000:2.0:1746143848.230969:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248128 00000100:00100000:2.0:1746143848.231002:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14113 00000100:00100000:2.0:1746143848.231008:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3082:x1830963625248128:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143848.231023:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.231037:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6996 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841292a expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.231111:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b699d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.231121:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b699d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.231129:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b699d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143848.231141:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143848.231205:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6996 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841292a expref: 17 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.231232:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b699d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841292a expref: 16 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.231238:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.231240:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143848.231243:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429a00, rc 0) 00000100:00100000:2.0:1746143848.231294:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:3082:x1830963625248128:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 286us (496us total) trans 8589945210 rc 0/0 00000100:00100000:2.0:1746143848.231300:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14113 00000100:00100000:0.0:1746143848.233493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.233528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.233553:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.233574:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.233588:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.233613:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248384 00000100:00100000:0.0:1746143848.233622:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248384 00000100:00100000:0.0:1746143848.233661:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248640 00000100:00100000:0.0:1746143848.233664:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248640 00000100:00100000:0.0:1746143848.233675:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248896 00000100:00100000:0.0:1746143848.233677:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248896 00000100:00100000:0.0:1746143848.233687:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248256 00000100:00100000:0.0:1746143848.233689:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248256 00000100:00100000:0.0:1746143848.233697:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248512 00000100:00100000:0.0:1746143848.233699:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248512 00000100:00100000:0.0:1746143848.233714:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17124 00000100:00100000:0.0:1746143848.233721:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625248384:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:1.0:1746143848.233736:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17125 00000100:00100000:1.0:1746143848.233752:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625248640:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1746143848.233770:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.233785:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233788:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233795:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.233799:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233803:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.233806:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143848.233807:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143848.233808:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.233810:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233810:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.233812:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.233820:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17126 00000100:00100000:3.0:1746143848.233827:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625248896:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143848.233838:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233838:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.233845:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233850:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 44 pid: 13436 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.233858:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.233862:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.233864:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746143848.233864:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627569280:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.233866:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.233866:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17127 00000100:00100000:2.0:1746143848.233873:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625248256:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143848.233880:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.233886:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.233894:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.233963:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 15 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.234044:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.234051:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 44 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.234060:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.234061:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.234063:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.234081:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 44 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.234139:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 28 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.234152:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627569408:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143848.234198:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746143848.234416:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 44 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.234416:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 15 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143848.234417:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 44 pid: 3135 timeout: 1007 lvb_type: 1 00000100:00100000:0.0:1746143848.234426:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627569664:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.234427:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627569536:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.234427:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627569792:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143848.234460:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.234467:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.234572:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627569920:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.234719:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.234735:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17128 00000100:00100000:3.0:1746143848.234742:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625248512:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143848.234758:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.234771:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.234778:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 15 pid: 12328 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143848.234785:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00010000:00010000:3.0:1746143848.234788:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.234788:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 13 pid: 9587 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.234793:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.234794:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.234796:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.234796:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 13 pid: 9587 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143848.234804:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627570048:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.234809:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.234816:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.234822:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627570176:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.234828:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 28 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.234835:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 28 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.234840:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 15 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.234847:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 15 pid: 12328 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143848.234847:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627570304:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.234853:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627570432:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.234857:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00010000:00010000:3.0:1746143848.234868:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.234878:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.234885:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627570560:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.234896:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143848.235282:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.235474:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625248768 00000100:00100000:2.0:1746143848.235479:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625248768 00000100:00100000:2.0:1746143848.235507:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17129 00000100:00100000:2.0:1746143848.235512:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625248768:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143848.235527:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.235536:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.235542:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143848.235543:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143848.235545:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.235559:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.235567:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.235574:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627570688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.235608:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.245364:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627569280:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143848.245365:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.245387:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627569664:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143848.245397:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.245424:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249024 00000100:00100000:0.0:1746143848.245432:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249024 00010000:00010000:0.0:1746143848.245469:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 45 pid: 13436 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.245483:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.245655:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627569536:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.245676:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.245863:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627569792:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143848.245993:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249280 00000100:00100000:0.0:1746143848.245996:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249280 00010000:00010000:0.0:1746143848.246011:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 16 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.246012:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8416 00000100:00100000:1.0:1746143848.246022:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963625249024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.246035:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143848.246041:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8417 00000100:00100000:0.0:1746143848.246048:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2011:x1830963625249280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.246052:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 45 pid: 13436 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143848.246058:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.246063:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 45 pid: 13436 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.246080:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408c600/0x87925e4cb73b68ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128ac expref: 45 pid: 13436 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.246107:0:29555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249152 00000100:00100000:3.0:1746143848.246111:0:29555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249152 00002000:00100000:3.0:1746143848.246140:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1863680->2097151) req@ffff88009322dc00 x1830963625249152/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.246149:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322dc00 with x1830963625249152 ext(1863680->2097151) 00010000:00010000:3.0:1746143848.246157:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 29 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.246166:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 29 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.246172:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322dc00 00000100:00100000:3.0:1746143848.246186:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2751 00000100:00100000:3.0:1746143848.246191:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625249152:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143848.246372:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.246457:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.246468:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249664 00000100:00100000:3.0:1746143848.246470:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249664 00010000:00010000:3.0:1746143848.246482:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.246499:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8418 00000100:00100000:3.0:1746143848.246503:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625249664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.246509:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143848.246533:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627570048:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.246549:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627570304:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.246571:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.246612:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627570688:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.246620:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.246641:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627569408:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.246653:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.246660:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 16 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143848.246671:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 16 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143848.246696:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24000/0x87925e4cb73b6942 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128e4 expref: 16 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:0.0:1746143848.246722:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143848.246751:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625249280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 703us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.246757:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8417 00000100:00100000:0.0:1746143848.246794:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12328:1830963627569920:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143848.246814:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.246928:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.246960:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625249024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 941us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.246969:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8416 00000100:00100000:1.0:1746143848.247010:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247040:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247100:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247112:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247122:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247153:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.247161:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249920 00000100:00100000:1.0:1746143848.247166:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249920 00010000:00010000:1.0:1746143848.247179:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.247189:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250176 00000100:00100000:1.0:1746143848.247191:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250176 00010000:00010000:1.0:1746143848.247197:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 15 pid: 12328 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.247204:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249536 00000100:00100000:1.0:1746143848.247205:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249536 00010000:00010000:1.0:1746143848.247211:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 45 pid: 3135 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.247217:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249792 00000100:00100000:1.0:1746143848.247218:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249792 00010000:00010000:1.0:1746143848.247224:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 15 pid: 9587 timeout: 1007 lvb_type: 1 00000100:00100000:1.0:1746143848.247239:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250048 00000100:00100000:1.0:1746143848.247241:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250048 00010000:00010000:1.0:1746143848.247246:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 31 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.247253:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250304 00000100:00100000:1.0:1746143848.247254:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250304 00010000:00010000:1.0:1746143848.247260:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.247269:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8419 00000100:00100000:1.0:1746143848.247283:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625249920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.247290:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.247299:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.247306:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.247317:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.247333:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625249920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.247338:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8419 00000100:00100000:1.0:1746143848.247347:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8420 00000100:00100000:1.0:1746143848.247352:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625250176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.247360:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.247366:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 15 pid: 12328 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.247372:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 15 pid: 12328 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.247381:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.247392:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625250176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 41us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.247397:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8420 00000100:00100000:1.0:1746143848.247406:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8421 00000100:00100000:1.0:1746143848.247410:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2008:x1830963625249536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.247416:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.247427:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 45 pid: 3135 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.247430:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247435:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 45 pid: 3135 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.247440:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247446:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189dc00/0x87925e4cb73b66a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126d7 expref: 45 pid: 3135 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.247453:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466a00/0x87925e4cb73b68d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412897 expref: 30 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247454:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.247468:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625249536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 57us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143848.247476:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.247478:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143848.247478:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8421 00010000:00010000:3.0:1746143848.247482:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.247490:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.247503:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8422 00000100:00100000:1.0:1746143848.247507:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625249792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.247510:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143848.247512:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.247518:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 15 pid: 9587 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.247521:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247525:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 15 pid: 9587 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.247527:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247535:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b672e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841272b expref: 15 pid: 9587 timeout: 1007 lvb_type: 1 00010000:00010000:1.0:1746143848.247542:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143848.247543:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.247550:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.247554:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625249792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (431us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143848.247558:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.247559:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8422 00010000:00010000:3.0:1746143848.247565:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143848.247568:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.247568:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8423 00000100:00100000:1.0:1746143848.247572:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625250048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.247576:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247577:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.247582:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 31 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.247584:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.247589:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b69ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247589:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 31 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247603:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091381200/0x87925e4cb73b6647 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841269f expref: 31 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247612:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.247613:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.247617:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247624:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247639:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.247642:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625248384:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13921us (14157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.247650:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17124 00000100:00100000:1.0:1746143848.247656:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625250048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.247661:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8423 00000100:00100000:1.0:1746143848.247670:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8424 00000100:00100000:1.0:1746143848.247674:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625250304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143848.247677:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625249664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1173us (1219us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143848.247680:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143848.247682:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8418 00010000:00010000:1.0:1746143848.247687:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 29 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247694:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 28 pid: 12327 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247704:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.247705:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.247707:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247713:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247722:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.247730:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625249408 00000100:00100000:3.0:1746143848.247734:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625249408 00000100:00100000:1.0:1746143848.247739:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625250304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 64us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.247744:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8424 00002000:00100000:3.0:1746143848.247755:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3551232->4194303) req@ffff880091d4ca80 x1830963625249408/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.247762:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ca80 with x1830963625249408 ext(3551232->4194303) 00010000:00010000:3.0:1746143848.247768:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 44 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.247777:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 44 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.247782:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4ca80 00000100:00100000:3.0:1746143848.247799:0:29557:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250432 00000100:00100000:3.0:1746143848.247802:0:29557:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250432 00002000:00100000:3.0:1746143848.247815:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4431871) req@ffff880092b48000 x1830963625250432/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.247822:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48000 with x1830963625250432 ext(4194304->4431871) 00010000:00010000:3.0:1746143848.247826:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.247830:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408ca00/0x87925e4cb73b68f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128b3 expref: 44 pid: 13436 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.247833:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 44 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.247839:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b48000 00000100:00100000:1.0:1746143848.247840:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627570176:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.247850:0:29557:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2752 00010000:00010000:1.0:1746143848.247850:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634000/0x87925e4cb73b693b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128eb expref: 13 pid: 12328 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.247855:0:29557:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625249408:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143848.247856:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627570432:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143848.247864:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913b7600/0x87925e4cb73b68e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128a5 expref: 27 pid: 12327 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.247871:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627570560:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143848.247884:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247890:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247897:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247909:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247935:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247941:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247946:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0b800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143848.247950:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247956:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247966:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.247971:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0b800/0x87925e4cb73b69c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.247984:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2753 00000100:00100000:3.0:1746143848.247989:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2008:x1830963625250432:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143848.248005:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625248512:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13264us (14416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.248012:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17128 00010000:00010000:2.0:1746143848.248214:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248221:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248231:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248236:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248246:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248251:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d428400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143848.248253:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248258:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248265:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.248280:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d428400/0x87925e4cb73b69c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.248317:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625248256:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 14445us (14741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.248323:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17127 00000100:00100000:3.0:1746143848.251702:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963625249152:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5498us (6331us total) trans 17179874061 rc 0/0 00000100:00100000:3.0:1746143848.251716:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2751 00002000:00100000:3.0:1746143848.251729:0:29555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x39e:0x0] (1863680->2097151) req@ffff88009322dc00 x1830963625249152/t17179874061(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.251738:0:29555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322dc00 with x1830963625249152 ext(1863680->2097151) 00010000:00010000:3.0:1746143848.251748:0:29555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.251761:0:29555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.251768:0:29555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009322dc00 00000100:00100000:0.0:1746143848.260295:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.260415:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250560 00000100:00100000:2.0:1746143848.260422:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250560 00010000:00010000:2.0:1746143848.260451:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.260485:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8425 00000100:00100000:2.0:1746143848.260492:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625250560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.260503:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.260519:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.260528:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.260547:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717a00/0x87925e4cb73b6903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1863680->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128c1 expref: 30 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.262943:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.262947:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.262952:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.262962:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.262985:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.263026:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e95050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625250560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2531us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.263035:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8425 00010000:00010000:2.0:1746143848.263080:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263088:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263112:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263119:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263125:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263131:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143848.263134:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263141:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263151:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.263157:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635000/0x87925e4cb73b69b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.263193:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625248640:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 29447us (29664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.263201:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17125 00000100:00100000:3.0:1746143848.264835:0:29557:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:2010:x1830963625249408:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 16969us (18453us total) trans 21474841328 rc 0/0 00000100:00100000:3.0:1746143848.264847:0:29557:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2752 00002000:00100000:3.0:1746143848.264860:0:29557:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x3bf:0x0] (3551232->4194303) req@ffff880091d4ca80 x1830963625249408/t21474841328(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.264876:0:29557:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091d4ca80 with x1830963625249408 ext(3551232->4194303) 00010000:00010000:3.0:1746143848.264887:0:29557:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.264900:0:29557:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.264906:0:29557:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091d4ca80 00000100:00100000:2.0:1746143848.265134:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625250432:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 17144us (18032us total) trans 17179874062 rc 0/0 00000100:00100000:2.0:1746143848.265142:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2753 00002000:00100000:2.0:1746143848.265148:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4431871) req@ffff880092b48000 x1830963625250432/t17179874062(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.265155:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b48000 with x1830963625250432 ext(4194304->4431871) 00010000:00010000:2.0:1746143848.265160:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.265168:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143848.265173:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b48000 00000100:00100000:0.0:1746143848.266668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.266756:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250688 00000100:00100000:2.0:1746143848.266764:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250688 00010000:00010000:2.0:1746143848.266797:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.266819:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8426 00000100:00100000:2.0:1746143848.266826:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2009:x1830963625250688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.266839:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.266857:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.266867:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.266892:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093717800/0x87925e4cb73b6918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4431871) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128d6 expref: 46 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.266907:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.266909:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.266937:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.266946:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.267307:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.267344:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963625250688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 517us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.267351:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8426 00000100:00100000:0.0:1746143848.267654:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.267868:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625250816 00000100:00100000:2.0:1746143848.267872:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625250816 00010000:00010000:2.0:1746143848.267890:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.267905:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8427 00000100:00100000:2.0:1746143848.267926:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+45:2011:x1830963625250816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.267941:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.267955:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.267969:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.267982:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717e00/0x87925e4cb73b6911 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3551232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484128cf expref: 45 pid: 9839 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.267993:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.267995:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.267998:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268004:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268379:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268388:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268407:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268414:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268421:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268427:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7de00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143848.268432:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268444:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268454:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.268459:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7de00/0x87925e4cb73b69ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268567:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.268599:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625250816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 687us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.268605:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8427 00010000:00010000:2.0:1746143848.268632:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268640:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268651:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268661:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268667:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268672:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143848.268675:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268681:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268690:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.268696:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d0a800/0x87925e4cb73b69b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.268734:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625248896:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 34908us (35180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.268742:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17126 00000100:00100000:3.0:1746143848.269052:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625248768:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 33539us (33780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.269059:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17129 00000100:00100000:0.0:1746143848.270622:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.270694:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625251072 00000100:00100000:2.0:1746143848.270703:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625251072 00000100:00100000:2.0:1746143848.270756:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14114 00000100:00100000:2.0:1746143848.270763:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+16:3082:x1830963625251072:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1746143848.270821:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.270844:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b697a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841290e expref: 16 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270859:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.270863:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143848.270888:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143848.270902:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 286 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270908:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270945:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 286 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270952:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270959:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 28 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270965:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270970:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.270980:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 10/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143848.271009:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271021:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 286 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271034:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627570816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.271114:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271470:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271479:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627570944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.271516:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 28 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271523:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 28 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271530:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.271553:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 286 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271563:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 286 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271570:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.271591:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 286 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271597:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 286 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271604:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571328:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.271627:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 28 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271634:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 28 pid: 6587 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271641:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.271668:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 286 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.271675:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 286 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.271681:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571584:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.271717:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.274861:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.274945:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.274970:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.274971:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625251328 00000100:00100000:0.0:1746143848.274982:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.274984:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625251328 00000100:00100000:0.0:1746143848.275000:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625251712 00000100:00100000:0.0:1746143848.275007:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625251712 00010000:00010000:0.0:1746143848.275032:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 29 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.275033:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625251584 00000100:00100000:3.0:1746143848.275036:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625251584 00000100:00100000:0.0:1746143848.275051:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625251968 00000100:00100000:3.0:1746143848.275052:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5501 00000100:00100000:0.0:1746143848.275053:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625251968 00000100:00100000:3.0:1746143848.275060:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:30523:x1830963625251328:12345-192.168.202.3@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746143848.275060:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 288 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.275070:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8428 00000100:00100000:0.0:1746143848.275076:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963625251712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143848.275086:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143848.275091:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 30 pid: 14991 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275100:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 30 pid: 14991 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275118:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.275121:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143848.275129:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143848.275157:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2010:x1830963625251712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.275165:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8428 00000100:00100000:0.0:1746143848.275176:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8429 00000100:00100000:0.0:1746143848.275179:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+288:2010:x1830963625251968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143848.275183:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143848.275186:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 289 pid: 14991 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275192:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 289 pid: 14991 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275200:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.275202:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143848.275206:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143848.275214:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+289:2010:x1830963625251968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.275218:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8429 00000100:00100000:0.0:1746143848.275241:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.275254:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252224 00000100:00100000:0.0:1746143848.275256:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252224 00000100:00100000:3.0:1746143848.275258:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:30523:x1830963625251328:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 199us (403us total) trans 8589945211 rc 0/0 00010000:00010000:0.0:1746143848.275263:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 289 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.275265:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5501 00000100:00100000:0.0:1746143848.275284:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8430 00000100:00100000:0.0:1746143848.275288:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+288:2010:x1830963625252224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143848.275292:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5502 00010000:00010000:0.0:1746143848.275292:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143848.275296:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 288 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.275298:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:30501:x1830963625251584:12345-192.168.202.3@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1746143848.275302:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 288 pid: 14991 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275311:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.275313:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143848.275318:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143848.275330:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+288:2010:x1830963625252224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.275334:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8430 00000100:00100000:3.0:1746143848.275358:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+30:30501:x1830963625251584:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 60us (412us total) trans 8589945212 rc 0/0 00000100:00100000:3.0:1746143848.275365:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5502 00000100:00100000:0.0:1746143848.275369:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.275380:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625251840 00000100:00100000:0.0:1746143848.275382:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625251840 00010000:00010000:0.0:1746143848.275390:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.275403:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8431 00000100:00100000:0.0:1746143848.275407:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+288:2010:x1830963625251840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143848.275414:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143848.275417:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275423:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 288 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.275435:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.275438:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746143848.275442:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143848.277795:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+288:2010:x1830963625251840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2377us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.277806:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8431 00000100:00100000:0.0:1746143848.277907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.278144:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627570816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.278155:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627570944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.278164:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800942a3800/0x87925e4cb73b622d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412437 expref: 29 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.278179:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.278187:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b621f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412429 expref: 287 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.278194:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.278201:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b6211 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841241b expref: 286 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.278208:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571328:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.278215:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.278222:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136e00/0x87925e4cb73b629d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412492 expref: 285 pid: 14991 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.278229:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830963627571584:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.278256:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143848.278284:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252096 00000100:00100000:2.0:1746143848.278289:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252096 00010000:00010000:2.0:1746143848.278310:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 29 pid: 6587 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.278326:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8432 00000100:00100000:2.0:1746143848.278331:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2010:x1830963625252096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.278340:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.278345:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 29 pid: 6587 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.278351:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 29 pid: 6587 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.278367:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800820b2000/0x87925e4cb73b634c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484124f4 expref: 29 pid: 6587 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.278377:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.278380:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143848.278386:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.278411:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2010:x1830963625252096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.278417:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8432 00000100:00100000:0.0:1746143848.282385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.282468:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252480 00000100:00100000:2.0:1746143848.282476:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252480 00010000:00010000:2.0:1746143848.282507:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.282542:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8433 00000100:00100000:2.0:1746143848.282550:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2011:x1830963625252480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.282566:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.282571:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.282580:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.282598:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1000/0x87925e4cb73b6624 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412683 expref: 28 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.282609:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.282614:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143848.282621:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.282651:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625252480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.282657:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8433 00000100:00100000:0.0:1746143848.288591:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.288673:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252352 00000100:00100000:1.0:1746143848.288680:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252352 00010000:00010000:1.0:1746143848.288710:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 285 pid: 7244 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.288742:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8434 00000100:00100000:1.0:1746143848.288747:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2009:x1830963625252352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.288758:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.288762:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 285 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.288772:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 285 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.288789:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090fc3600/0x87925e4cb73b669b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484126c9 expref: 285 pid: 7244 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.288813:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.288817:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143848.288824:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143848.288829:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746143848.288845:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.288876:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+284:2009:x1830963625252352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.288882:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8434 00010000:00010000:2.0:1746143848.288954:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746143848.288961:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000040:00080000:2.0:1746143848.289162:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3302, 88 off278432 00000004:00080000:2.0:1746143848.289168:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513254878ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289196:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3290, 88 off277024 00000004:00080000:2.0:1746143848.289201:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513288824ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289214:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3291, 88 off277112 00000004:00080000:2.0:1746143848.289217:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513304508ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289381:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3304, 88 off278616 00000004:00080000:2.0:1746143848.289386:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513474144ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289398:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3305, 88 off278704 00000004:00080000:2.0:1746143848.289400:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513488404ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289411:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3292, 88 off277200 00000004:00080000:2.0:1746143848.289413:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513501153ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289420:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3293, 88 off277288 00000004:00080000:2.0:1746143848.289422:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513510111ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289429:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3294, 88 off277376 00000004:00080000:2.0:1746143848.289431:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513519086ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289438:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3306, 88 off278792 00000004:00080000:2.0:1746143848.289440:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513528371ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289448:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3295, 88 off277464 00000004:00080000:2.0:1746143848.289450:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513537958ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289457:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3307, 88 off278880 00000004:00080000:2.0:1746143848.289460:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513547621ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289467:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3296, 88 off277552 00000004:00080000:2.0:1746143848.289469:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513556958ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143848.289475:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3308, 88 off278968 00000004:00080000:2.0:1746143848.289477:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513564676ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289483:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3309, 88 off279056 00000004:00080000:2.0:1746143848.289485:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513573224ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289494:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3310, 88 off279144 00000004:00080000:2.0:1746143848.289497:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513584952ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289504:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3311, 88 off279232 00000004:00080000:2.0:1746143848.289506:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907513594233ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143848.289513:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3297, 88 off277640 00000004:00080000:2.0:1746143848.289515:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907513603022ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143848.291195:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945213 is committed 00000004:00080000:2.0:1746143848.291203:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2510 committed 00000004:00080000:2.0:1746143848.291773:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2526 committed 00000004:00080000:2.0:1746143848.291788:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2525 committed 00000004:00080000:2.0:1746143848.291790:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2524 committed 00000004:00080000:2.0:1746143848.291792:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2523 committed 00000004:00080000:2.0:1746143848.291793:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2509 committed 00000100:00100000:0.0:1746143848.291931:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627571712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.291978:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.292009:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627572224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292024:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.292039:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746143848.292043:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627571840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.292051:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627571712 00000100:00100000:0.0:1746143848.292054:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.292063:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627571712 00000100:00100000:0.0:1746143848.292063:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627572352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292072:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.292090:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572224 00000100:00100000:0.0:1746143848.292095:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572224 00000100:00100000:3.0:1746143848.292120:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627571840 00000100:00100000:0.0:1746143848.292120:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572352 00000100:00100000:0.0:1746143848.292122:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572352 00000100:00100000:3.0:1746143848.292123:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627571840 00000100:00100000:0.0:1746143848.292132:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17130 00000100:00100000:0.0:1746143848.292138:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3771:x1830963627571712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.292156:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17131 00000100:00100000:3.0:1746143848.292163:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3771:x1830963627572224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292248:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627571712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (269us total) trans 17179874063 rc 0/0 00000100:00100000:0.0:1746143848.292254:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17130 00000100:00100000:0.0:1746143848.292268:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17132 00000100:00100000:0.0:1746143848.292283:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627572352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.292320:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627572224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (293us total) trans 17179874064 rc 0/0 00000100:00100000:3.0:1746143848.292326:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17131 00000100:00100000:3.0:1746143848.292341:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17133 00000100:00100000:3.0:1746143848.292345:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3771:x1830963627571840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292383:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627572352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (309us total) trans 17179874065 rc 0/0 00000100:00100000:0.0:1746143848.292388:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17132 00000100:00100000:3.0:1746143848.292404:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627571840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (348us total) trans 17179874066 rc 0/0 00000100:00100000:3.0:1746143848.292409:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17133 00000004:00080000:0.0:1746143848.292417:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32680/2, rc 0, transno 17179874066 00000100:00100000:0.0:1746143848.292423:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627571840:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746143848.292425:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746143848.292429:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31880/2, rc 0, transno 17179874065 00000100:00100000:0.0:1746143848.292431:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627572352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.292436:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30700/2, rc 0, transno 17179874063 00000100:00100000:0.0:1746143848.292438:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627571712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.292443:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e31c00/2, rc 0, transno 17179874064 00000100:00100000:0.0:1746143848.292445:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627572224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292478:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627572736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292495:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.292529:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572736 00000100:00100000:0.0:1746143848.292532:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572736 00000100:00100000:0.0:1746143848.292554:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17134 00000100:00100000:0.0:1746143848.292558:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3771:x1830963627572736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.292615:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627572736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (119us total) trans 17179874067 rc 0/0 00000100:00100000:0.0:1746143848.292622:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17134 00000004:00080000:0.0:1746143848.292640:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32300/2, rc 0, transno 17179874067 00000100:00100000:0.0:1746143848.292642:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627572736:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143848.292863:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2522 committed 00000004:00080000:2.0:1746143848.292866:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2508 committed 00000004:00080000:2.0:1746143848.292870:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2521 committed 00000004:00080000:2.0:1746143848.292871:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2507 committed 00000004:00080000:2.0:1746143848.292873:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2506 committed 00000004:00080000:2.0:1746143848.292874:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2505 committed 00000004:00080000:2.0:1746143848.292875:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2520 committed 00000004:00080000:2.0:1746143848.292876:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2519 committed 00000004:00080000:2.0:1746143848.292878:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2504 committed 00000004:00080000:2.0:1746143848.292880:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2503 committed 00000004:00080000:2.0:1746143848.292881:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2518 committed 00000100:00100000:1.0:1746143848.292964:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627572864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.292987:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.293027:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627573248:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1746143848.293089:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945212 is committed 00000001:00080000:2.0:1746143848.293094:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945211 is committed 00000004:00010000:3.0:1746143848.293247:0:7245:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095c30e00 reply state ffff88012d4a5800 transno 8589945213 ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293266:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293283:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.293286:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746143848.293290:0:7245:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746143848.293294:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627573376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.293307:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746143848.293359:0:7245:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143848.293371:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3082:x1830963625251072:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 22606us (22754us total) trans 8589945213 rc 0/0 00000100:00100000:3.0:1746143848.293381:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14114 00010000:00010000:3.0:1746143848.293406:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293413:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293418:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293423:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e7d400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.293426:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293431:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293438:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.293439:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143848.293441:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.293445:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7d400/0x87925e4cb73b69d5 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746143848.293479:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572864 00000100:00100000:3.0:1746143848.293480:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627573376 00000100:00100000:2.0:1746143848.293482:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572864 00000100:00100000:3.0:1746143848.293483:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627573376 00000100:00080000:3.0:1746143848.293506:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746143848.293525:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17135 00000100:00100000:2.0:1746143848.293531:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627573376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.293609:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627573376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (301us total) trans 21474841329 rc 0/0 00000100:00100000:2.0:1746143848.293615:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17135 00000100:00100000:2.0:1746143848.293626:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17136 00000100:00100000:2.0:1746143848.293630:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627572864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.293678:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627572864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (690us total) trans 21474841330 rc 0/0 00000100:00100000:2.0:1746143848.293684:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17136 00000004:00080000:1.0:1746143848.293761:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b48380/2, rc 0, transno 21474841329 00000100:00100000:1.0:1746143848.293765:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627573376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.293775:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b49880/2, rc 0, transno 21474841330 00000100:00100000:1.0:1746143848.293777:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627572864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.293787:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627571968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.293804:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.293827:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.293839:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.293857:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.293870:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.293878:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627573504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.293882:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627571968 00000100:00100000:3.0:1746143848.293886:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627571968 00000100:00100000:1.0:1746143848.293888:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.293900:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746143848.293904:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572480 00000100:00100000:1.0:1746143848.293904:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.293906:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572480 00000100:00100000:1.0:1746143848.293936:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.293942:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572992 00000100:00100000:3.0:1746143848.293945:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572992 00000100:00100000:1.0:1746143848.293949:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.293959:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627573504 00000100:00100000:3.0:1746143848.293961:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627573504 00000100:00100000:1.0:1746143848.293962:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.293975:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572096 00000100:00100000:1.0:1746143848.293975:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627573120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.293977:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572096 00000100:00100000:3.0:1746143848.293987:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627572608 00000100:00100000:1.0:1746143848.293988:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.293989:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627572608 00000100:00100000:1.0:1746143848.293995:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627573632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.293997:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627573120 00000100:00100000:3.0:1746143848.293999:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627573120 00000100:00100000:1.0:1746143848.294005:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.294007:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17137 00000100:00100000:3.0:1746143848.294012:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627571968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.294021:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627573632 00000100:00100000:1.0:1746143848.294023:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627573632 00000100:00100000:1.0:1746143848.294037:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17138 00000100:00100000:1.0:1746143848.294041:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627572480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143848.294094:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143848.294098:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.294099:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746143848.294101:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3773:x1830963627571968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (295us total) trans 17179874068 rc 0/0 00002000:00010000:1.0:1746143848.294101:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.294102:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:3.0:1746143848.294107:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17137 00000100:00100000:3.0:1746143848.294119:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17139 00000100:00100000:3.0:1746143848.294123:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963627572992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.294123:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627572480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (282us total) trans 17179874069 rc 0/0 00000100:00100000:1.0:1746143848.294129:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17138 00000100:00100000:1.0:1746143848.294141:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17140 00000100:00100000:1.0:1746143848.294145:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963627573504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.294188:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3773:x1830963627572992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (316us total) trans 21474841331 rc 0/0 00002000:00010000:1.0:1746143848.294188:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:1.0:1746143848.294190:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.294192:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746143848.294193:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17139 00002000:00010000:1.0:1746143848.294193:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.294195:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143848.294203:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17141 00000100:00100000:3.0:1746143848.294208:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627572096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.294216:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963627573504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (326us total) trans 21474841332 rc 0/0 00000100:00100000:1.0:1746143848.294221:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17140 00000100:00100000:1.0:1746143848.294234:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17142 00000100:00100000:1.0:1746143848.294238:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627572608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.294259:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627572096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (322us total) trans 17179874070 rc 0/0 00000100:00100000:3.0:1746143848.294264:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17141 00000100:00100000:3.0:1746143848.294288:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17143 00000100:00100000:3.0:1746143848.294293:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3773:x1830963627573120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143848.294296:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:1.0:1746143848.294298:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.294299:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143848.294301:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.294302:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:1.0:1746143848.294321:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627572608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (358us total) trans 17179874071 rc 0/0 00000100:00100000:1.0:1746143848.294326:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17142 00000100:00100000:1.0:1746143848.294337:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17144 00000100:00100000:1.0:1746143848.294341:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963627573632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.294344:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963627573120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (355us total) trans 21474841333 rc 0/0 00000100:00100000:3.0:1746143848.294350:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17143 00000100:00100000:0.0:1746143848.295689:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.295725:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627573760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.295752:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.295773:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627573248 00000100:00100000:0.0:1746143848.295777:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627573248 00000100:00100000:0.0:1746143848.295795:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627573760 00000100:00100000:0.0:1746143848.295796:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627573760 00000100:00100000:0.0:1746143848.295807:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17145 00000100:00100000:0.0:1746143848.295811:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627573248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143848.295876:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143848.295879:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.295881:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143848.295882:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.295884:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143848.295907:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3771:x1830963627573248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (221us total) trans 21474841335 rc 0/0 00000100:00100000:0.0:1746143848.295932:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17145 00000100:00100000:0.0:1746143848.295944:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17146 00000100:00100000:0.0:1746143848.295948:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009afb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3771:x1830963627573760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.295999:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009afb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3771:x1830963627573760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (246us total) trans 21474841336 rc 0/0 00000100:00100000:0.0:1746143848.296007:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17146 00000004:00080000:0.0:1746143848.296032:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b4a300/2, rc 0, transno 21474841335 00000100:00100000:0.0:1746143848.296036:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627573248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143848.296043:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1d9500/2, rc 0, transno 21474841336 00000100:00100000:0.0:1746143848.296045:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627573760:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.296514:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3773:x1830963627573632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2172us (2506us total) trans 21474841334 rc 0/0 00000100:00100000:1.0:1746143848.296520:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17144 00000004:00080000:1.0:1746143848.296628:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e32a00/2, rc 0, transno 17179874070 00000100:00100000:1.0:1746143848.296632:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.296640:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30000/2, rc 0, transno 17179874071 00000100:00100000:1.0:1746143848.296642:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572608:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.296650:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b49f80/2, rc 0, transno 21474841333 00000100:00100000:1.0:1746143848.296653:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627573120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.296658:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b4b100/2, rc 0, transno 21474841334 00000100:00100000:1.0:1746143848.296660:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627573632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.296667:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e30380/2, rc 0, transno 17179874068 00000100:00100000:1.0:1746143848.296670:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627571968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.296675:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095e33800/2, rc 0, transno 17179874069 00000100:00100000:1.0:1746143848.296677:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.296683:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b4aa00/2, rc 0, transno 21474841331 00000100:00100000:1.0:1746143848.296685:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627572992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.296689:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b48a80/2, rc 0, transno 21474841332 00000100:00100000:1.0:1746143848.296691:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627573504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.297770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.298009:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252608 00000100:00100000:3.0:1746143848.298021:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252608 00000100:00100000:3.0:1746143848.298078:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14115 00000100:00100000:3.0:1746143848.298086:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3082:x1830963625252608:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.298109:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.298128:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412931 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.298186:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.298199:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.298217:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.298220:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143848.298223:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ca00, rc 0) 00000100:00100000:3.0:1746143848.298269:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3082:x1830963625252608:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 185us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.298285:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14115 00000100:00100000:0.0:1746143848.299825:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.299965:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252736 00000100:00100000:3.0:1746143848.299972:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252736 00000100:00100000:3.0:1746143848.300006:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14116 00000100:00100000:3.0:1746143848.300013:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3082:x1830963625252736:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.300027:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.300043:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d000/0x87925e4cb73b69e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412938 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.300111:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b69ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.300123:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b69ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.300133:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b69ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143848.300156:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143848.300159:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143848.300170:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b69ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.300188:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7d000/0x87925e4cb73b69e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412938 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.300369:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b69ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412938 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.300375:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.300378:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143848.300380:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7c800, rc 0) 00000100:00100000:3.0:1746143848.301080:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3082:x1830963625252736:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1065us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.301085:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14116 00000100:00100000:0.0:1746143848.303481:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.303511:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.303532:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.303554:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.303570:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252864 00000100:00100000:0.0:1746143848.303576:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252864 00000100:00100000:0.0:1746143848.303605:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625252992 00000100:00100000:0.0:1746143848.303607:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625252992 00000100:00100000:0.0:1746143848.303617:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253248 00000100:00100000:0.0:1746143848.303618:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253248 00000100:00100000:0.0:1746143848.303625:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253120 00000100:00100000:0.0:1746143848.303627:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253120 00000100:00100000:0.0:1746143848.303636:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17147 00000100:00100000:0.0:1746143848.303642:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625252864:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143848.303655:0:12328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143848.303670:0:12328:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841293f expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143848.303687:0:12328:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a66, atime: 0x68140a66, ctime: 0x68140a66, blocks: 0x800 00000100:00100000:3.0:1746143848.303730:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17148 00000100:00100000:3.0:1746143848.303737:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625252992:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.303745:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.303755:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412946 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143848.303766:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a68, atime: 0x68140a67, ctime: 0x68140a68, blocks: 0x808 00010000:00010000:3.0:1746143848.303782:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.303784:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.303791:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.303802:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.303811:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d200, rc 0) 00000100:00100000:3.0:1746143848.303846:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625252992:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 109us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.303850:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17148 00000100:00100000:3.0:1746143848.303863:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17149 00000100:00100000:3.0:1746143848.303867:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625253248:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.303872:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.303879:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412954 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143848.303888:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a68, atime: 0x68140a67, ctime: 0x68140a68, blocks: 0x808 00010000:00010000:3.0:1746143848.303895:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.303896:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.303900:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.303927:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.303933:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d400, rc 0) 00000100:00100000:3.0:1746143848.303947:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625253248:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 80us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.303950:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17149 00000100:00100000:3.0:1746143848.303959:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17150 00000100:00100000:3.0:1746143848.303963:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625253120:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.303967:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.303973:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841294d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143848.303982:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a68, atime: 0x68140a67, ctime: 0x68140a68, blocks: 0x808 00010000:00010000:3.0:1746143848.303988:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.303989:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.303992:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.304000:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 13 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.304006:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7de00, rc 0) 00000100:00100000:3.0:1746143848.304019:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625253120:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 56us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.304026:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17150 00000100:00100000:3.0:1746143848.304051:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.304061:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253376 00000100:00100000:3.0:1746143848.304064:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253376 00000100:00100000:3.0:1746143848.304076:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17151 00000100:00100000:3.0:1746143848.304080:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625253376:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.304085:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.304093:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841295b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143848.304101:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a68, atime: 0x68140a68, ctime: 0x68140a68, blocks: 0x1510 00010000:00010000:3.0:1746143848.304107:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.304108:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.304111:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.304119:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.304125:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d800, rc 0) 00000100:00100000:3.0:1746143848.304139:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625253376:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.304144:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17151 00000100:00100000:3.0:1746143848.304196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.304209:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253504 00000100:00100000:3.0:1746143848.304212:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253504 00000100:00100000:3.0:1746143848.304227:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17152 00000100:00100000:3.0:1746143848.304231:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625253504:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.304236:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.304244:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412962 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143848.304253:0:13430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a68, atime: 0x68140a68, ctime: 0x68140a68, blocks: 0x1008 00010000:00010000:3.0:1746143848.304259:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.304260:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.304264:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.304286:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.304292:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940f6600, rc 0) 00000100:00100000:3.0:1746143848.304306:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625253504:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 75us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.304311:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17152 00010000:00010000:0.0:1746143848.304600:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.304601:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.304606:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 14 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143848.304615:0:12328:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 14 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143848.304622:0:12328:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:0.0:1746143848.304637:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625252864:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 996us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.304642:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17147 00000100:00100000:0.0:1746143848.309114:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.309144:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.309162:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.309179:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.309189:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.309207:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.309277:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253632 00000100:00100000:1.0:1746143848.309284:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253632 00000100:00100000:1.0:1746143848.309316:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253888 00000100:00100000:1.0:1746143848.309318:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253888 00000100:00100000:1.0:1746143848.309329:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254144 00000100:00100000:1.0:1746143848.309330:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254144 00000100:00100000:1.0:1746143848.309340:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625253760 00000100:00100000:1.0:1746143848.309341:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625253760 00000100:00100000:2.0:1746143848.309344:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254016 00000100:00100000:2.0:1746143848.309348:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254016 00000100:00100000:1.0:1746143848.309348:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254272 00000100:00100000:1.0:1746143848.309350:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254272 00000100:00100000:1.0:1746143848.309359:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17153 00000100:00100000:1.0:1746143848.309365:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625253632:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143848.309373:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17154 00000100:00100000:2.0:1746143848.309378:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625253888:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143848.309433:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17155 00000100:00100000:0.0:1746143848.309439:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625254144:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143848.309452:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625253888:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 73us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.309462:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17154 00000100:00100000:2.0:1746143848.309476:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17156 00000100:00100000:2.0:1746143848.309481:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625253760:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143848.309482:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625253632:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 117us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.309487:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17153 00000100:00100000:1.0:1746143848.309496:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17157 00000100:00100000:1.0:1746143848.309499:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625254272:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143848.309511:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625253760:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.309516:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17156 00000100:00100000:1.0:1746143848.309520:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625254272:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 21us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.309526:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17158 00000100:00100000:1.0:1746143848.309528:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17157 00000100:00100000:2.0:1746143848.309530:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625254016:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143848.309591:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625254016:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 60us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.309596:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17158 00000100:00100000:0.0:1746143848.309597:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625254144:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 158us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.309602:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17155 00000100:00100000:2.0:1746143848.315114:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.315147:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.315160:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.315170:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254528 00000100:00100000:2.0:1746143848.315170:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.315178:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254528 00000100:00100000:2.0:1746143848.315183:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254784 00000100:00100000:2.0:1746143848.315185:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254784 00000100:00100000:3.0:1746143848.315240:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625255040 00000100:00100000:3.0:1746143848.315243:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625255040 00000100:00100000:3.0:1746143848.315257:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254400 00000100:00100000:3.0:1746143848.315259:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254400 00000100:00100000:3.0:1746143848.315282:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17159 00000100:00100000:3.0:1746143848.315289:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625254784:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143848.315536:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17160 00000100:00100000:2.0:1746143848.315544:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625254528:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143848.315710:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625254784:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 421us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.315717:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17159 00000100:00100000:3.0:1746143848.315730:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17161 00000100:00100000:3.0:1746143848.315734:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625255040:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143848.315801:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17162 00000100:00100000:0.0:1746143848.315808:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625254400:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143848.315827:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625254528:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 282us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.315831:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625255040:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 97us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.315833:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17160 00000100:00100000:3.0:1746143848.315836:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17161 00000100:00100000:2.0:1746143848.315905:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.315957:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.316068:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254656 00000100:00100000:3.0:1746143848.316071:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254656 00000100:00100000:3.0:1746143848.316088:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625254912 00000100:00100000:3.0:1746143848.316090:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625254912 00000100:00100000:3.0:1746143848.316110:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17163 00000100:00100000:3.0:1746143848.316114:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625254912:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143848.316282:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625254400:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 473us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.316291:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17162 00000100:00100000:3.0:1746143848.316442:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625254912:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 325us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.316447:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17163 00000100:00100000:3.0:1746143848.316480:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17164 00000100:00100000:3.0:1746143848.316485:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625254656:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143848.316524:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625254656:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 39us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.316529:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17164 00000100:00100000:0.0:1746143848.323903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.324082:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625255168 00000100:00100000:3.0:1746143848.324090:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625255168 00000100:00100000:3.0:1746143848.324133:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17165 00000100:00100000:3.0:1746143848.324140:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625255168:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:3.0:1746143848.324317:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143848.324320:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.324322:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.324324:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.324325:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:3.0:1746143848.327107:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625255168:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 2957us (3201us total) trans 21474841337 rc 0/0 00000100:00100000:3.0:1746143848.327119:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17165 00000100:00100000:0.0:1746143848.331302:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.331360:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625255296 00000100:00100000:3.0:1746143848.331368:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625255296 00000100:00100000:3.0:1746143848.331417:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17166 00000100:00100000:3.0:1746143848.331426:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2011:x1830963625255296:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:3.0:1746143848.331588:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143848.331590:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.331593:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.331595:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.331597:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:3.0:1746143848.331644:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2011:x1830963625255296:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 219us (372us total) trans 17179874072 rc 0/0 00000100:00100000:3.0:1746143848.331651:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17166 00000100:00100000:0.0:1746143848.341895:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.341961:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.342060:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625255552 00000100:00100000:2.0:1746143848.342069:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625255552 00000100:00100000:2.0:1746143848.342116:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625255808 00000100:00100000:2.0:1746143848.342119:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625255808 00000100:00100000:2.0:1746143848.342141:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7504 00000100:00100000:2.0:1746143848.342148:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625255552:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143848.342176:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.342188:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.342189:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.342193:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.342203:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143848.342288:0:29555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7505 00000100:00100000:0.0:1746143848.342295:0:29555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625255808:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143848.342313:0:29555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.342321:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.342322:0:29555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.342325:0:29555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.342334:0:29555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143848.355201:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.355236:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.355280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.355316:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625256064 00000100:00100000:0.0:1746143848.355324:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625256064 00000100:00100000:0.0:1746143848.355372:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625256320 00000100:00100000:0.0:1746143848.355374:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625256320 00000100:00100000:0.0:1746143848.355386:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625256576 00000100:00100000:0.0:1746143848.355387:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625256576 00000100:00100000:0.0:1746143848.355399:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7506 00000100:00100000:0.0:1746143848.355406:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2010:x1830963625256064:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143848.355433:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.355445:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.355447:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.355450:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.355461:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.355945:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7507 00000100:00100000:3.0:1746143848.355953:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2010:x1830963625256320:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143848.355972:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.355983:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.355985:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.355988:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.355996:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.356554:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7508 00000100:00100000:3.0:1746143848.356561:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2011:x1830963625256576:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143848.356577:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.356584:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.356585:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.356588:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.356596:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.366679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.366796:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.366829:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.366846:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625256832 00000100:00100000:1.0:1746143848.366852:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625256832 00000100:00100000:1.0:1746143848.366886:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625257088 00000100:00100000:1.0:1746143848.366887:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625257088 00000100:00100000:1.0:1746143848.366898:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625257344 00000100:00100000:1.0:1746143848.366899:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625257344 00000100:00100000:1.0:1746143848.366926:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7509 00000100:00100000:1.0:1746143848.366933:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+20:2011:x1830963625256832:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143848.366961:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.366973:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.366974:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.366978:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.366988:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.367534:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7510 00000100:00100000:1.0:1746143848.367539:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+21:2010:x1830963625257088:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143848.367554:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.367565:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.367566:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.367569:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.367575:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.367708:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7511 00000100:00100000:2.0:1746143848.367717:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+21:2010:x1830963625257344:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143848.367734:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.367741:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.367742:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.367746:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.367754:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368316:0:29555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368324:0:29555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368331:0:29555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368336:0:29555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b25000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143848.368340:0:29555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368347:0:29555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368358:0:29555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.368368:0:29555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b6a22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.368427:0:29555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+21:2010:x1830963625255808:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 26132us (26464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143848.368433:0:29555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7505 00010000:00010000:3.0:1746143848.369702:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.369714:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.369720:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.369726:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb5200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143848.369728:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.369734:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.369745:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.369750:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b6a1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.369817:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+21:2010:x1830963625255552:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 27667us (27926us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143848.369824:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7504 00010000:00010000:0.0:1746143848.370133:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.370142:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.370148:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.370152:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143848.370155:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.370161:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.370171:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.370177:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24c00/0x87925e4cb73b6a29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143848.372632:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2010:x1830963625256064:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 17217us (17431us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143848.372644:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7506 00010000:00010000:3.0:1746143848.374538:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.374551:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.374558:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.374564:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4e0de00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143848.374567:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.374574:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.374589:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.374594:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e0de00/0x87925e4cb73b6a30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.375154:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2010:x1830963625256320:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 19198us (19912us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.375163:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7507 00010000:00010000:3.0:1746143848.384235:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.384248:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.384255:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.384260:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143848.384263:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.384277:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.384293:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.384299:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7c400/0x87925e4cb73b6a37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.384361:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963625256576:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 27797us (29086us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.384369:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7508 00010000:00010000:1.0:1746143848.390655:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.390673:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.390680:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.390687:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a45800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143848.390690:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.390697:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.390712:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.390718:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092a45800/0x87925e4cb73b6a3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.391033:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963625256832:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 24097us (24357us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143848.391042:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7509 00010000:00010000:1.0:1746143848.396193:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.396206:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.396213:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.396218:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a44800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143848.396221:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.396227:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.396241:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.396246:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092a44800/0x87925e4cb73b6a45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.396325:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625257088:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 28783us (29526us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143848.396335:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7510 00010000:00010000:2.0:1746143848.398330:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.398342:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.398349:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.398353:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4fbb000 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143848.398356:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.398361:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.398373:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.398379:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.398460:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625257344:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 30743us (31627us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143848.398469:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7511 00000100:00100000:0.0:1746143848.407380:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.407475:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625257600 00000100:00100000:3.0:1746143848.407485:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625257600 00000100:00100000:3.0:1746143848.407544:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14117 00000100:00100000:3.0:1746143848.407551:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3082:x1830963625257600:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143848.407588:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.407610:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7c800/0x87925e4cb73b69ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412938 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.407639:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.407643:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143848.407685:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.407694:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.407704:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00010000:3.0:1746143848.407781:0:7245:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093f7aa00 reply state ffff880097130000 transno 8589945214 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.407788:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.407792:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.407794:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746143848.407796:0:7245:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143848.407865:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3082:x1830963625257600:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 314us (497us total) trans 8589945214 rc 0/0 00000100:00100000:3.0:1746143848.407871:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14117 00000100:00100000:0.0:1746143848.410232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.411472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.412332:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625257728 00000100:00100000:2.0:1746143848.412344:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625257728 00000100:00100000:2.0:1746143848.412409:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17167 00000100:00100000:2.0:1746143848.412418:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625257728:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143848.412581:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143848.412584:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143846 -> 1746143848 00002000:00010000:2.0:1746143848.412586:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143846 -> 1746143848 00002000:00010000:2.0:1746143848.412588:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143846 -> 1746143848 00002000:00010000:2.0:1746143848.412590:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143848.412661:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625257728:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 244us (2437us total) trans 17179874073 rc 0/0 00000100:00100000:2.0:1746143848.412668:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17167 00000100:00100000:2.0:1746143848.412782:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625257856 00000100:00100000:2.0:1746143848.412786:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625257856 00000100:00100000:2.0:1746143848.414247:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17168 00000100:00100000:2.0:1746143848.414256:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625257856:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143848.414367:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143848.414370:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.414372:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143847 -> 1746143848 00002000:00010000:2.0:1746143848.414374:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.414375:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143848.414795:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2009:x1830963625257856:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 540us (3325us total) trans 21474841338 rc 0/0 00000100:00100000:2.0:1746143848.414802:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17168 00000100:00100000:0.0:1746143848.414900:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.414949:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.414961:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625257984 00000100:00100000:0.0:1746143848.414964:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.414966:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625257984 00000100:00100000:0.0:1746143848.415000:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.415036:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625258240 00000100:00100000:2.0:1746143848.415039:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625258240 00000100:00100000:2.0:1746143848.415063:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625258112 00000100:00100000:2.0:1746143848.415065:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625258112 00000100:00100000:2.0:1746143848.415073:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625258368 00000100:00100000:2.0:1746143848.415075:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625258368 00000100:00100000:2.0:1746143848.415085:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17169 00000100:00100000:2.0:1746143848.415089:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963625258240:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:0.0:1746143848.415096:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17170 00000100:00100000:0.0:1746143848.415101:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963625258112:12345-192.168.202.3@tcp:2:lfs.0 00000100:00100000:2.0:1746143848.415149:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17171 00000100:00100000:2.0:1746143848.415154:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963625258368:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143848.415163:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143848.415165:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.415167:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143847 -> 1746143848 00002000:00010000:0.0:1746143848.415169:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.415170:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143848.415190:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+19:2009:x1830963625258112:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 89us (224us total) trans 17179874074 rc 0/0 00002000:00010000:2.0:1746143848.415194:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746143848.415195:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17170 00002000:00010000:2.0:1746143848.415196:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.415198:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.415200:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.415201:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746143848.415217:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2009:x1830963625258368:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 63us (216us total) trans 21474841339 rc 0/0 00002000:00010000:0.0:1746143848.415217:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:0.0:1746143848.415220:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.415221:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00000100:00100000:2.0:1746143848.415222:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17171 00002000:00010000:0.0:1746143848.415223:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.415225:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:0.0:1746143848.415238:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2009:x1830963625258240:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 148us (289us total) trans 17179874075 rc 0/0 00000100:00100000:0.0:1746143848.415243:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17169 00000100:00100000:2.0:1746143848.415246:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17172 00000100:00100000:2.0:1746143848.415251:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963625257984:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:2.0:1746143848.415306:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143848.415308:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.415310:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143847 -> 1746143848 00002000:00010000:2.0:1746143848.415312:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.415313:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143848.415331:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2009:x1830963625257984:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 79us (431us total) trans 21474841340 rc 0/0 00000100:00100000:2.0:1746143848.415336:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17172 00000100:00100000:0.0:1746143848.419020:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.419155:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625258624 00000100:00100000:1.0:1746143848.419163:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625258624 00000100:00100000:1.0:1746143848.419213:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5503 00000100:00100000:1.0:1746143848.419220:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3082:x1830963625258624:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:1.0:1746143848.419267:0:7247:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b699d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841292a expref: 10 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.419312:0:7247:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.419321:0:7247:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.419328:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.419350:0:7247:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.419360:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 10 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.419370:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963627573888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143848.419442:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143848.421833:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830963627573888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143848.421853:0:7247:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746143848.422386:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.422454:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625258752 00000100:00100000:2.0:1746143848.422460:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625258752 00010000:00010000:2.0:1746143848.422487:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.422649:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8435 00000100:00100000:2.0:1746143848.422656:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625258752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.422667:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.422672:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.422681:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.422697:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7ca00/0x87925e4cb73b69dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412931 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.423457:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.423462:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143848.423475:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143848.423480:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746143848.423505:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143848.423522:0:7247:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.423528:0:7247:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000040:00080000:1.0:1746143848.423735:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3312, 88 off279320 00000004:00080000:1.0:1746143848.423739:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907647827122ns, next at 850790015893ns, rc = 0 00000100:00100000:2.0:1746143848.423861:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625258752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1204us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.423867:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8435 00000040:00080000:1.0:1746143848.423977:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3298, 88 off277728 00000004:00080000:1.0:1746143848.423981:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648068472ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424001:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3299, 88 off277816 00000004:00080000:1.0:1746143848.424003:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648091217ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424010:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3313, 88 off279408 00000004:00080000:1.0:1746143848.424012:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648099737ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424019:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3314, 88 off279496 00000004:00080000:1.0:1746143848.424022:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648109640ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424029:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3300, 88 off277904 00000004:00080000:1.0:1746143848.424032:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648119734ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424039:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3301, 88 off277992 00000004:00080000:1.0:1746143848.424041:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648129262ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424047:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3302, 88 off278080 00000004:00080000:1.0:1746143848.424049:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648137064ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424055:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3315, 88 off279584 00000004:00080000:1.0:1746143848.424056:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648144407ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424063:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3303, 88 off278168 00000004:00080000:1.0:1746143848.424066:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648153868ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424072:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3316, 88 off279672 00000004:00080000:1.0:1746143848.424075:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648163152ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424083:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3304, 88 off278256 00000004:00080000:1.0:1746143848.424085:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648172694ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143848.424091:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3317, 88 off279760 00000004:00080000:1.0:1746143848.424093:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648181350ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424101:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3318, 88 off279848 00000004:00080000:1.0:1746143848.424103:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648190729ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424111:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3319, 88 off279936 00000004:00080000:1.0:1746143848.424113:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648200932ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424120:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3320, 88 off280024 00000004:00080000:1.0:1746143848.424123:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907648211040ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143848.424136:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3305, 88 off278344 00000004:00080000:1.0:1746143848.424139:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907648226768ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143848.425812:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945215 is committed 00000004:00080000:2.0:1746143848.425820:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2518 committed 00010000:00010000:3.0:1746143848.425825:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.425834:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00000004:00080000:2.0:1746143848.425835:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2535 committed 00010000:00010000:3.0:1746143848.425841:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.425846:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4fbb000 already unused, calling callback (ffffffffa0f2a690) 00000004:00080000:2.0:1746143848.425847:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2534 committed 00000004:00080000:2.0:1746143848.425848:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2533 committed 00010000:00010000:3.0:1746143848.425850:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00000004:00080000:2.0:1746143848.425850:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2532 committed 00000004:00080000:2.0:1746143848.425851:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2517 committed 00000004:00080000:2.0:1746143848.425852:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2531 committed 00000004:00080000:2.0:1746143848.425853:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2516 committed 00000004:00080000:2.0:1746143848.425854:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2530 committed 00010000:00010000:3.0:1746143848.425855:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00000004:00080000:2.0:1746143848.425856:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2515 committed 00000004:00080000:2.0:1746143848.425857:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2514 committed 00000004:00080000:2.0:1746143848.425858:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2513 committed 00000004:00080000:2.0:1746143848.425859:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2529 committed 00000004:00080000:2.0:1746143848.425860:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2528 committed 00000004:00080000:2.0:1746143848.425861:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2512 committed 00000004:00080000:2.0:1746143848.425862:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2511 committed 00000004:00080000:2.0:1746143848.425863:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2527 committed 00010000:00010000:3.0:1746143848.425868:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.425871:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.425874:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.425879:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fbb000/0x87925e4cb73b6a53 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746143848.425991:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627574144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.426038:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.426064:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627574016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.426080:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.426092:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627574656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.426102:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.426107:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627574528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.426111:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627575168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.426122:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.426144:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627575680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.426159:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.426177:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574144 00000100:00100000:3.0:1746143848.426183:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574144 00000100:00100000:2.0:1746143848.426199:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574016 00000100:00100000:2.0:1746143848.426202:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574016 00000100:00100000:3.0:1746143848.426208:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574656 00000100:00100000:3.0:1746143848.426210:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574656 00000100:00100000:2.0:1746143848.426217:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575168 00000100:00100000:3.0:1746143848.426218:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575680 00000100:00100000:3.0:1746143848.426219:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575680 00000100:00100000:2.0:1746143848.426219:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575168 00000100:00100000:2.0:1746143848.426230:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17173 00000100:00100000:2.0:1746143848.426235:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963627574144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143848.426338:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143848.426341:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.426343:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.426345:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.426347:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143848.426370:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17174 00000100:00100000:3.0:1746143848.426377:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963627574016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143848.426433:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746143848.426435:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.426437:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.426438:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.426439:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746143848.426464:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3772:x1830963627574016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (382us total) trans 17179874076 rc 0/0 00000100:00100000:3.0:1746143848.426469:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17174 00000100:00100000:3.0:1746143848.426480:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17175 00000100:00100000:3.0:1746143848.426483:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963627574656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.426533:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3772:x1830963627574656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (429us total) trans 17179874077 rc 0/0 00000100:00100000:3.0:1746143848.426537:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17175 00000100:00100000:3.0:1746143848.426546:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17176 00000100:00100000:3.0:1746143848.426550:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3772:x1830963627575168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143848.426589:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:3.0:1746143848.426591:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.426593:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.426594:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.426596:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:3.0:1746143848.426613:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3772:x1830963627575168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (489us total) trans 17179874078 rc 0/0 00000100:00100000:3.0:1746143848.426617:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17176 00000100:00100000:3.0:1746143848.426626:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17177 00000100:00100000:3.0:1746143848.426629:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963627575680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143848.426665:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:3.0:1746143848.426667:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.426669:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.426671:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.426672:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143848.426689:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627575680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (530us total) trans 21474841342 rc 0/0 00000100:00100000:3.0:1746143848.426694:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17177 00000100:00100000:0.0:1746143848.426770:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.426792:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627575040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.426808:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.426818:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627575552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.426831:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.426849:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574528 00000100:00100000:0.0:1746143848.426852:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574528 00000100:00100000:0.0:1746143848.426867:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575040 00000100:00100000:0.0:1746143848.426868:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575040 00000100:00100000:0.0:1746143848.426876:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575552 00000100:00100000:0.0:1746143848.426878:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575552 00000100:00100000:0.0:1746143848.426886:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17178 00000100:00100000:0.0:1746143848.426889:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3771:x1830963627574528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143848.426947:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:0.0:1746143848.426949:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.426951:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.426953:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.426955:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:0.0:1746143848.426975:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627574528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (205us total) trans 17179874079 rc 0/0 00000100:00100000:0.0:1746143848.426980:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17178 00000100:00100000:0.0:1746143848.426989:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17179 00000100:00100000:0.0:1746143848.426992:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3771:x1830963627575040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143848.427027:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143848.427029:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.427030:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143848.427032:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.427033:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143848.427050:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627575040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (241us total) trans 17179874080 rc 0/0 00000100:00100000:0.0:1746143848.427056:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17179 00000100:00100000:0.0:1746143848.427065:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17180 00000100:00100000:0.0:1746143848.427068:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3771:x1830963627575552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.427110:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3771:x1830963627575552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (278us total) trans 21474841343 rc 0/0 00000100:00100000:0.0:1746143848.427114:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17180 00000004:00080000:0.0:1746143848.427138:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46d80/2, rc 0, transno 17179874079 00000100:00100000:0.0:1746143848.427144:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627574528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.427150:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b44e00/2, rc 0, transno 17179874080 00000100:00100000:0.0:1746143848.427152:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627575040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.427157:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b70e00/2, rc 0, transno 21474841343 00000100:00100000:0.0:1746143848.427159:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627575552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.427181:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627576064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.427194:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.427206:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627576064 00000100:00100000:0.0:1746143848.427208:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627576064 00000100:00100000:0.0:1746143848.427219:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17181 00000100:00100000:0.0:1746143848.427223:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3771:x1830963627576064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.427264:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3771:x1830963627576064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (69us total) trans 17179874081 rc 0/0 00000100:00100000:0.0:1746143848.427278:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17181 00000004:00080000:0.0:1746143848.427295:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6fb80/2, rc 0, transno 17179874081 00000100:00100000:0.0:1746143848.427298:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627576064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.427570:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627574272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.427591:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.427649:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627574400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.427817:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627574784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.427832:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.427907:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627575296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.427931:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.427951:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574272 00000100:00100000:0.0:1746143848.427953:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574272 00000100:00100000:3.0:1746143848.427987:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574784 00000100:00100000:3.0:1746143848.427989:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574784 00000100:00100000:3.0:1746143848.428008:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17182 00000100:00100000:3.0:1746143848.428012:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627574272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143848.428058:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143848.428060:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.428062:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.428063:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.428065:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143848.428083:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3773:x1830963627574272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (492us total) trans 21474841344 rc 0/0 00000100:00100000:3.0:1746143848.428088:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17182 00000100:00100000:3.0:1746143848.428097:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17183 00000100:00100000:3.0:1746143848.428100:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3773:x1830963627574784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.428150:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+48:3773:x1830963627574784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (315us total) trans 17179874082 rc 0/0 00000100:00100000:3.0:1746143848.428155:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17183 00000100:00100000:0.0:1746143848.428214:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.428227:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627574912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.428244:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574400 00000100:00100000:0.0:1746143848.428246:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574400 00000100:00100000:0.0:1746143848.428261:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17184 00000100:00100000:0.0:1746143848.428264:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3774:x1830963627574400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143848.428320:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143848.428322:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.428323:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.428325:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.428326:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143848.428349:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963627574400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (134us total) trans 17179874083 rc 0/0 00000100:00100000:0.0:1746143848.428353:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17184 00000100:00100000:1.0:1746143848.428395:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627575808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.428410:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143848.428429:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b73b80/2, rc 0, transno 21474841344 00000100:00100000:1.0:1746143848.428432:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627574272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.428439:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b45c00/2, rc 0, transno 17179874082 00000100:00100000:1.0:1746143848.428441:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627574784:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.428454:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71180/2, rc 0, transno 21474841342 00000100:00100000:1.0:1746143848.428456:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627575680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.428462:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b47800/2, rc 0, transno 17179874076 00000100:00100000:1.0:1746143848.428464:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627574016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.428469:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b45180/2, rc 0, transno 17179874077 00000100:00100000:2.0:1746143848.428472:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963627574144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2236us (2434us total) trans 21474841341 rc 0/0 00000100:00100000:1.0:1746143848.428472:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627574656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143848.428477:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17173 00000004:00080000:1.0:1746143848.428477:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46300/2, rc 0, transno 17179874078 00000100:00100000:1.0:1746143848.428479:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627575168:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.428485:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b70700/2, rc 0, transno 21474841341 00000100:00100000:1.0:1746143848.428487:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627574144:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746143848.428517:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092b72d80 reply state ffff880092e9e800 transno 8589945215 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.428530:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.428537:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.428539:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143848.428542:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746143848.428546:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.428548:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:2.0:1746143848.428549:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575296 00000100:00100000:2.0:1746143848.428552:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575296 00010000:00010000:1.0:1746143848.428552:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b699d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841292a expref: 7 pid: 10936 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.428564:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575808 00000100:00100000:2.0:1746143848.428566:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575808 00000100:00100000:2.0:1746143848.428574:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17185 00000100:00100000:2.0:1746143848.428578:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3773:x1830963627575296:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1746143848.428610:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00002000:00010000:2.0:1746143848.428615:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143848.428617:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00000100:00100000:1.0:1746143848.428618:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3082:x1830963625258624:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 9399us (9606us total) trans 8589945215 rc 0/0 00002000:00010000:2.0:1746143848.428619:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.428621:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.428622:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143848.428625:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5503 00000100:00100000:2.0:1746143848.428640:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3773:x1830963627575296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (709us total) trans 21474841345 rc 0/0 00010000:00010000:1.0:1746143848.428643:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00000100:00100000:2.0:1746143848.428645:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17185 00010000:00010000:1.0:1746143848.428649:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00000100:00100000:2.0:1746143848.428653:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17186 00010000:00010000:1.0:1746143848.428654:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00000100:00100000:2.0:1746143848.428657:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3773:x1830963627575808:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746143848.428659:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143848.428662:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.428667:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.428675:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.428676:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143848.428679:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746143848.428684:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97000/0x87925e4cb73b6a5a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000004:00080000:1.0:1746143848.428702:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b73100/2, rc 0, transno 21474841345 00000100:00100000:2.0:1746143848.428704:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3773:x1830963627575808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (293us total) trans 21474841346 rc 0/0 00000100:00100000:1.0:1746143848.428705:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627575296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.428709:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17186 00000004:00080000:1.0:1746143848.428710:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b72a00/2, rc 0, transno 21474841346 00000100:00100000:1.0:1746143848.428712:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627575808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.428804:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.428823:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627575424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.428837:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.428846:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627575936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.428858:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746143848.428875:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b46a00/2, rc 0, transno 17179874083 00000100:00100000:0.0:1746143848.428878:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627574400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.428888:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627574912 00000100:00100000:0.0:1746143848.428890:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627574912 00000100:00100000:0.0:1746143848.428902:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575424 00000100:00100000:0.0:1746143848.428904:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575424 00000100:00100000:0.0:1746143848.428923:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627575936 00000100:00100000:0.0:1746143848.428925:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627575936 00000100:00100000:0.0:1746143848.428937:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17187 00000100:00100000:0.0:1746143848.428940:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3774:x1830963627574912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.428993:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3774:x1830963627574912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (189us total) trans 17179874084 rc 0/0 00000100:00100000:0.0:1746143848.428997:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17187 00000100:00100000:0.0:1746143848.429006:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17188 00000100:00100000:0.0:1746143848.429009:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3774:x1830963627575424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143848.429043:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143848.429046:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.429047:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143848.429049:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.429051:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143848.429067:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3774:x1830963627575424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (230us total) trans 21474841347 rc 0/0 00000100:00100000:0.0:1746143848.429072:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17188 00000100:00100000:0.0:1746143848.429080:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17189 00000100:00100000:0.0:1746143848.429084:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3774:x1830963627575936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.429127:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3774:x1830963627575936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (267us total) trans 21474841348 rc 0/0 00000100:00100000:0.0:1746143848.429131:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17189 00000004:00080000:0.0:1746143848.429150:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b47480/2, rc 0, transno 17179874084 00000100:00100000:0.0:1746143848.429153:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627574912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.429159:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71880/2, rc 0, transno 21474841347 00000100:00100000:0.0:1746143848.429161:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627575424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143848.429165:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71c00/2, rc 0, transno 21474841348 00000100:00100000:0.0:1746143848.429167:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627575936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.430742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.430897:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625258880 00000100:00100000:3.0:1746143848.430903:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625258880 00000100:00100000:3.0:1746143848.430946:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14118 00000100:00100000:3.0:1746143848.430952:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+6:3082:x1830963625258880:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143848.430965:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.430977:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412969 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.431011:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.431020:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.431032:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.431035:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143848.431037:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801368da400, rc 0) 00000100:00100000:3.0:1746143848.431248:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3082:x1830963625258880:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 295us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.431253:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14118 00000100:00100000:0.0:1746143848.433628:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.433961:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625259136 00000100:00100000:1.0:1746143848.433968:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625259136 00000100:00100000:1.0:1746143848.434363:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5504 00000100:00100000:1.0:1746143848.434371:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3082:x1830963625259136:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143848.434543:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3082:x1830963625259136:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 173us (920us total) trans 8589945216 rc 0/0 00000100:00100000:1.0:1746143848.434548:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5504 00000100:00100000:0.0:1746143848.454065:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.455618:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625259392 00000100:00100000:3.0:1746143848.455627:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625259392 00000100:00100000:3.0:1746143848.455672:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14119 00000100:00100000:3.0:1746143848.455680:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+7:3090:x1830963625259392:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143848.455701:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.455717:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73b6a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412970 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.455778:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455789:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455798:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455810:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455815:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455820:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455897:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455905:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.455942:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143848.455950:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143848.456007:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456012:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456017:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456022:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456026:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.456029:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456034:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456043:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143848.456045:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.456048:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456053:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33e00/0x87925e4cb73b6a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456082:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456090:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456094:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456097:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.456099:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456104:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456110:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65f00) 00010000:00010000:3.0:1746143848.456112:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.456114:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456118:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33200/0x87925e4cb73b6a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.456149:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e7c200/0x87925e4cb73b6a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.456158:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.456164:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.456166:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143848.456168:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32600, rc 0) 00000100:00100000:3.0:1746143848.456226:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3090:x1830963625259392:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 547us (2168us total) trans 8589945217 rc 0/0 00000100:00100000:3.0:1746143848.456233:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14119 00000100:00100000:2.0:1746143848.463134:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.463238:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625259648 00000100:00100000:1.0:1746143848.463246:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625259648 00000100:00100000:1.0:1746143848.463308:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14120 00000100:00100000:1.0:1746143848.463316:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3094:x1830963625259648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143848.463336:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143848.463352:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e59f000/0x87925e4cb73b6a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412977 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.463450:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.463465:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.463477:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:1.0:1746143848.463490:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143848.463595:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e59f000/0x87925e4cb73b6a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 12 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.463619:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.463627:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.463629:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746143848.463632:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d85200, rc 0) 00000100:00100000:1.0:1746143848.463685:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3094:x1830963625259648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 368us (555us total) trans 8589945218 rc 0/0 00000100:00100000:1.0:1746143848.463691:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14120 00000100:00100000:0.0:1746143848.466704:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.466866:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625259904 00000100:00100000:3.0:1746143848.466874:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625259904 00000100:00100000:3.0:1746143848.466937:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14121 00000100:00100000:3.0:1746143848.466944:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+260:3095:x1830963625259904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.466964:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.466977:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841297e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.467028:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467038:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467048:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467058:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467064:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467069:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467144:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467152:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467159:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746143848.467165:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143848.467218:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467223:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467227:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467231:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467236:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.467239:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467244:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467253:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143848.467255:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.467258:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467262:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467294:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467303:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467307:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467310:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e33600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.467312:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467316:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467322:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65e00) 00010000:00010000:3.0:1746143848.467325:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.467326:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467334:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746143848.467362:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 263 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.467371:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.467376:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.467378:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143848.467380:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32400, rc 0) 00000100:00100000:3.0:1746143848.467749:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:3095:x1830963625259904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 805us (1050us total) trans 8589945219 rc 0/0 00000100:00100000:3.0:1746143848.467755:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14121 00000100:00100000:0.0:1746143848.472286:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.474601:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625260032 00000100:00100000:2.0:1746143848.474612:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625260032 00000100:00100000:2.0:1746143848.474673:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17190 00000100:00100000:2.0:1746143848.474681:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3094:x1830963625260032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143848.474696:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.474711:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412985 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.474732:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.474734:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.474740:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.474753:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.474761:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ca00, rc 0) 00000100:00100000:2.0:1746143848.474801:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+30:3094:x1830963625260032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 121us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.474807:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17190 00000100:00100000:0.0:1746143848.475113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.475333:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625260160 00000100:00100000:3.0:1746143848.475338:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625260160 00000100:00100000:3.0:1746143848.475359:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17191 00000100:00100000:3.0:1746143848.475365:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+45:3095:x1830963625260160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.475373:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.475384:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841298c expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.475396:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.475397:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.475401:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 46 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.475411:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 46 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.475417:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33e00, rc 0) 00000100:00100000:3.0:1746143848.475565:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+46:3095:x1830963625260160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 198us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.475570:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17191 00000100:00100000:0.0:1746143848.475621:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.475682:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625260416 00000100:00100000:2.0:1746143848.475685:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625260416 00000100:00100000:2.0:1746143848.475710:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14122 00000100:00100000:2.0:1746143848.475715:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+262:3092:x1830963625260416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.475728:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.475739:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412993 expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.475842:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.475850:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.475854:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 263 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.475858:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.475875:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 263 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.475882:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 263 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.475889:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576192:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.475992:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.476000:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 10 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.476008:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576320:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.476027:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.479659:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576192:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143848.481353:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.481488:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625260544 00000100:00100000:3.0:1746143848.481495:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625260544 00010000:00010000:3.0:1746143848.481775:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 264 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.481810:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8436 00000100:00100000:3.0:1746143848.481817:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2011:x1830963625260544:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.481830:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.481835:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 264 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.481845:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 264 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.481865:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32400/0x87925e4cb73b6ab5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841297e expref: 264 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.482181:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576320:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.482205:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.482340:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.482345:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.482353:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.482357:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.482574:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:2011:x1830963625260544:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 755us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.482580:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8436 00000100:00100000:0.0:1746143848.483110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.483143:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.483212:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625260800 00000100:00100000:3.0:1746143848.483217:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625260800 00000100:00100000:3.0:1746143848.483240:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14123 00000100:00100000:3.0:1746143848.483245:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:3095:x1830963625260800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.483258:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.483277:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6adf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841299a expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.483314:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6adf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841299a expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.483323:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6adf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841299a expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.483334:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.483337:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143848.483339:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:3.0:1746143848.483357:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:3095:x1830963625260800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.483362:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14123 00000100:00100000:2.0:1746143848.483417:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625260672 00000100:00100000:2.0:1746143848.483420:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625260672 00010000:00010000:2.0:1746143848.483431:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.483444:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8437 00000100:00100000:2.0:1746143848.483448:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625260672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143848.483454:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.483457:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.483464:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.483475:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e32600/0x87925e4cb73b6a7d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412970 expref: 11 pid: 7245 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.483486:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.483488:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.483494:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.483499:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.483509:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.483524:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625260672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.483528:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8437 00010000:00010000:2.0:1746143848.483539:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.483544:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000004:00200000:2.0:1746143848.483556:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143848.483645:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 265 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.483655:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.483660:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.483662:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143848.483664:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84fe00, rc 0) 00000100:00100000:2.0:1746143848.483679:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:3092:x1830963625260416:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7964us (8059us total) trans 8589945220 rc 0/0 00000100:00100000:2.0:1746143848.483684:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14122 00000100:00100000:0.0:1746143848.486051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.486277:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625261056 00000100:00100000:2.0:1746143848.486286:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625261056 00002000:00100000:2.0:1746143848.486332:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012e35ad80 x1830963625261056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.486341:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963625261056 ext(0->1048575) 00002000:00010000:2.0:1746143848.486346:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35ad80 00000100:00100000:2.0:1746143848.486392:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7512 00000100:00100000:2.0:1746143848.486401:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625261056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143848.497498:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625261056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11091us (11446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143848.497509:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7512 00002000:00100000:2.0:1746143848.497519:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012e35ad80 x1830963625261056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.497527:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e35ad80 with x1830963625261056 ext(0->1048575) 00002000:00010000:2.0:1746143848.497532:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e35ad80 00000100:00100000:0.0:1746143848.498474:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.499113:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625261312 00000100:00100000:3.0:1746143848.499122:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625261312 00002000:00100000:3.0:1746143848.499161:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012e359880 x1830963625261312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.499170:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359880 with x1830963625261312 ext(0->1048575) 00002000:00010000:3.0:1746143848.499174:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e359880 00000100:00100000:3.0:1746143848.499219:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7513 00000100:00100000:3.0:1746143848.499229:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625261312:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.507554:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.508979:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625261440 00000100:00100000:3.0:1746143848.508989:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625261440 00000100:00100000:3.0:1746143848.509053:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17192 00000100:00100000:3.0:1746143848.509062:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3094:x1830963625261440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.509081:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.509099:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129a1 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.509121:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.509122:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.509129:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 28 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.509143:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 28 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.509153:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33600, rc 0) 00000100:00100000:3.0:1746143848.511861:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3094:x1830963625261440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2789us (4304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.511871:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17192 00000100:00100000:3.0:1746143848.514468:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625261312:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15235us (15992us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.514477:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7513 00002000:00100000:3.0:1746143848.514486:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88012e359880 x1830963625261312/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.514495:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e359880 with x1830963625261312 ext(0->1048575) 00002000:00010000:3.0:1746143848.514499:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e359880 00000100:00100000:0.0:1746143848.520620:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.520657:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.520699:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.520726:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262080 00000100:00100000:0.0:1746143848.520733:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262080 00002000:00100000:0.0:1746143848.520768:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880090e7a680 x1830963625262080/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.520776:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7a680 with x1830963625262080 ext(1048576->2097151) 00002000:00010000:0.0:1746143848.520780:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e7a680 00000100:00100000:0.0:1746143848.520810:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7514 00000100:00100000:0.0:1746143848.520816:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625262080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143848.521146:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625261568 00000100:00100000:3.0:1746143848.521150:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625261568 00000100:00100000:3.0:1746143848.521172:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17193 00000100:00100000:3.0:1746143848.521177:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+44:3095:x1830963625261568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.521185:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.521200:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129a8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.521218:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.521220:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.521226:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 45 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.521238:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 45 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.521246:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32800, rc 0) 00000100:00100000:3.0:1746143848.521296:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+45:3095:x1830963625261568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.521301:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17193 00000100:00100000:2.0:1746143848.521375:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625261952 00000100:00100000:2.0:1746143848.521379:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625261952 00000100:00100000:2.0:1746143848.521411:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14124 00000100:00100000:2.0:1746143848.521416:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:3092:x1830963625261952:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.521429:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.521431:0:10936:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143848.521447:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6adf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841299a expref: 264 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.521461:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.521465:0:10936:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143848.521471:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73b6afb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129af expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.521504:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.521515:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.521522:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.521527:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.521550:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 9 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.521560:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 9 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.521569:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576448:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.521631:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 7 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.521639:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 7 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.521646:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576576:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.521664:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.525385:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.525513:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.525603:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262336 00000100:00100000:3.0:1746143848.525610:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262336 00000100:00100000:3.0:1746143848.525654:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14125 00000100:00100000:3.0:1746143848.525661:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3090:x1830963625262336:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.525681:0:10936:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from blocking AST (req@ffff88009610ce00 x1830963627576448) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 10 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.525683:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.525685:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143848.525694:0:10936:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 10 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.525714:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576448:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.525716:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d85200/0x87925e4cb73b6a92 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412977 expref: 10 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.525723:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627576576:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.525731:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.525736:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.525742:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.525933:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143848.525934:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.525938:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.525944:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6b09 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129b6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.525944:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143848.525951:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.525980:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.525987:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.525991:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.526003:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.526010:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746143848.526063:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262464 00000100:00100000:1.0:1746143848.526067:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262464 00010000:00010000:1.0:1746143848.526086:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 8 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.526381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.526461:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8438 00000100:00100000:1.0:1746143848.526468:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625262464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.526476:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.526480:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 8 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.526486:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+28:2008:x1830963625262080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5669us (5785us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746143848.526488:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 8 pid: 7245 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.526493:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7514 00010000:00010000:1.0:1746143848.526500:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801368da400/0x87925e4cb73b6a61 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412969 expref: 8 pid: 7245 timeout: 1007 lvb_type: 0 00002000:00100000:0.0:1746143848.526501:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880090e7a680 x1830963625262080/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.526508:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e7a680 with x1830963625262080 ext(1048576->2097151) 00002000:00010000:0.0:1746143848.526511:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090e7a680 00010000:00010000:1.0:1746143848.526513:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.526516:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.526522:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.526527:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143848.526533:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.526536:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746143848.526661:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262592 00000100:00100000:3.0:1746143848.526664:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262592 00000100:00100000:3.0:1746143848.526871:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14126 00000100:00100000:3.0:1746143848.526878:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+265:3095:x1830963625262592:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.526887:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.526894:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129bd expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.526936:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.526943:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.526952:0:7245:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.526960:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 266 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.526974:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.526976:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143848.526978:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.526983:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1e3ce00, rc 0) 00010000:00010000:1.0:1746143848.527014:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.527019:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7448e42d-373a-41e0-9678-9a18291c6700+266:3095:x1830963625262592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 141us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.527024:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14126 00000100:00100000:1.0:1746143848.527030:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963625262464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 563us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.527035:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8438 00010000:00010000:3.0:1746143848.527046:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00010000:00010000:3.0:1746143848.527051:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10936 initiator: MDT0 00000040:00080000:3.0:1746143848.527983:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3321, 88 off280112 00000004:00080000:3.0:1746143848.527989:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752076573ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528020:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3306, 88 off278432 00000004:00080000:3.0:1746143848.528023:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752111010ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528138:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3308, 88 off278616 00000004:00080000:3.0:1746143848.528142:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752230253ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528154:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3322, 88 off280200 00000004:00080000:3.0:1746143848.528157:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752244656ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528177:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3323, 88 off280288 00000004:00080000:3.0:1746143848.528180:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752268098ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528193:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3309, 88 off278704 00000004:00080000:3.0:1746143848.528195:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752283411ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528211:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3310, 88 off278792 00000004:00080000:3.0:1746143848.528214:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752301653ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528220:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3311, 88 off278880 00000004:00080000:3.0:1746143848.528222:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752310298ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528229:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3324, 88 off280376 00000004:00080000:3.0:1746143848.528232:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752319930ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528239:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3312, 88 off278968 00000004:00080000:3.0:1746143848.528241:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752329115ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528251:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3325, 88 off280464 00000004:00080000:3.0:1746143848.528255:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752342426ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528262:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3313, 88 off279056 00000004:00080000:3.0:1746143848.528264:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752352303ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.528284:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3326, 88 off280552 00000004:00080000:3.0:1746143848.528287:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752374710ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528294:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3327, 88 off280640 00000004:00080000:3.0:1746143848.528296:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752384153ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528304:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3328, 88 off280728 00000004:00080000:3.0:1746143848.528307:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752394615ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528314:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3329, 88 off280816 00000004:00080000:3.0:1746143848.528316:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907752404401ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.528325:0:10936:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3314, 88 off279144 00000004:00080000:3.0:1746143848.528327:0:10936:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907752415330ns, next at 850789974850ns, rc = 0 00000100:00100000:1.0:1746143848.529459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.529506:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262720 00000100:00100000:0.0:1746143848.529513:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262720 00000100:00100000:0.0:1746143848.529556:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17194 00000100:00100000:0.0:1746143848.529564:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3094:x1830963625262720:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143848.529576:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143848.529638:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129c4 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.529658:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.529660:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.529666:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.529678:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.529687:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:0.0:1746143848.529730:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3094:x1830963625262720:12345-192.168.202.3@tcp:101:cat.0 Request processed in 166us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.529736:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17194 00000001:00080000:2.0:1746143848.530577:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945221 is committed 00000004:00080000:2.0:1746143848.530583:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2526 committed 00000004:00080000:2.0:1746143848.530599:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2544 committed 00000004:00080000:2.0:1746143848.530603:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2543 committed 00000004:00080000:2.0:1746143848.530604:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2542 committed 00000004:00080000:2.0:1746143848.530606:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2541 committed 00000004:00080000:2.0:1746143848.530610:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2525 committed 00000004:00080000:2.0:1746143848.530612:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2540 committed 00000004:00080000:2.0:1746143848.530614:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2524 committed 00000004:00080000:2.0:1746143848.530616:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2539 committed 00000004:00080000:2.0:1746143848.530618:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2523 committed 00000004:00080000:2.0:1746143848.530619:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2522 committed 00000004:00080000:2.0:1746143848.530620:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2521 committed 00000004:00080000:2.0:1746143848.530622:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2538 committed 00000004:00080000:2.0:1746143848.530623:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2537 committed 00000004:00080000:2.0:1746143848.530624:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2520 committed 00000004:00080000:2.0:1746143848.530626:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2519 committed 00000004:00080000:2.0:1746143848.530627:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2536 committed 00000001:00080000:2.0:1746143848.530635:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945218 is committed 00000001:00080000:2.0:1746143848.530640:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945216 is committed 00010000:00010000:3.0:1746143848.530729:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.530738:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.530741:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143848.530743:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.530750:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.530756:0:10936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746143848.530767:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627577088:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746143848.530773:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 264 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.530782:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 264 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.530791:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627577728:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143848.530800:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.530834:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122667300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.530895:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627577600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.530932:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.530963:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627576960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.530978:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.530995:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627577472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.531007:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.531015:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627576704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.531018:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746143848.531022:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627576832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.531036:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531050:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627577344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.531060:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531074:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143848.531079:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627577856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.531094:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531113:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627578240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.531119:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627577984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.531128:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.531138:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531141:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627578752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.531154:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627578496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.531155:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531165:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143848.531169:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627578368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.531170:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.531182:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746143848.531184:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.531187:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627578112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.531200:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531203:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577088 00000100:00100000:1.0:1746143848.531208:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627578624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.531208:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577088 00000100:00100000:1.0:1746143848.531219:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.531225:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577600 00000100:00100000:0.0:1746143848.531227:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577600 00000100:00100000:1.0:1746143848.531234:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627576960 00000100:00100000:0.0:1746143848.531234:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577472 00000100:00100000:0.0:1746143848.531236:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577472 00000100:00100000:1.0:1746143848.531237:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627576960 00000100:00100000:0.0:1746143848.531241:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627576832 00000100:00100000:0.0:1746143848.531243:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627576832 00000100:00100000:0.0:1746143848.531249:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577344 00000100:00100000:1.0:1746143848.531250:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577856 00000100:00100000:0.0:1746143848.531251:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577344 00000100:00100000:1.0:1746143848.531252:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577856 00000100:00100000:0.0:1746143848.531256:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578240 00000100:00100000:0.0:1746143848.531258:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578240 00000100:00100000:1.0:1746143848.531260:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577984 00000100:00100000:1.0:1746143848.531261:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577984 00000100:00100000:0.0:1746143848.531264:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578752 00000100:00100000:0.0:1746143848.531266:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578752 00000100:00100000:1.0:1746143848.531282:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578496 00000100:00100000:1.0:1746143848.531284:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578496 00000100:00100000:0.0:1746143848.531287:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578368 00000100:00100000:0.0:1746143848.531289:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578368 00000100:00100000:1.0:1746143848.531292:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578112 00000100:00100000:1.0:1746143848.531293:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578112 00000100:00100000:0.0:1746143848.531296:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578624 00000100:00100000:0.0:1746143848.531297:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578624 00000100:00100000:1.0:1746143848.531302:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17195 00000100:00100000:1.0:1746143848.531308:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963627577088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.531311:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17196 00000100:00100000:0.0:1746143848.531314:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17197 00000100:00100000:3.0:1746143848.531316:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963627577600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.531318:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3774:x1830963627577472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.531382:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17198 00000100:00100000:3.0:1746143848.531387:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3774:x1830963627576960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.531394:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17199 00000100:00100000:1.0:1746143848.531399:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3774:x1830963627576832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143848.531431:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00000100:00100000:2.0:1746143848.531432:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17200 00002000:00010000:3.0:1746143848.531433:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.531436:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.531437:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00000100:00100000:2.0:1746143848.531438:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3774:x1830963627577344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143848.531439:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00002000:00010000:1.0:1746143848.531441:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143848.531443:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.531445:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.531447:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.531448:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143848.531464:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3774:x1830963627576960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (483us total) trans 17179874088 rc 0/0 00000100:00100000:3.0:1746143848.531469:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17198 00000100:00100000:1.0:1746143848.531469:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3774:x1830963627576832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (431us total) trans 17179874089 rc 0/0 00000100:00100000:1.0:1746143848.531476:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17199 00000100:00100000:3.0:1746143848.531480:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17201 00000100:00100000:3.0:1746143848.531484:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3771:x1830963627577856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.531488:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17202 00000100:00100000:2.0:1746143848.531493:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3774:x1830963627577344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (431us total) trans 17179874090 rc 0/0 00000100:00100000:2.0:1746143848.531498:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17200 00000100:00100000:2.0:1746143848.531508:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17203 00000100:00100000:2.0:1746143848.531512:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3773:x1830963627577984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143848.531533:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143848.531535:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.531537:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.531538:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.531540:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:2.0:1746143848.531541:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143848.531543:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531544:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531545:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531547:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143848.531559:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3771:x1830963627577856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (464us total) trans 21474841349 rc 0/0 00000100:00100000:2.0:1746143848.531562:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3773:x1830963627577984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (424us total) trans 21474841350 rc 0/0 00000100:00100000:3.0:1746143848.531564:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17201 00000100:00100000:2.0:1746143848.531567:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17203 00000100:00100000:3.0:1746143848.531572:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17204 00000100:00100000:3.0:1746143848.531576:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3771:x1830963627578752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.531584:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17205 00000100:00100000:2.0:1746143848.531588:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3773:x1830963627578496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143848.531616:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:2.0:1746143848.531618:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143848.531620:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143848.531622:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143848.531624:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143848.531625:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3771:x1830963627578752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (470us total) trans 21474841351 rc 0/0 00000100:00100000:3.0:1746143848.531629:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17204 00000100:00100000:1.0:1746143848.531636:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3771:x1830963627578240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.531637:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3773:x1830963627578496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (467us total) trans 21474841352 rc 0/0 00000100:00100000:3.0:1746143848.531638:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17206 00000100:00100000:3.0:1746143848.531641:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3771:x1830963627578368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.531642:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17205 00000100:00100000:2.0:1746143848.531649:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17207 00000100:00100000:2.0:1746143848.531652:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3773:x1830963627578112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.531686:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3771:x1830963627578368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (501us total) trans 21474841353 rc 0/0 00002000:00010000:1.0:1746143848.531687:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143848.531689:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000004:00080000:2.0:1746143848.531691:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4d5500/2, rc 0, transno 21474841350 00002000:00010000:1.0:1746143848.531691:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143848.531692:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00000100:00100000:3.0:1746143848.531693:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17206 00002000:00010000:1.0:1746143848.531694:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143848.531695:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627577984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.531700:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17208 00000004:00080000:2.0:1746143848.531701:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58380/2, rc 0, transno 21474841352 00000100:00100000:3.0:1746143848.531703:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3773:x1830963627578624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143848.531703:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627578496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.531713:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3771:x1830963627578240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (583us total) trans 21474841354 rc 0/0 00000100:00100000:1.0:1746143848.531717:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17202 00002000:00010000:2.0:1746143848.531722:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143848.531724:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531725:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531727:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531729:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143848.531733:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143848.531748:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3773:x1830963627578112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (546us total) trans 21474841355 rc 0/0 00000100:00100000:1.0:1746143848.531748:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627577216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143848.531759:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17207 00000100:00100000:1.0:1746143848.531763:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143848.531767:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627576704 00000100:00100000:2.0:1746143848.531770:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627576704 00000100:00100000:1.0:1746143848.531779:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627577216 00000100:00100000:2.0:1746143848.531782:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17209 00000100:00100000:1.0:1746143848.531782:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627577216 00000100:00100000:2.0:1746143848.531786:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3772:x1830963627576704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.531795:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17210 00000100:00100000:1.0:1746143848.531799:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3772:x1830963627577216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143848.531825:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143848.531828:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531829:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531831:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.531833:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143848.531852:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3772:x1830963627577216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (88us total) trans 17179874092 rc 0/0 00000100:00100000:1.0:1746143848.531857:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17210 00000004:00080000:1.0:1746143848.531876:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7aa00/2, rc 0, transno 17179874092 00000100:00100000:1.0:1746143848.531882:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627577216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.531905:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627578880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.531937:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.531953:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627578880 00000100:00100000:1.0:1746143848.531955:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627578880 00000100:00100000:1.0:1746143848.531967:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17211 00000100:00100000:1.0:1746143848.531970:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3772:x1830963627578880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.532021:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3772:x1830963627578880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (84us total) trans 17179874093 rc 0/0 00000100:00100000:1.0:1746143848.532026:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17211 00000004:00080000:1.0:1746143848.532043:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d843480/2, rc 0, transno 17179874093 00000100:00100000:1.0:1746143848.532046:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627578880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143848.532115:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3772:x1830963627576704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 327us (379us total) trans 17179874091 rc 0/0 00000100:00100000:2.0:1746143848.532121:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17209 00002000:00010000:0.0:1746143848.532170:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143848.532173:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.532174:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143848.532176:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.532177:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143848.532292:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3774:x1830963627577472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 973us (1282us total) trans 17179874087 rc 0/0 00000100:00100000:0.0:1746143848.532298:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17197 00000004:00080000:0.0:1746143848.532323:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b800/2, rc 0, transno 17179874089 00000100:00100000:0.0:1746143848.532326:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627576832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.532332:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972eb100/2, rc 0, transno 17179874090 00000100:00100000:0.0:1746143848.532334:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627577344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.532339:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78700/2, rc 0, transno 17179874088 00000100:00100000:0.0:1746143848.532341:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627576960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.532346:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c3aa00/2, rc 0, transno 17179874087 00000100:00100000:0.0:1746143848.532348:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627577472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143848.532361:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5a680/2, rc 0, transno 21474841353 00000100:00100000:0.0:1746143848.532363:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627578368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143848.532367:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e59180/2, rc 0, transno 21474841351 00000100:00100000:0.0:1746143848.532369:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627578752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143848.532375:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e5bb80/2, rc 0, transno 21474841354 00000100:00100000:0.0:1746143848.532377:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627578240:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143848.532381:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4d7480/2, rc 0, transno 21474841349 00000100:00100000:0.0:1746143848.532383:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627577856:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143848.532446:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c4d5c00/2, rc 0, transno 21474841355 00000100:00100000:3.0:1746143848.532448:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3773:x1830963627578624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 743us (1227us total) trans 21474841356 rc 0/0 00000100:00100000:2.0:1746143848.532449:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627578112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.532453:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17208 00000004:00080000:2.0:1746143848.532456:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e58700/2, rc 0, transno 21474841356 00000100:00100000:2.0:1746143848.532458:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627578624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.532465:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78380/2, rc 0, transno 17179874091 00000100:00100000:1.0:1746143848.532469:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627576704:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143848.532483:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:3.0:1746143848.532485:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.532487:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.532488:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.532490:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:3.0:1746143848.532521:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+60:3771:x1830963627577600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1205us (1589us total) trans 17179874085 rc 0/0 00000100:00100000:3.0:1746143848.532525:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17196 00000004:00080000:1.0:1746143848.532541:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c38e00/2, rc 0, transno 17179874085 00000100:00100000:1.0:1746143848.532545:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627577600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.532901:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963627577088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1592us (2099us total) trans 17179874086 rc 0/0 00000100:00100000:0.0:1746143848.532907:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17195 00000004:00080000:1.0:1746143848.532984:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79c00/2, rc 0, transno 17179874086 00000100:00100000:1.0:1746143848.532988:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627577088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.533348:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.533442:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262848 00000100:00100000:2.0:1746143848.533446:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262848 00000100:00100000:2.0:1746143848.533484:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14127 00000100:00100000:2.0:1746143848.533489:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3094:x1830963625262848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143848.533500:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.533512:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129cb expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.533552:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.533562:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.533645:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627577728:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.533670:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73b6afb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 264 pid: 10936 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143848.533681:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 263 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.533687:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 263 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.533701:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429400, rc 0) 00000100:00100000:3.0:1746143848.533727:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+263:3092:x1830963625261952:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12311us (13069us total) trans 8589945221 rc 0/0 00000100:00100000:3.0:1746143848.533733:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14124 00010000:00010000:2.0:1746143848.533780:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.533783:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143848.533785:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143848.533790:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:2.0:1746143848.533815:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3094:x1830963625262848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 327us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.533819:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14127 00000100:00100000:2.0:1746143848.535186:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627579008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746143848.535226:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.535256:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579008 00000100:00100000:0.0:1746143848.535261:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579008 00000100:00080000:3.0:1746143848.535333:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143848.535376:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1746143848.535383:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627579008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746143848.535402:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1178279104 pending 9912320 free 3910172672 avail 3678650368 00000100:00100000:0.0:1746143848.535429:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3773:x1830963627579008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.535434:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1746143848.535442:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627579008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143848.537338:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.537421:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625262976 00000100:00100000:1.0:1746143848.537428:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625262976 00010000:00010000:1.0:1746143848.537456:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 263 pid: 10936 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.537527:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8439 00000100:00100000:1.0:1746143848.537535:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2011:x1830963625262976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.537548:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.537553:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 263 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.537564:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 263 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.537582:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429400/0x87925e4cb73b6b02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129af expref: 263 pid: 10936 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.537608:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.537612:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.537620:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.537625:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.537632:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 262 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.537660:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.537701:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2011:x1830963625262976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 166us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.537707:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8439 00010000:00010000:3.0:1746143848.537826:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143848.537835:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00000040:00080000:3.0:1746143848.538072:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3330, 88 off280904 00000004:00080000:3.0:1746143848.538077:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762164294ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538098:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3315, 88 off279232 00000004:00080000:3.0:1746143848.538101:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762188997ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538112:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3316, 88 off279320 00000004:00080000:3.0:1746143848.538115:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762203028ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538123:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3331, 88 off280992 00000004:00080000:3.0:1746143848.538126:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762213699ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538132:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3332, 88 off281080 00000004:00080000:3.0:1746143848.538135:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762222755ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538143:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3317, 88 off279408 00000004:00080000:3.0:1746143848.538145:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762232875ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538152:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3318, 88 off279496 00000004:00080000:3.0:1746143848.538154:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762241914ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538164:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3319, 88 off279584 00000004:00080000:3.0:1746143848.538166:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762253960ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538173:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3333, 88 off281168 00000004:00080000:3.0:1746143848.538176:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762263700ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538186:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3320, 88 off279672 00000004:00080000:3.0:1746143848.538188:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762276265ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538197:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3334, 88 off281256 00000004:00080000:3.0:1746143848.538200:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762288284ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538208:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3321, 88 off279760 00000004:00080000:3.0:1746143848.538210:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762298134ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143848.538218:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3335, 88 off281344 00000004:00080000:3.0:1746143848.538220:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762308348ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538227:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3336, 88 off281432 00000004:00080000:3.0:1746143848.538229:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762317214ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538236:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3337, 88 off281520 00000004:00080000:3.0:1746143848.538238:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762325642ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538244:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3338, 88 off281608 00000004:00080000:3.0:1746143848.538246:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907762334040ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143848.538253:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3322, 88 off279848 00000004:00080000:3.0:1746143848.538255:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 907762342950ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143848.544406:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945222 is committed 00000004:00080000:2.0:1746143848.544419:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2534 committed 00000004:00080000:2.0:1746143848.544427:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2553 committed 00000004:00080000:2.0:1746143848.544438:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2552 committed 00000004:00080000:2.0:1746143848.544440:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2551 committed 00000004:00080000:2.0:1746143848.544442:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2550 committed 00000004:00080000:2.0:1746143848.544443:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2533 committed 00000004:00080000:2.0:1746143848.544445:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2549 committed 00000004:00080000:2.0:1746143848.544446:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2532 committed 00000004:00080000:2.0:1746143848.544448:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2548 committed 00000004:00080000:2.0:1746143848.544449:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2531 committed 00000004:00080000:2.0:1746143848.544451:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2530 committed 00000004:00080000:2.0:1746143848.544452:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2529 committed 00000004:00080000:2.0:1746143848.544453:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2547 committed 00000004:00080000:2.0:1746143848.544455:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2546 committed 00000004:00080000:2.0:1746143848.544458:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2528 committed 00000004:00080000:2.0:1746143848.544459:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2527 committed 00000004:00080000:2.0:1746143848.544461:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2545 committed 00010000:00010000:3.0:1746143848.544571:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544585:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.544587:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746143848.544592:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544601:0:7244:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544607:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544614:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544620:0:7244:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544625:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.544647:0:7244:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.544658:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627579392:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.544686:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627579136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.544720:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746143848.544734:0:7244:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 261 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.544738:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627579776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.544742:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627580800:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.544764:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.544772:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143848.544784:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.544790:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579136 00000100:00100000:0.0:1746143848.544791:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579776 00000100:00100000:3.0:1746143848.544795:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579136 00000100:00100000:0.0:1746143848.544797:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579776 00000100:00100000:1.0:1746143848.544800:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.544819:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.544832:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.544832:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580288 00000100:00100000:0.0:1746143848.544834:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580288 00000100:00100000:3.0:1746143848.544837:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17212 00000100:00100000:3.0:1746143848.544843:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3774:x1830963627579136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.544845:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746143848.544849:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627579648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.544849:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580928 00000100:00100000:0.0:1746143848.544852:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580928 00000100:00100000:1.0:1746143848.544863:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.544866:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17213 00000100:00100000:0.0:1746143848.544872:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+60:3774:x1830963627579776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.544874:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.544885:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.544895:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.544906:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.544943:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627581312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.544956:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143848.544970:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579648 00000100:00100000:1.0:1746143848.544972:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580160 00000100:00100000:0.0:1746143848.544973:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579648 00000100:00100000:1.0:1746143848.544975:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580160 00000100:00100000:0.0:1746143848.544985:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580672 00002000:00010000:3.0:1746143848.544986:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746143848.544988:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580672 00002000:00010000:3.0:1746143848.544989:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00000100:00100000:1.0:1746143848.544989:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627581312 00002000:00010000:3.0:1746143848.544991:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00000100:00100000:1.0:1746143848.544991:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627581312 00002000:00010000:3.0:1746143848.544993:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:3.0:1746143848.544994:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143848.544999:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17214 00000100:00100000:0.0:1746143848.545004:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3774:x1830963627580288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.545027:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:3774:x1830963627579136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (307us total) trans 17179874094 rc 0/0 00000100:00100000:1.0:1746143848.545692:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17215 00000100:00100000:3.0:1746143848.545717:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17212 00000100:00100000:3.0:1746143848.545735:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17216 00000100:00100000:3.0:1746143848.545740:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3774:x1830963627579648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.545747:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3774:x1830963627580928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.545799:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:3774:x1830963627579648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (935us total) trans 17179874096 rc 0/0 00000100:00100000:3.0:1746143848.545803:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17216 00000100:00100000:3.0:1746143848.545813:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17217 00000100:00100000:3.0:1746143848.545816:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3774:x1830963627580160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.545817:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3774:x1830963627580928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (983us total) trans 21474841357 rc 0/0 00000100:00100000:1.0:1746143848.545823:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17215 00002000:00010000:0.0:1746143848.545824:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143848.545828:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.545830:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:0.0:1746143848.545831:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00000100:00100000:1.0:1746143848.545833:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17218 00002000:00010000:0.0:1746143848.545833:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143848.545837:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3774:x1830963627580672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143848.545847:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:3.0:1746143848.545850:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.545851:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.545853:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.545855:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:3.0:1746143848.545879:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+64:3774:x1830963627580160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (992us total) trans 17179874097 rc 0/0 00000100:00100000:0.0:1746143848.545879:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3774:x1830963627580288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 874us (1077us total) trans 21474841358 rc 0/0 00000100:00100000:3.0:1746143848.545883:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17217 00000100:00100000:0.0:1746143848.545887:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17214 00000100:00100000:3.0:1746143848.545892:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17219 00000100:00100000:3.0:1746143848.545896:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3774:x1830963627581312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.545958:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3774:x1830963627579776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1085us (1192us total) trans 17179874095 rc 0/0 00000100:00100000:0.0:1746143848.545963:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17213 00000100:00100000:3.0:1746143848.545964:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3774:x1830963627581312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1007us total) trans 21474841359 rc 0/0 00000100:00100000:3.0:1746143848.545969:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17219 00000004:00080000:3.0:1746143848.545996:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6ed80/2, rc 0, transno 17179874096 00000100:00100000:3.0:1746143848.546004:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627579648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143848.546010:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136635f80/2, rc 0, transno 17179874097 00000100:00100000:3.0:1746143848.546012:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143848.546020:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719f480/2, rc 0, transno 21474841359 00000100:00100000:3.0:1746143848.546023:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627581312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143848.546029:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0b800/2, rc 0, transno 21474841358 00000100:00100000:3.0:1746143848.546031:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143848.546036:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719e680/2, rc 0, transno 21474841357 00000100:00100000:3.0:1746143848.546038:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143848.546043:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d840380/2, rc 0, transno 17179874094 00000100:00100000:3.0:1746143848.546045:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627579136:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143848.546051:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79f80/2, rc 0, transno 17179874095 00000100:00100000:3.0:1746143848.546053:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627579776:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143848.546070:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143848.546072:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.546074:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143848.546076:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143848.546078:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:3.0:1746143848.546088:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627581440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.546108:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143848.546126:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0b100/2, rc 0, transno 21474841360 00000100:00100000:3.0:1746143848.546129:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627580672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.546143:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627581440 00000100:00100000:3.0:1746143848.546146:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627581440 00000100:00100000:3.0:1746143848.546166:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17220 00000100:00100000:3.0:1746143848.546171:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3774:x1830963627581440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.546230:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+64:3774:x1830963627581440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (121us total) trans 17179874098 rc 0/0 00000100:00100000:3.0:1746143848.546238:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17220 00000100:00100000:1.0:1746143848.546267:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3774:x1830963627580672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 261us (1191us total) trans 21474841360 rc 0/0 00000004:00080000:2.0:1746143848.546276:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4d880/2, rc 0, transno 17179874098 00000100:00100000:2.0:1746143848.546282:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627581440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.546283:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17218 00000100:00100000:1.0:1746143848.546367:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627579264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.546383:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.546837:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627579904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.546853:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.546864:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627580416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.546881:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.546978:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627581056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.546992:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.547375:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746143848.547380:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627579520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143848.547396:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143848.547412:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579264 00000100:00100000:2.0:1746143848.547417:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579264 00000100:00100000:2.0:1746143848.547439:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579904 00000100:00100000:2.0:1746143848.547441:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579904 00000100:00100000:2.0:1746143848.547450:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580416 00000100:00100000:2.0:1746143848.547451:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580416 00000100:00100000:2.0:1746143848.547461:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627581056 00000100:00100000:2.0:1746143848.547463:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627581056 00000100:00100000:2.0:1746143848.547472:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17221 00000100:00100000:2.0:1746143848.547477:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3771:x1830963627579264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143848.547538:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143848.547540:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.547542:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.547544:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.547546:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143848.547568:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3771:x1830963627579264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1183us total) trans 17179874099 rc 0/0 00000100:00100000:2.0:1746143848.547573:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17221 00000100:00100000:2.0:1746143848.547584:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17222 00000100:00100000:2.0:1746143848.547589:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3771:x1830963627579904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143848.547637:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3771:x1830963627579904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (783us total) trans 17179874100 rc 0/0 00000100:00100000:2.0:1746143848.547642:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17222 00000100:00100000:2.0:1746143848.547651:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17223 00000100:00100000:2.0:1746143848.547656:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3771:x1830963627580416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143848.547692:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143848.547694:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.547696:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.547698:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:2.0:1746143848.547700:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746143848.547720:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17224 00000100:00100000:2.0:1746143848.547720:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963627580416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (838us total) trans 21474841361 rc 0/0 00000100:00100000:2.0:1746143848.547724:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17223 00000100:00100000:3.0:1746143848.547732:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3771:x1830963627581056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143848.547775:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:3.0:1746143848.547778:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.547779:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143848.547781:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143848.547783:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:3.0:1746143848.547802:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3771:x1830963627581056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (809us total) trans 21474841362 rc 0/0 00000100:00100000:3.0:1746143848.547807:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17224 00000100:00100000:1.0:1746143848.547811:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627580032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.547820:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627579520 00000100:00100000:3.0:1746143848.547822:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627579520 00000100:00100000:1.0:1746143848.547825:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143848.547835:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580032 00000100:00100000:1.0:1746143848.547835:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627580544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.547837:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580032 00000100:00100000:1.0:1746143848.547847:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143848.547858:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627581184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.547871:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746143848.547888:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d841c00/2, rc 0, transno 17179874099 00000100:00100000:1.0:1746143848.547892:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627579264:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.547899:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136634a80/2, rc 0, transno 17179874100 00000100:00100000:1.0:1746143848.547901:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627579904:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143848.547906:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627580544 00000004:00080000:1.0:1746143848.547907:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0bb80/2, rc 0, transno 21474841361 00000100:00100000:3.0:1746143848.547908:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627580544 00000100:00100000:1.0:1746143848.547909:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627580416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143848.547930:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719e300/2, rc 0, transno 21474841362 00000100:00100000:1.0:1746143848.547932:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627581056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143848.547944:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627581184 00000100:00100000:1.0:1746143848.547946:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627581184 00000100:00100000:1.0:1746143848.547962:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17225 00000100:00100000:1.0:1746143848.547965:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3771:x1830963627579520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143848.547983:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17226 00000100:00100000:3.0:1746143848.547990:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17227 00000100:00100000:3.0:1746143848.547995:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3771:x1830963627581184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143848.547995:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3771:x1830963627580032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143848.548004:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:1.0:1746143848.548006:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.548008:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.548009:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.548011:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:1.0:1746143848.548030:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3771:x1830963627579520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (633us total) trans 17179874101 rc 0/0 00000100:00100000:1.0:1746143848.548035:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17225 00000100:00100000:1.0:1746143848.548045:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17228 00000100:00100000:1.0:1746143848.548050:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3771:x1830963627580544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143848.548085:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143848.548088:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.548089:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.548091:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143848 -> 1746143848 00002000:00010000:1.0:1746143848.548093:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143848.548109:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3771:x1830963627580544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (261us total) trans 21474841364 rc 0/0 00000100:00100000:1.0:1746143848.548113:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17228 00000004:00080000:1.0:1746143848.548137:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6c700/2, rc 0, transno 17179874101 00000100:00100000:1.0:1746143848.548140:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627579520:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.548146:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0a300/2, rc 0, transno 21474841364 00000100:00100000:1.0:1746143848.548149:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627580544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.548183:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3771:x1830963627581184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (311us total) trans 21474841363 rc 0/0 00000100:00100000:3.0:1746143848.548188:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17227 00002000:00010000:0.0:1746143848.548208:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143848.548211:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.548213:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143848.548214:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143848.548215:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:0.0:1746143848.548251:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3771:x1830963627580032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 260us (424us total) trans 17179874102 rc 0/0 00000100:00100000:0.0:1746143848.548258:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17226 00000004:00080000:1.0:1746143848.548508:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136637100/2, rc 0, transno 17179874102 00000100:00100000:1.0:1746143848.548512:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627580032:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143848.548520:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009719dc00/2, rc 0, transno 21474841363 00000100:00100000:1.0:1746143848.548523:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627581184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143848.552114:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627579392:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143848.552126:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830963627580800:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143848.552166:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33a00/0x87925e4cb73b6b09 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 10 pid: 7244 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746143848.552330:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.552356:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e33c00, rc 0) 00000100:00100000:3.0:1746143848.552667:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3090:x1830963625262336:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 27004us (27287us total) trans 8589945222 rc 0/0 00000100:00100000:3.0:1746143848.552673:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14125 00000100:00100000:2.0:1746143848.552849:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.552940:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.552991:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263104 00000100:00100000:3.0:1746143848.552996:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263104 00000100:00100000:3.0:1746143848.553021:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263232 00000100:00100000:3.0:1746143848.553023:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263232 00000100:00100000:3.0:1746143848.553032:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5505 00000100:00100000:3.0:1746143848.553037:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:3095:x1830963625263104:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:3.0:1746143848.553111:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:3095:x1830963625263104:12345-192.168.202.3@tcp:49:cat.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.553117:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5505 00000100:00100000:3.0:1746143848.553145:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5506 00000100:00100000:3.0:1746143848.553150:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3094:x1830963625263232:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:3.0:1746143848.553305:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3094:x1830963625263232:12345-192.168.202.3@tcp:49:cat.0 Request processed in 154us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.553310:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5506 00000100:00100000:0.0:1746143848.554222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.554289:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263360 00000100:00100000:3.0:1746143848.554294:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263360 00000100:00100000:3.0:1746143848.554359:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14128 00000100:00100000:3.0:1746143848.554365:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:3092:x1830963625263360:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143848.554375:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.554387:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b2c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129d2 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.554421:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b2c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d2 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.554432:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b2c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d2 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.554444:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.554446:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143848.554448:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:3.0:1746143848.554481:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:3092:x1830963625263360:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 116us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.554487:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14128 00000100:00100000:2.0:1746143848.556688:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.556745:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263488 00000100:00100000:3.0:1746143848.556751:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263488 00000100:00100000:3.0:1746143848.556780:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5507 00000100:00100000:3.0:1746143848.556786:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3090:x1830963625263488:12345-192.168.202.3@tcp:49:multiop.0 00000100:00100000:3.0:1746143848.556866:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3090:x1830963625263488:12345-192.168.202.3@tcp:49:multiop.0 Request processed in 79us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.556871:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5507 00000100:00100000:0.0:1746143848.558092:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.558171:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263616 00000100:00100000:0.0:1746143848.558176:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263616 00000100:00100000:0.0:1746143848.558199:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17229 00000100:00100000:0.0:1746143848.558203:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+45:3092:x1830963625263616:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143848.558214:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143848.558227:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129d9 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.558249:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 17 pid: 13430 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143848.558254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143848.558255:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.558257:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143848.558259:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3457024->3944447] (req 3457024->3944447) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.558280:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263744 00000100:00100000:1.0:1746143848.558283:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263744 00010000:00010000:0.0:1746143848.558293:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 17 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143848.558303:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 17 pid: 13430 timeout: 1007 lvb_type: 1 00000100:00100000:0.0:1746143848.558314:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627581568:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143848.558363:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143848.558535:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1014 00000100:00100000:1.0:1746143848.558542:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+263:2008:x1830963625263744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.558550:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.558566:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b2c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d2 expref: 263 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.558590:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.558594:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.558614:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+262:2008:x1830963625263744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.558623:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1014 00000100:00100000:2.0:1746143848.561557:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009719ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627581568:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.561584:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3457024->3944447] (req 3457024->3944447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.561598:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74200, rc 0) 00000100:00100000:2.0:1746143848.561632:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:3092:x1830963625263616:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3428us (3541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.561639:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17229 00000100:00100000:0.0:1746143848.561705:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.562314:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625263872 00000100:00100000:3.0:1746143848.562320:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625263872 00010000:00010000:3.0:1746143848.562343:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 18 pid: 13430 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.562368:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8440 00000100:00100000:3.0:1746143848.562374:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2011:x1830963625263872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.562384:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.562399:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 18 pid: 13430 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.562408:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 18 pid: 13430 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.562427:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b6a14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412962 expref: 18 pid: 13430 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.562449:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.562450:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.562456:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.562463:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.562489:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 45 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.562499:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627581696:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143848.562545:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.562669:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.562855:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625264128 00000100:00100000:2.0:1746143848.562859:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625264128 00002000:00100000:2.0:1746143848.562884:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094196d80 x1830963625264128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.562893:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196d80 with x1830963625264128 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.562897:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196d80 00000100:00100000:2.0:1746143848.562921:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7515 00000100:00100000:2.0:1746143848.562927:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625264128:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143848.563595:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.566009:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625264256 00000100:00100000:2.0:1746143848.566018:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625264256 00000100:00100000:2.0:1746143848.566065:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17230 00000100:00100000:2.0:1746143848.566072:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+30:3090:x1830963625264256:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.566087:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.566102:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129e0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.566125:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.566132:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.566133:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.566136:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.566161:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.566170:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 17 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143848.566180:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627581824:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.566239:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.567538:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.567568:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.567632:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627581696:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143848.567647:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.567675:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009719ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2011:x1830963625263872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5300us (5969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.567683:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8440 00000100:00100000:2.0:1746143848.567757:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625264512 00000100:00100000:2.0:1746143848.567761:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625264512 00002000:00100000:2.0:1746143848.567788:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3457024->3461119) req@ffff880094196300 x1830963625264512/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.567796:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963625264512 ext(3457024->3461119) 00002000:00010000:2.0:1746143848.567800:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196300 00000100:00100000:2.0:1746143848.567810:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625264768 00000100:00100000:2.0:1746143848.567812:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625264768 00002000:00100000:2.0:1746143848.567822:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094194a80 x1830963625264768/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.567828:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194a80 with x1830963625264768 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.567831:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194a80 00000100:00100000:2.0:1746143848.567839:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7516 00000100:00100000:2.0:1746143848.567844:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+48:2010:x1830963625264512:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.567950:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+48:2010:x1830963625264512:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 105us (415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.567955:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7516 00002000:00100000:2.0:1746143848.567959:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3457024->3461119) req@ffff880094196300 x1830963625264512/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.567965:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196300 with x1830963625264512 ext(3457024->3461119) 00002000:00010000:2.0:1746143848.567968:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196300 00000100:00100000:2.0:1746143848.567978:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7517 00000100:00100000:2.0:1746143848.567983:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625264768:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143848.571687:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625264128:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8751us (9010us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.571697:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7515 00002000:00100000:3.0:1746143848.571707:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880094196d80 x1830963625264128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.571715:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094196d80 with x1830963625264128 ext(1048576->2097151) 00002000:00010000:3.0:1746143848.571720:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094196d80 00000100:00100000:2.0:1746143848.571896:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627581824:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.571947:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [2011136->2097151] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.571961:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:2.0:1746143848.571984:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+31:3090:x1830963625264256:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5913us (8390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.571990:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17230 00000100:00100000:0.0:1746143848.572447:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.572805:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625264896 00000100:00100000:3.0:1746143848.572811:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625264896 00010000:00010000:3.0:1746143848.572833:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 18 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.572860:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8441 00000100:00100000:3.0:1746143848.572866:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+18:2009:x1830963625264896:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.572876:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.572889:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 18 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.572899:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 18 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.572951:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d400/0x87925e4cb73b69ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412954 expref: 18 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.572961:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.572963:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.572968:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.572974:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.572996:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 30 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.573005:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627581952:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143848.573050:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.574447:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094194a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625264768:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6459us (6874us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143848.574456:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7517 00002000:00100000:2.0:1746143848.574463:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880094194a80 x1830963625264768/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.574471:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094194a80 with x1830963625264768 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.574476:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094194a80 00000100:00100000:0.0:1746143848.582740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.582771:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.582797:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.582802:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625265280 00000100:00100000:2.0:1746143848.582810:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625265280 00002000:00100000:2.0:1746143848.582850:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3940352->3944447) req@ffff880096e55f80 x1830963625265280/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.582859:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55f80 with x1830963625265280 ext(3940352->3944447) 00002000:00010000:2.0:1746143848.582863:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e55f80 00000100:00100000:2.0:1746143848.582876:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625265536 00000100:00100000:2.0:1746143848.582877:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625265536 00002000:00100000:2.0:1746143848.582888:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (2011136->2015231) req@ffff880096e57480 x1830963625265536/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.582893:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e57480 with x1830963625265536 ext(2011136->2015231) 00002000:00010000:2.0:1746143848.582896:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e57480 00000100:00100000:2.0:1746143848.582906:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7518 00000100:00100000:2.0:1746143848.582929:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625265280:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143848.582940:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7519 00000100:00100000:0.0:1746143848.582946:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963625265536:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143848.583050:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963625265536:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 103us (250us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143848.583056:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7519 00002000:00100000:0.0:1746143848.583061:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (2011136->2015231) req@ffff880096e57480 x1830963625265536/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.583069:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e57480 with x1830963625265536 ext(2011136->2015231) 00002000:00010000:0.0:1746143848.583072:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e57480 00000100:00100000:2.0:1746143848.583156:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+46:2010:x1830963625265280:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 243us (383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.583162:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7518 00002000:00100000:2.0:1746143848.583167:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3940352->3944447) req@ffff880096e55f80 x1830963625265280/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.583174:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e55f80 with x1830963625265280 ext(3940352->3944447) 00002000:00010000:2.0:1746143848.583177:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e55f80 00000100:00100000:2.0:1746143848.583191:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625265024 00000100:00100000:2.0:1746143848.583193:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625265024 00000100:00100000:2.0:1746143848.583226:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17231 00000100:00100000:2.0:1746143848.583231:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:3095:x1830963625265024:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143848.583239:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.583252:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129e7 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.583278:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.583280:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.583286:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.583298:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.583312:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de82600, rc 0) 00000100:00100000:2.0:1746143848.583339:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+47:3095:x1830963625265024:12345-192.168.202.3@tcp:101:cat.0 Request processed in 108us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.583344:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17231 00000100:00100000:3.0:1746143848.583736:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627581952:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143848.583752:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143848.583944:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963625264896:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11077us (11497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.583951:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8441 00000100:00100000:0.0:1746143848.587004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.587078:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625265792 00000100:00100000:2.0:1746143848.587085:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625265792 00002000:00100000:2.0:1746143848.587115:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880096e54000 x1830963625265792/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 504/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.587121:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54000 with x1830963625265792 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.587125:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e54000 00000100:00100000:2.0:1746143848.587139:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7520 00000100:00100000:2.0:1746143848.587143:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963625265792:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143848.591371:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.592053:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266048 00000100:00100000:2.0:1746143848.592063:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266048 00002000:00100000:2.0:1746143848.592101:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880096e56680 x1830963625266048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.592110:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56680 with x1830963625266048 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.592115:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e56680 00000100:00100000:2.0:1746143848.592131:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7521 00000100:00100000:2.0:1746143848.592137:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963625266048:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.605431:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2009:x1830963625265792:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 18278us (18425us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746143848.605442:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7520 00002000:00100000:2.0:1746143848.605454:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880096e54000 x1830963625265792/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 504/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.605462:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e54000 with x1830963625265792 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.605468:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e54000 00000100:00100000:2.0:1746143848.607885:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963625266048:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 15738us (16512us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143848.607897:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7521 00002000:00100000:2.0:1746143848.607908:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880096e56680 x1830963625266048/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.607941:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e56680 with x1830963625266048 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.607946:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e56680 00000100:00100000:0.0:1746143848.614751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.614786:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.615329:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266176 00000100:00100000:1.0:1746143848.615338:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266176 00000100:00100000:0.0:1746143848.615353:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.615408:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266304 00000100:00100000:1.0:1746143848.615410:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266304 00000100:00100000:1.0:1746143848.615429:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266432 00000100:00100000:1.0:1746143848.615431:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266432 00000100:00100000:2.0:1746143848.615437:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17232 00000100:00100000:1.0:1746143848.615446:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17233 00000100:00100000:2.0:1746143848.615449:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17234 00000100:00100000:1.0:1746143848.615451:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963625266304:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143848.615455:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625266432:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143848.615466:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143848.615466:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.615480:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73b6b4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129fc expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.615480:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129f5 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.615498:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.615500:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.615506:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143848.615518:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143848.615520:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627582080:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143848.615526:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00000100:00100000:1.0:1746143848.615564:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963625266304:12345-192.168.202.3@tcp:101:cat.0 Request processed in 112us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.615569:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17233 00000100:00100000:2.0:1746143848.615675:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.615689:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+32:3090:x1830963625266176:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.615696:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.615701:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484129ee expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.615718:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.615725:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.615730:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.615731:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.615733:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.615751:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.615761:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 33 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143848.615770:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627582208:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.615799:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 16 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.615807:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 16 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:2.0:1746143848.615814:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627582336:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.615829:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f240 going to sleep for 11 seconds 00002000:00010000:2.0:1746143848.618655:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143848 -> 1746143849 00002000:00010000:2.0:1746143848.618661:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143848 -> 1746143849 00002000:00010000:2.0:1746143848.618663:0:13436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143848 -> 1746143849 00000100:00100000:2.0:1746143848.618680:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627582080:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143848.618706:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73b6b4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129fc expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.618718:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de83000/0x87925e4cb73b6b4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129fc expref: 30 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.618738:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011de83000, rc 0) 00000100:00100000:2.0:1746143848.618786:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:2008:x1830963625266432:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3331us (3431us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143848.618793:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17234 00000100:00100000:3.0:1746143848.619088:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627582208:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143848.619113:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.619114:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627582336:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.619132:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2605055] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.619144:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:1.0:1746143848.619146:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.619160:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266688 00000100:00100000:3.0:1746143848.619164:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266688 00010000:00010000:3.0:1746143848.619186:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 17 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.619203:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266560 00000100:00100000:3.0:1746143848.619205:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266560 00010000:00010000:3.0:1746143848.619211:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 34 pid: 9585 timeout: 1007 lvb_type: 1 00000100:00100000:3.0:1746143848.619240:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8442 00000100:00100000:3.0:1746143848.619246:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2010:x1830963625266688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143848.619246:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8443 00000100:00100000:2.0:1746143848.619253:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2010:x1830963625266560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143848.619256:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.619261:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143848.619276:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 17 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143848.619277:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 34 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.619283:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 17 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143848.619294:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 34 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143848.619309:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26c00/0x87925e4cb73b6b48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129f5 expref: 34 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:2.0:1746143848.619322:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.619338:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2010:x1830963625266560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.619343:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8443 00010000:00010000:3.0:1746143848.619604:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d800/0x87925e4cb73b6a0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841295b expref: 17 pid: 9585 timeout: 1007 lvb_type: 1 00010000:00010000:3.0:1746143848.619617:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.619618:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.619623:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.619630:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.619653:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 32 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.619662:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627582464:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143848.619717:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.619735:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+32:3090:x1830963625266176:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4291us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.619740:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17232 00000100:00100000:1.0:1746143848.619874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.620518:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266816 00000100:00100000:3.0:1746143848.620523:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266816 00000100:00100000:3.0:1746143848.620555:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17235 00000100:00100000:3.0:1746143848.620561:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:3095:x1830963625266816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.620572:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.620581:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a03 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.620598:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.620603:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.620604:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.620607:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.620622:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 31 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.620631:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 31 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.620638:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627582592:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.620682:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.621414:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.621464:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625266944 00000100:00100000:2.0:1746143848.621469:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625266944 00000100:00100000:2.0:1746143848.621498:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17236 00000100:00100000:2.0:1746143848.621504:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+32:3094:x1830963625266944:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143848.621510:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.621517:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a0a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.621537:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.621542:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143848.621543:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143848.621545:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 33 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.621561:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 33 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.621568:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 33 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:2.0:1746143848.621580:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627582720:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143848.621682:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627582464:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.621700:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.621718:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625266688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2472us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.621725:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8442 00000100:00100000:2.0:1746143848.622034:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.622459:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627582592:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.622472:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.622481:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd87000, rc 0) 00000100:00100000:3.0:1746143848.622501:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+47:3095:x1830963625266816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1941us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.622507:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17235 00000100:00100000:0.0:1746143848.622667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.622941:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625267072 00000100:00100000:3.0:1746143848.622946:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625267072 00002000:00100000:3.0:1746143848.622968:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (2011136->2097151) req@ffff880095c6ad80 x1830963625267072/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.622977:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6ad80 with x1830963625267072 ext(2011136->2097151) 00010000:00010000:3.0:1746143848.622982:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 34 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.622995:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 34 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.623000:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c6ad80 00000100:00100000:3.0:1746143848.623021:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2754 00000100:00100000:3.0:1746143848.623026:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2010:x1830963625267072:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143848.624365:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627582720:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.624382:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.624394:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b6c00, rc 0) 00000100:00100000:2.0:1746143848.624416:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+35:3094:x1830963625266944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2912us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.624422:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17236 00000100:00100000:3.0:1746143848.627611:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2010:x1830963625267072:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4576us (4936us total) trans 17179874103 rc 0/0 00000100:00100000:3.0:1746143848.627621:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2754 00002000:00100000:3.0:1746143848.627631:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (2011136->2097151) req@ffff880095c6ad80 x1830963625267072/t17179874103(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.627639:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6ad80 with x1830963625267072 ext(2011136->2097151) 00010000:00010000:3.0:1746143848.627647:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.627657:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.627663:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c6ad80 00000100:00100000:0.0:1746143848.628134:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.628215:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625267328 00000100:00100000:3.0:1746143848.628221:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625267328 00002000:00100000:3.0:1746143848.628244:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2600960->2605055) req@ffff880095c6b100 x1830963625267328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.628250:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6b100 with x1830963625267328 ext(2600960->2605055) 00010000:00010000:3.0:1746143848.628255:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.628263:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.628276:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c6b100 00000100:00100000:3.0:1746143848.628425:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2755 00000100:00100000:3.0:1746143848.628433:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625267328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143848.628534:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625267328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 102us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143848.628541:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2755 00002000:00100000:3.0:1746143848.628545:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2600960->2605055) req@ffff880095c6b100 x1830963625267328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.628551:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6b100 with x1830963625267328 ext(2600960->2605055) 00010000:00010000:3.0:1746143848.628555:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:3.0:1746143848.628563:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:3.0:1746143848.628568:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c6b100 00000100:00100000:0.0:1746143848.634084:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.634154:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625267456 00000100:00100000:1.0:1746143848.634164:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625267456 00010000:00010000:1.0:1746143848.634205:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.634252:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8444 00000100:00100000:1.0:1746143848.634260:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2010:x1830963625267456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.634299:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143848.634320:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143848 -> 1746143849 00002000:00010000:1.0:1746143848.634323:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143848 -> 1746143849 00002000:00010000:1.0:1746143848.634325:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143848 -> 1746143849 00010000:00010000:1.0:1746143848.634331:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.634342:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.634366:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6b3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e0 expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.634385:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.634388:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.634395:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.634403:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.634436:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.634448:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627582848:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.634538:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.635320:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.635406:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.635453:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625267968 00000100:00100000:3.0:1746143848.635459:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625267968 00000100:00100000:0.0:1746143848.635467:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625267712 00000100:00100000:0.0:1746143848.635471:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625267712 00002000:00100000:0.0:1746143848.635501:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2605055) req@ffff88009610ea00 x1830963625267712/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746143848.635504:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5508 00000100:00100000:3.0:1746143848.635510:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3090:x1830963625267968:12345-192.168.202.3@tcp:35:multiop.0 00002000:00100000:0.0:1746143848.635517:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610ea00 with x1830963625267712 ext(2097152->2605055) 00010000:00010000:0.0:1746143848.635524:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:0.0:1746143848.635536:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 35 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:0.0:1746143848.635543:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009610ea00 00000100:00100000:0.0:1746143848.636071:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2756 00000100:00100000:0.0:1746143848.636079:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625267712:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143848.636094:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3090:x1830963625267968:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 583us (687us total) trans 8589945223 rc 0/0 00000100:00100000:3.0:1746143848.636101:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5508 00000100:00100000:1.0:1746143848.638293:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627582848:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.638314:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.638364:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2010:x1830963625267456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4104us (4288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.638375:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8444 00000100:00100000:0.0:1746143848.640551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.640777:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625268224 00000100:00100000:3.0:1746143848.640786:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625268224 00002000:00100000:3.0:1746143848.640830:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c68380 x1830963625268224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.640840:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963625268224 ext(1048576->2097151) 00002000:00010000:3.0:1746143848.640845:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:3.0:1746143848.640873:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7522 00000100:00100000:3.0:1746143848.640880:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963625268224:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143848.647799:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2008:x1830963625267712:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11708us (12468us total) trans 17179874104 rc 0/0 00000100:00100000:1.0:1746143848.647814:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2756 00002000:00100000:1.0:1746143848.647826:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2605055) req@ffff88009610ea00 x1830963625267712/t17179874104(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143848.647836:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610ea00 with x1830963625267712 ext(2097152->2605055) 00010000:00010000:1.0:1746143848.647846:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 36 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.647866:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 36 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:1.0:1746143848.647872:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009610ea00 00000100:00100000:3.0:1746143848.648824:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963625268224:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7941us (8279us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.648833:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7522 00002000:00100000:3.0:1746143848.648840:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c68380 x1830963625268224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.648848:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68380 with x1830963625268224 ext(1048576->2097151) 00002000:00010000:3.0:1746143848.648855:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68380 00000100:00100000:0.0:1746143848.653018:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.653093:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625268352 00000100:00100000:1.0:1746143848.653103:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625268352 00010000:00010000:1.0:1746143848.653142:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 36 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:0.0:1746143848.653183:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.653185:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8445 00000100:00100000:1.0:1746143848.653193:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2011:x1830963625268352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.653208:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746143848.653226:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143848 -> 1746143849 00002000:00010000:1.0:1746143848.653229:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143848 -> 1746143849 00010000:00010000:1.0:1746143848.653234:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 36 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.653250:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 36 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.653284:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b6b56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2605055) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129ee expref: 36 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.653314:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.653316:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.653324:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.653332:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.653371:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.653383:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627582976:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143848.653420:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625268480 00000100:00100000:2.0:1746143848.653424:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625268480 00000100:00100000:2.0:1746143848.653453:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17237 00000100:00100000:2.0:1746143848.653458:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+47:3095:x1830963625268480:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143848.653458:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095c4b3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143848.653477:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.653490:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a11 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.653504:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.653505:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.653510:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 48 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.653526:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 48 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.653534:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800913b7c00, rc 0) 00000100:00100000:2.0:1746143848.653556:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:3095:x1830963625268480:12345-192.168.202.3@tcp:101:cat.0 Request processed in 97us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.653561:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17237 00000100:00100000:1.0:1746143848.654961:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627582976:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.654977:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.655546:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2011:x1830963625268352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2352us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.655556:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8445 00000100:00100000:0.0:1746143848.659485:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.659743:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625268736 00000100:00100000:3.0:1746143848.659754:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625268736 00002000:00100000:3.0:1746143848.659809:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88007f648700 x1830963625268736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.659820:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648700 with x1830963625268736 ext(2097152->3145727) 00002000:00010000:3.0:1746143848.659825:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648700 00000100:00100000:3.0:1746143848.659865:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7523 00000100:00100000:3.0:1746143848.659873:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625268736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.660936:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.660961:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.660976:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625268992 00000100:00100000:0.0:1746143848.660979:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625268992 00002000:00100000:0.0:1746143848.661002:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88007f64a300 x1830963625268992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.661010:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a300 with x1830963625268992 ext(2097152->4194303) 00002000:00010000:0.0:1746143848.661013:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64a300 00000100:00100000:0.0:1746143848.661023:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625269248 00000100:00100000:0.0:1746143848.661024:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625269248 00002000:00100000:0.0:1746143848.661034:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f648380 x1830963625269248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 504/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.661040:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648380 with x1830963625269248 ext(2097152->4194303) 00002000:00010000:0.0:1746143848.661043:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f648380 00000100:00100000:0.0:1746143848.661052:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7524 00000100:00100000:0.0:1746143848.661056:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+48:2008:x1830963625268992:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.662151:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7525 00000100:00100000:0.0:1746143848.662162:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963625269248:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143848.668038:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625268736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8154us (8559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.668050:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7523 00002000:00100000:3.0:1746143848.668063:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88007f648700 x1830963625268736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.668073:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648700 with x1830963625268736 ext(2097152->3145727) 00002000:00010000:3.0:1746143848.668078:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f648700 00000100:00100000:0.0:1746143848.675198:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.675441:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963625269248:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13279us (14476us total) trans 0 rc 1609728/1609728 00000100:00100000:1.0:1746143848.675452:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7525 00002000:00100000:1.0:1746143848.675465:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f648380 x1830963625269248/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 504/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1609728/1609728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143848.675474:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f648380 with x1830963625269248 ext(2097152->4194303) 00002000:00010000:1.0:1746143848.675480:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f648380 00000100:00100000:3.0:1746143848.675654:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625269376 00000100:00100000:3.0:1746143848.675662:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625269376 00000100:00100000:2.0:1746143848.675936:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+48:2008:x1830963625268992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14878us (15024us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143848.675944:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7524 00002000:00100000:2.0:1746143848.675950:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88007f64a300 x1830963625268992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.675956:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64a300 with x1830963625268992 ext(2097152->4194303) 00002000:00010000:2.0:1746143848.675960:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88007f64a300 00000100:00100000:3.0:1746143848.676199:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17238 00000100:00100000:3.0:1746143848.676208:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3094:x1830963625269376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.676224:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.676242:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a18 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.676279:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.676286:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.676288:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.676291:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.676320:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 46 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.676332:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 46 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:3.0:1746143848.676345:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627583104:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.676406:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.678542:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627583104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.678574:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 30 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.678592:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428000, rc 0) 00000100:00100000:3.0:1746143848.678697:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+30:3094:x1830963625269376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2490us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.678705:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17238 00000100:00100000:0.0:1746143848.679764:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.679873:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625269504 00000100:00100000:2.0:1746143848.679881:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625269504 00002000:00100000:2.0:1746143848.679973:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3457024->3944447) req@ffff88007f64b800 x1830963625269504/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.680336:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b800 with x1830963625269504 ext(3457024->3944447) 00010000:00010000:2.0:1746143848.680345:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 47 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.680363:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 47 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143848.680376:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f64b800 00000100:00100000:2.0:1746143848.680418:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2757 00000100:00100000:2.0:1746143848.680427:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963625269504:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143848.681110:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.681216:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625269632 00000100:00100000:3.0:1746143848.681221:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625269632 00000100:00100000:3.0:1746143848.681247:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17239 00000100:00100000:3.0:1746143848.681253:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+49:3095:x1830963625269632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.681262:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.681289:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a1f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.681310:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.681315:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 50 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.681331:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 50 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.681341:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd86600, rc 0) 00000100:00100000:3.0:1746143848.681557:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+50:3095:x1830963625269632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 302us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.681564:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17239 00000100:00100000:2.0:1746143848.686982:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+50:2010:x1830963625269504:12345-192.168.202.3@tcp:4:cat.0 Request processed in 6543us (7208us total) trans 21474841365 rc 0/0 00000100:00100000:2.0:1746143848.686996:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2757 00002000:00100000:2.0:1746143848.687010:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (3457024->3944447) req@ffff88007f64b800 x1830963625269504/t21474841365(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.687024:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f64b800 with x1830963625269504 ext(3457024->3944447) 00010000:00010000:2.0:1746143848.687036:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 50 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:2.0:1746143848.687051:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 50 pid: 3135 timeout: 1007 lvb_type: 0 00002000:00010000:2.0:1746143848.687058:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88007f64b800 00000001:00080000:1.0:1746143848.687086:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841364 is committed 00000001:00080000:1.0:1746143848.687119:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841340 is committed 00000001:00080000:1.0:1746143848.687137:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841328 is committed 00000001:00080000:1.0:1746143848.687144:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841326 is committed 00000100:00100000:0.0:1746143848.691210:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.691290:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625269760 00000100:00100000:1.0:1746143848.691300:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625269760 00010000:00010000:1.0:1746143848.691338:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 26 pid: 3135 timeout: 1007 lvb_type: 0 00000100:00100000:1.0:1746143848.691383:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8446 00000100:00100000:1.0:1746143848.691392:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625269760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.691410:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.691430:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 26 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.691442:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 26 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.691465:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74200/0x87925e4cb73b6b33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3457024->3944447) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129d9 expref: 26 pid: 3135 timeout: 1007 lvb_type: 0 00010000:00010000:1.0:1746143848.691498:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.691500:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.691507:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.691516:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.691523:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.691524:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.691527:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.691533:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.691563:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.691575:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627583232:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.691671:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.691679:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627583360:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.691699:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143848.693837:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627583232:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.693847:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627583360:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.693865:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.693907:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625269760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2516us (2708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.693944:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8446 00000100:00100000:0.0:1746143848.697748:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.697892:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625270016 00000100:00100000:2.0:1746143848.697902:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625270016 00002000:00100000:2.0:1746143848.697975:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f649500 x1830963625270016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.697985:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963625270016 ext(2097152->4194303) 00002000:00010000:2.0:1746143848.697991:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:2.0:1746143848.698025:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7526 00000100:00100000:2.0:1746143848.698033:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625270016:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.699989:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.700231:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.700311:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625270400 00000100:00100000:3.0:1746143848.700321:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625270400 00002000:00100000:3.0:1746143848.700367:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880136ac9180 x1830963625270400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.700377:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963625270400 ext(2097152->4194303) 00002000:00010000:3.0:1746143848.700384:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:3.0:1746143848.700402:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625270528 00000100:00100000:3.0:1746143848.700405:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625270528 00002000:00100000:3.0:1746143848.700418:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009610d880 x1830963625270528/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.700425:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610d880 with x1830963625270528 ext(3145728->4194303) 00002000:00010000:3.0:1746143848.700428:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610d880 00000100:00100000:3.0:1746143848.700992:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7527 00000100:00100000:3.0:1746143848.701001:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625270400:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143848.701193:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7528 00000100:00100000:1.0:1746143848.701200:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625270528:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143848.718722:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625270528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17509us (18478us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143848.718741:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7528 00002000:00100000:1.0:1746143848.718757:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009610d880 x1830963625270528/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143848.718767:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610d880 with x1830963625270528 ext(3145728->4194303) 00002000:00010000:1.0:1746143848.718785:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610d880 00000100:00100000:0.0:1746143848.719031:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88007f649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625270016:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20998us (21293us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143848.719038:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7526 00002000:00100000:0.0:1746143848.719044:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88007f649500 x1830963625270016/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.719051:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88007f649500 with x1830963625270016 ext(2097152->4194303) 00002000:00010000:0.0:1746143848.719055:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88007f649500 00000100:00100000:3.0:1746143848.724259:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625270400:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23247us (24264us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143848.724286:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7527 00002000:00100000:3.0:1746143848.724303:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880136ac9180 x1830963625270400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.724313:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac9180 with x1830963625270400 ext(2097152->4194303) 00002000:00010000:3.0:1746143848.724319:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136ac9180 00000100:00100000:2.0:1746143848.735105:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.735166:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625270784 00000100:00100000:2.0:1746143848.735177:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625270784 00002000:00100000:2.0:1746143848.735224:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009610f480 x1830963625270784/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.735235:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610f480 with x1830963625270784 ext(4194304->4853759) 00002000:00010000:2.0:1746143848.735240:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610f480 00000100:00100000:2.0:1746143848.735279:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7529 00000100:00100000:2.0:1746143848.735288:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963625270784:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.738865:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.738965:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625270912 00000100:00100000:3.0:1746143848.738975:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625270912 00000100:00100000:3.0:1746143848.739026:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17240 00000100:00100000:3.0:1746143848.739034:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2010:x1830963625270912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.739053:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.739071:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a26 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.739095:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.739097:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143848.739105:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 36 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.739119:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 36 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.739131:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7f200, rc 0) 00000100:00100000:3.0:1746143848.739180:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2010:x1830963625270912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.739186:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17240 00000100:00100000:2.0:1746143848.741194:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963625270784:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5900us (6093us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143848.741204:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7529 00002000:00100000:2.0:1746143848.741213:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009610f480 x1830963625270784/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.741222:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610f480 with x1830963625270784 ext(4194304->4853759) 00002000:00010000:2.0:1746143848.741228:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610f480 00000100:00100000:0.0:1746143848.743034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.743144:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625271168 00000100:00100000:2.0:1746143848.743154:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625271168 00002000:00100000:2.0:1746143848.743197:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880136ac8380 x1830963625271168/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.743206:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8380 with x1830963625271168 ext(4194304->4853759) 00002000:00010000:2.0:1746143848.743211:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8380 00000100:00100000:2.0:1746143848.743229:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7530 00000100:00100000:2.0:1746143848.743236:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2010:x1830963625271168:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143848.751014:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.751190:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625271424 00000100:00100000:3.0:1746143848.751200:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625271424 00000100:00100000:3.0:1746143848.751245:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5509 00000100:00100000:3.0:1746143848.751253:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:3095:x1830963625271424:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143848.751387:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2010:x1830963625271168:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8150us (8358us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143848.751397:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7530 00002000:00100000:2.0:1746143848.751408:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880136ac8380 x1830963625271168/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.751417:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8380 with x1830963625271168 ext(4194304->4853759) 00002000:00010000:2.0:1746143848.751422:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8380 00000100:00100000:3.0:1746143848.751488:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:3095:x1830963625271424:12345-192.168.202.3@tcp:35:cat.0 Request processed in 234us (486us total) trans 8589945224 rc 0/0 00000100:00100000:3.0:1746143848.751494:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5509 00000100:00100000:0.0:1746143848.756546:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.756652:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625271680 00000100:00100000:3.0:1746143848.756663:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625271680 00000100:00100000:3.0:1746143848.756708:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5510 00000100:00100000:3.0:1746143848.756715:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b497050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3094:x1830963625271680:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143848.757577:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b497050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3094:x1830963625271680:12345-192.168.202.3@tcp:35:cat.0 Request processed in 861us (1040us total) trans 8589945225 rc 0/0 00000100:00100000:3.0:1746143848.757585:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5510 00000100:00100000:0.0:1746143848.757847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.760237:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625271936 00000100:00100000:2.0:1746143848.760249:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625271936 00000100:00100000:2.0:1746143848.760331:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14129 00000100:00100000:2.0:1746143848.760339:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3100:x1830963625271936:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.760361:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.760382:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b6b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a2d expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.760460:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760473:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760483:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760494:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760503:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760508:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760609:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760617:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760623:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746143848.760630:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143848.760694:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760699:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760704:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760709:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760713:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143848.760716:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760721:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760733:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143848.760736:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143848.760740:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760744:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760769:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760773:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760777:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760780:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143848.760782:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760785:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760790:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008219e000) 00010000:00010000:2.0:1746143848.760792:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143848.760794:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760797:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.760835:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848000/0x87925e4cb73b6b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.760847:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.760852:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143848.760854:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143848.760856:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9800, rc 0) 00000100:00100000:2.0:1746143848.760952:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3100:x1830963625271936:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 614us (3104us total) trans 8589945226 rc 0/0 00000100:00100000:2.0:1746143848.760959:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14129 00000100:00100000:0.0:1746143848.808298:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.809060:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625272064 00000100:00100000:2.0:1746143848.809071:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625272064 00000100:00100000:2.0:1746143848.809354:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17241 00000100:00100000:2.0:1746143848.809363:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+36:3100:x1830963625272064:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.809383:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.809403:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a34 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.809436:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.809445:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 37 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.809452:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.809454:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.809457:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1617920->2097151] (req 1617920->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.809488:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 37 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.809500:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 37 pid: 13436 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143848.809511:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627583488:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.810715:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 47 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.810726:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 47 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143848.810737:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627583616:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.810766:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.814157:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.814203:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.814301:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625272192 00000100:00100000:1.0:1746143848.814310:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625272192 00010000:00010000:1.0:1746143848.814347:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 38 pid: 13436 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746143848.814373:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625272320 00000100:00100000:1.0:1746143848.814376:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625272320 00010000:00010000:1.0:1746143848.814385:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 48 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143848.814400:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8447 00000100:00100000:1.0:1746143848.814407:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+38:2010:x1830963625272192:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.814420:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.814441:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 38 pid: 13436 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746143848.814452:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 38 pid: 13436 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746143848.814479:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.814519:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+38:2010:x1830963625272192:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.814525:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8447 00000100:00100000:1.0:1746143848.814539:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8448 00000100:00100000:1.0:1746143848.814543:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+48:2010:x1830963625272320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.814549:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.814555:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 48 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.814563:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 48 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.814575:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.814577:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.814584:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.814592:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.814619:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.814630:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627583744:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.814682:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143848.815007:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7f200/0x87925e4cb73b6b80 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a26 expref: 37 pid: 13436 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143848.815024:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627583488:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.815034:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd87000/0x87925e4cb73b6b5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a03 expref: 48 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143848.815042:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627583616:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.815069:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.815078:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849a00, rc 0) 00000100:00100000:2.0:1746143848.815104:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+36:3100:x1830963625272064:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5743us (6819us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.815112:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17241 00000100:00100000:1.0:1746143848.816050:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627583744:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.816064:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.816101:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+47:2010:x1830963625272320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1556us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.816108:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8448 00000100:00100000:0.0:1746143848.817557:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.818073:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625272576 00000100:00100000:2.0:1746143848.818081:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625272576 00002000:00100000:2.0:1746143848.818128:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1617920->1622015) req@ffff880129dc2d80 x1830963625272576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.818139:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2d80 with x1830963625272576 ext(1617920->1622015) 00002000:00010000:2.0:1746143848.818143:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc2d80 00000100:00100000:2.0:1746143848.818170:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7531 00000100:00100000:2.0:1746143848.818179:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963625272576:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.818345:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963625272576:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 167us (793us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.818351:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7531 00002000:00100000:2.0:1746143848.818356:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1617920->1622015) req@ffff880129dc2d80 x1830963625272576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.818363:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129dc2d80 with x1830963625272576 ext(1617920->1622015) 00002000:00010000:2.0:1746143848.818365:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129dc2d80 00000100:00100000:0.0:1746143848.822556:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.822644:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625272832 00000100:00100000:2.0:1746143848.822654:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625272832 00000100:00100000:2.0:1746143848.825244:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14130 00000100:00100000:2.0:1746143848.825276:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+263:3104:x1830963625272832:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.825304:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.825327:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6bb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a3b expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.825408:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825421:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825434:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825447:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825452:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825458:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825555:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825564:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825569:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746143848.825578:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143848.825655:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825661:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825667:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825673:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825679:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143848.825683:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825688:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825698:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143848.825700:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143848.825704:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.825708:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826264:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826279:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826283:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826288:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b8400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143848.826291:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826295:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826303:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008219e100) 00010000:00010000:2.0:1746143848.826305:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143848.826308:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143848.826313:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8400/0x87925e4cb73b6bbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.826709:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 266 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.826738:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 265 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.826744:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.826746:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143848.826748:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e504e00, rc 0) 00000100:00100000:3.0:1746143848.826808:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:3104:x1830963625272832:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1552us (4260us total) trans 8589945227 rc 0/0 00000100:00100000:3.0:1746143848.826815:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14130 00000100:00100000:0.0:1746143848.827874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.829157:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625272960 00000100:00100000:2.0:1746143848.829168:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625272960 00000100:00100000:2.0:1746143848.829229:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17242 00000100:00100000:2.0:1746143848.829237:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+36:3100:x1830963625272960:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143848.829257:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.829284:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a42 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.829313:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.829321:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 46 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.829328:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.829330:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.829334:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.829367:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 46 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.829378:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 46 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143848.829391:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627583872:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.829482:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.829490:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143848.829498:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627584000:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.829516:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.830278:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.830342:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625273216 00000100:00100000:0.0:1746143848.830347:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625273216 00000100:00100000:0.0:1746143848.830388:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5511 00000100:00100000:0.0:1746143848.830393:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:3104:x1830963625273216:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:0.0:1746143848.831330:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:3104:x1830963625273216:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 934us (1061us total) trans 8589945228 rc 0/0 00000100:00100000:0.0:1746143848.831337:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5511 00000100:00100000:2.0:1746143848.836339:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627583872:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143848.836350:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627584000:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143848.836381:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->2174975] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 37 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.836399:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74a00, rc 0) 00000100:00100000:2.0:1746143848.837187:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+37:3100:x1830963625272960:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7946us (9312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.837201:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17242 00000100:00100000:0.0:1746143848.841375:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.841731:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.841963:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625273344 00000100:00100000:1.0:1746143848.841973:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625273344 00010000:00010000:1.0:1746143848.842012:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 47 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143848.843243:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625273472 00000100:00100000:2.0:1746143848.843253:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625273472 00010000:00010000:2.0:1746143848.843286:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143848.843288:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8449 00000100:00100000:1.0:1746143848.843297:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963625273344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143848.843306:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8450 00000100:00100000:2.0:1746143848.843310:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+37:2010:x1830963625273472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.843314:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.843316:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143848.843333:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.843334:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 47 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.843344:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 47 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143848.843352:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.843376:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b7c00/0x87925e4cb73b6b6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a11 expref: 47 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143848.843380:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800913b6c00/0x87925e4cb73b6b64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a0a expref: 37 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143848.843405:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.843407:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143848.843414:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.843421:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.843429:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143848.843452:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143848.843464:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627584128:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.843475:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625273344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 180us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.843480:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8449 00000100:00100000:2.0:1746143848.843513:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.846497:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627584128:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143848.846520:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143848.846787:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2010:x1830963625273472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3473us (5052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143848.846798:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8450 00000100:00100000:0.0:1746143848.854770:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.857496:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625273728 00000100:00100000:2.0:1746143848.857511:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625273728 00002000:00100000:2.0:1746143848.857567:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2170880->2174975) req@ffff880092144000 x1830963625273728/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.857579:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144000 with x1830963625273728 ext(2170880->2174975) 00002000:00010000:2.0:1746143848.857584:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144000 00000100:00100000:2.0:1746143848.857621:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7532 00000100:00100000:2.0:1746143848.857630:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963625273728:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143848.857786:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2009:x1830963625273728:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 156us (3027us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143848.857793:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7532 00002000:00100000:2.0:1746143848.857799:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2170880->2174975) req@ffff880092144000 x1830963625273728/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/4536 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.857806:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092144000 with x1830963625273728 ext(2170880->2174975) 00002000:00010000:2.0:1746143848.857809:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092144000 00000100:00100000:0.0:1746143848.865698:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.866164:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625273984 00000100:00100000:1.0:1746143848.866175:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625273984 00000100:00100000:1.0:1746143848.867145:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5512 00000100:00100000:1.0:1746143848.867157:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3100:x1830963625273984:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143848.867411:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3100:x1830963625273984:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 257us (1722us total) trans 8589945229 rc 0/0 00000100:00100000:1.0:1746143848.867417:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5512 00000100:00100000:0.0:1746143848.878342:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.880957:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625274240 00000100:00100000:3.0:1746143848.880971:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625274240 00000100:00100000:3.0:1746143848.881029:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14131 00000100:00100000:3.0:1746143848.881038:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:3107:x1830963625274240:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.881063:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.881085:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73b6bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a49 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.881163:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881177:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881188:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881199:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881204:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881209:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881312:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bf0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881320:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881325:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143848.881333:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143848.881404:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881410:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881415:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881420:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881426:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d429000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.881430:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881436:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881447:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143848.881449:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.881453:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881458:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429000/0x87925e4cb73b6be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881479:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881484:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881488:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881495:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143848.881497:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881501:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881506:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880135539f00) 00010000:00010000:3.0:1746143848.881507:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143848.881509:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881512:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b6be9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143848.881545:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429e00/0x87925e4cb73b6bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a49 expref: 269 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.881555:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a49 expref: 268 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.881560:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143848.881562:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143848.881564:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849400, rc 0) 00000100:00100000:3.0:1746143848.881613:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+268:3107:x1830963625274240:12345-192.168.202.3@tcp:101:cat.0 Request processed in 577us (3281us total) trans 8589945230 rc 0/0 00000100:00100000:3.0:1746143848.881618:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14131 00000100:00100000:0.0:1746143848.892699:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.892737:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.893223:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.893273:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625274624 00000100:00100000:0.0:1746143848.893282:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625274624 00000100:00100000:0.0:1746143848.893337:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1015 00000100:00100000:0.0:1746143848.893345:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+268:2008:x1830963625274624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143848.893361:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143848.893387:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849400/0x87925e4cb73b6bf0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a49 expref: 268 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143848.893408:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143848.893413:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143848.893453:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+267:2008:x1830963625274624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143848.893459:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1015 00000100:00100000:3.0:1746143848.893668:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625274368 00000100:00100000:3.0:1746143848.893672:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625274368 00000100:00100000:2.0:1746143848.893680:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625274496 00000100:00100000:2.0:1746143848.893685:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625274496 00000100:00100000:3.0:1746143848.893697:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17243 00000100:00100000:3.0:1746143848.893702:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+47:2009:x1830963625274368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.893717:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143848.893723:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17244 00000100:00100000:2.0:1746143848.893730:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+47:2008:x1830963625274496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.893731:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b6bfe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a50 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143848.893739:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143848.893748:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b6c05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a57 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143848.893778:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627584256:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143848.893779:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627584384:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143848.893840:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143848.894032:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.896701:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627584256:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143848.896732:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b6bfe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a50 expref: 49 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.896747:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849e00/0x87925e4cb73b6bfe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a50 expref: 49 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143848.896771:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849e00, rc 0) 00000100:00100000:3.0:1746143848.896816:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+48:2009:x1830963625274368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3107us (4123us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143848.896825:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17243 00002000:00010000:2.0:1746143848.897094:0:3135:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143848 -> 1746143849 00000100:00100000:2.0:1746143848.897107:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627584384:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143848.897123:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b6c05 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a57 expref: 47 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.897131:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75800/0x87925e4cb73b6c05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a57 expref: 47 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143848.897141:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:2.0:1746143848.897450:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+46:2008:x1830963625274496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3721us (4711us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143848.897456:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17244 00000100:00100000:2.0:1746143848.903832:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143848.903947:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625274880 00000100:00100000:0.0:1746143848.903958:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625274880 00002000:00100000:0.0:1746143848.904002:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009610e680 x1830963625274880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.904013:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610e680 with x1830963625274880 ext(0->1048575) 00002000:00010000:0.0:1746143848.904019:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610e680 00000100:00100000:0.0:1746143848.904047:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7533 00000100:00100000:0.0:1746143848.904054:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625274880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.917028:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625274880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12961us (13193us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143848.917044:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7533 00002000:00100000:0.0:1746143848.917058:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88009610e680 x1830963625274880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.917068:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610e680 with x1830963625274880 ext(0->1048575) 00002000:00010000:0.0:1746143848.917075:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009610e680 00000100:00100000:0.0:1746143848.940421:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.940579:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625275008 00000100:00100000:2.0:1746143848.940589:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625275008 00000100:00100000:3.0:1746143848.941401:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17245 00000100:00100000:3.0:1746143848.941414:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:3107:x1830963625275008:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143848.941434:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143848.941453:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a5e expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.941485:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.941493:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.941495:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143848.941499:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 47 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.941531:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.941542:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 35 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143848.941553:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627584512:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143848.941651:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143848.943458:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627584512:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143848.943490:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 47 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143848.943505:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429000, rc 0) 00000100:00100000:3.0:1746143848.943551:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+47:3107:x1830963625275008:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2140us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143848.943559:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17245 00000100:00100000:0.0:1746143848.948625:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143848.948800:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625275136 00000100:00100000:2.0:1746143848.948810:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625275136 00002000:00100000:2.0:1746143848.948863:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1617920->2097151) req@ffff880093415500 x1830963625275136/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.948874:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415500 with x1830963625275136 ext(1617920->2097151) 00010000:00010000:2.0:1746143848.948884:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 36 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143848.948899:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 36 pid: 3135 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143848.948905:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093415500 00000100:00100000:2.0:1746143848.948970:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2758 00000100:00100000:2.0:1746143848.948978:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+36:2011:x1830963625275136:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143848.961024:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+38:2011:x1830963625275136:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 12032us (12397us total) trans 17179874105 rc 0/0 00000100:00100000:0.0:1746143848.961039:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2758 00002000:00100000:0.0:1746143848.961051:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1617920->2097151) req@ffff880093415500 x1830963625275136/t17179874105(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:244/0 lens 488/448 e 0 to 0 dl 1746143859 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143848.961060:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415500 with x1830963625275136 ext(1617920->2097151) 00010000:00010000:0.0:1746143848.961072:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 38 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143848.961089:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 38 pid: 3135 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143848.961096:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093415500 00000001:00080000:0.0:1746143848.965565:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874105 is committed 00000001:00080000:0.0:1746143848.965592:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874102 is committed 00000001:00080000:0.0:1746143848.965643:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874075 is committed 00000001:00080000:0.0:1746143848.965666:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874062 is committed 00000100:00100000:0.0:1746143848.966408:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.967446:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625275264 00000100:00100000:1.0:1746143848.967457:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625275264 00010000:00010000:1.0:1746143848.967498:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143848.967528:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8451 00000100:00100000:1.0:1746143848.967536:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2010:x1830963625275264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143848.967550:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143848.970816:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.970832:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.970859:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d849a00/0x87925e4cb73b6baa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a34 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143848.970890:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.970892:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143848.970900:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.970908:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.970973:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143848.970988:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627584640:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143848.971107:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143848.976770:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143848.976876:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627584640:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143848.976899:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143848.976968:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3e94050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2010:x1830963625275264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 9431us (10564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143848.976980:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8451 00000100:00100000:2.0:1746143848.977117:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625275520 00000100:00100000:2.0:1746143848.977125:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625275520 00002000:00100000:2.0:1746143848.977163:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093417480 x1830963625275520/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/0 e 0 to 0 dl 1746143859 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143848.977173:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417480 with x1830963625275520 ext(1048576->2097151) 00002000:00010000:2.0:1746143848.977178:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093417480 00000100:00100000:2.0:1746143848.977372:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7534 00000100:00100000:2.0:1746143848.977379:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963625275520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143848.988466:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143848.989422:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963625275520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12040us (12660us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143848.989433:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7534 00002000:00100000:3.0:1746143848.989446:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093417480 x1830963625275520/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:244/0 lens 488/440 e 0 to 0 dl 1746143859 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143848.989455:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093417480 with x1830963625275520 ext(1048576->2097151) 00002000:00010000:3.0:1746143848.989460:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093417480 00000100:00100000:1.0:1746143848.990370:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625275776 00000100:00100000:1.0:1746143848.990381:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625275776 00000100:00100000:1.0:1746143848.990436:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14132 00000100:00100000:1.0:1746143848.990444:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3111:x1830963625275776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143848.990464:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143848.990483:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b6c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a65 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.990558:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990571:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990581:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990595:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990600:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990604:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990697:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6c28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990705:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990709:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6c28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143848.990717:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143848.990781:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990786:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990791:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990796:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990800:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3ac00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143848.990804:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990810:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990819:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143848.990821:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143848.990824:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990828:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b6c1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990850:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990855:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990859:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990862:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3ba00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143848.990864:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990867:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990871:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600b600) 00010000:00010000:1.0:1746143848.990873:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143848.990874:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990878:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b6c21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143848.990909:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3aa00/0x87925e4cb73b6c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a65 expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.990944:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6c28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a65 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143848.990950:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143848.990951:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143848.990954:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3b400, rc 0) 00000100:00100000:1.0:1746143848.991001:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:3111:x1830963625275776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 557us (2547us total) trans 8589945231 rc 0/0 00000100:00100000:1.0:1746143848.991007:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14132 00010000:00010000:1.0:1746143848.991062:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143849.004079:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.004126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.004152:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625275904 00000100:00100000:3.0:1746143849.004161:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625275904 00000100:00100000:0.0:1746143849.004166:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.004205:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625276160 00000100:00100000:3.0:1746143849.004208:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625276160 00000100:00100000:0.0:1746143849.004216:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17246 00000100:00100000:0.0:1746143849.004227:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2008:x1830963625275904:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143849.004231:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17247 00000100:00100000:3.0:1746143849.004237:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+23:3107:x1830963625276160:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143849.004246:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.004246:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.004271:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a73 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.004274:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a6c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.004295:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.004297:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.004300:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 8 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.004304:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.004307:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143849.004308:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143849.004311:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.004319:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.004328:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d7fa00, rc 0) 00010000:00010000:3.0:1746143849.004340:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 8 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.004351:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.004368:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627584768:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.004516:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625276032 00000100:00100000:1.0:1746143849.004520:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625276032 00000100:00100000:1.0:1746143849.004554:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1016 00000100:00100000:1.0:1746143849.004559:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625276032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.004569:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.004587:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6c28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a65 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.004605:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.004609:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1746143849.004850:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746143849.004855:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143849.005765:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625275904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1537us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.005772:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17246 00000100:00100000:1.0:1746143849.005908:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625276032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1348us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.005931:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.005931:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1016 00000100:00100000:3.0:1746143849.031559:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627584768:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.031591:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.031608:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428600, rc 0) 00000100:00100000:3.0:1746143849.031651:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:3107:x1830963625276160:12345-192.168.202.3@tcp:101:cat.0 Request processed in 27413us (27483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.031659:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17247 00000100:00100000:0.0:1746143849.033594:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.033683:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625276288 00000100:00100000:3.0:1746143849.033692:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625276288 00002000:00100000:3.0:1746143849.033736:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2174975) req@ffff880093415180 x1830963625276288/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.033746:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415180 with x1830963625276288 ext(2097152->2174975) 00010000:00010000:3.0:1746143849.033754:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.033768:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 8 pid: 3135 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.033774:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093415180 00000100:00100000:3.0:1746143849.033808:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2759 00000100:00100000:3.0:1746143849.033815:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625276288:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143849.043030:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.043068:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.043111:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.043177:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625276544 00000100:00100000:3.0:1746143849.043191:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625276544 00000100:00100000:1.0:1746143849.043218:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625277056 00000100:00100000:1.0:1746143849.043222:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625277056 00002000:00100000:3.0:1746143849.043234:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096e57b80 x1830963625276544/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.043240:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6e300 x1830963625277056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.043243:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e57b80 with x1830963625276544 ext(0->1048575) 00002000:00100000:1.0:1746143849.043248:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6e300 with x1830963625277056 ext(1048576->2097151) 00002000:00010000:3.0:1746143849.043249:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e57b80 00002000:00010000:1.0:1746143849.043252:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6e300 00000100:00100000:3.0:1746143849.043289:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625276800 00000100:00100000:3.0:1746143849.043291:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625276800 00000100:00100000:1.0:1746143849.043316:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7535 00000100:00100000:1.0:1746143849.043323:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625276544:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143849.043331:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880129e6d180 x1830963625276800/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.043337:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d180 with x1830963625276800 ext(1048576->2097151) 00002000:00010000:3.0:1746143849.043340:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e6d180 00000100:00100000:3.0:1746143849.043353:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7536 00000100:00100000:3.0:1746143849.043359:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625277056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.043462:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7537 00000100:00100000:2.0:1746143849.043472:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625276800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.054594:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.054675:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625277184 00000100:00100000:3.0:1746143849.054683:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625277184 00000100:00100000:3.0:1746143849.054737:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17248 00000100:00100000:3.0:1746143849.054749:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:3104:x1830963625277184:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143849.054762:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.054776:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a7a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.054801:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.054812:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.054817:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.054819:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.054822:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.054846:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.054855:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.054864:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627584896:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.054949:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.054957:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 9 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.054964:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627585024:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.054986:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00080000:2.0:1746143849.055186:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143849.056365:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625276544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13033us (13338us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143849.056378:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7535 00002000:00100000:0.0:1746143849.056390:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880096e57b80 x1830963625276544/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.056400:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e57b80 with x1830963625276544 ext(0->1048575) 00002000:00010000:0.0:1746143849.056406:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e57b80 00000100:00100000:2.0:1746143849.057980:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625276288:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 24158us (24387us total) trans 17179874106 rc 0/0 00000100:00100000:2.0:1746143849.057991:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2759 00002000:00100000:2.0:1746143849.057999:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2174975) req@ffff880093415180 x1830963625276288/t17179874106(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.058008:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415180 with x1830963625276288 ext(2097152->2174975) 00010000:00010000:2.0:1746143849.058016:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 12 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.058028:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 12 pid: 3135 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143849.058034:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093415180 00000100:00100000:3.0:1746143849.060340:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625277056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16974us (17264us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.060352:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7536 00002000:00100000:3.0:1746143849.060360:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880129e6e300 x1830963625277056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.060366:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6e300 with x1830963625277056 ext(1048576->2097151) 00002000:00010000:3.0:1746143849.060371:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6e300 00000100:00100000:3.0:1746143849.061482:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627584896:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.061490:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627585024:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.061517:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2813952->3145727] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 26 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.061532:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:3.0:1746143849.061568:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:3104:x1830963625277184:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6823us (6980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.061574:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17248 00000100:00100000:0.0:1746143849.064614:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.064767:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625277312 00000100:00100000:1.0:1746143849.064776:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625277312 00010000:00010000:1.0:1746143849.064807:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.065028:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625276800:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21557us (21915us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143849.065038:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7537 00002000:00100000:2.0:1746143849.065046:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880129e6d180 x1830963625276800/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.065054:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d180 with x1830963625276800 ext(1048576->2097151) 00002000:00010000:2.0:1746143849.065059:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129e6d180 00000100:00100000:1.0:1746143849.065140:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8452 00000100:00100000:1.0:1746143849.065148:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2011:x1830963625277312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.065159:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.065174:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 8 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.065663:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 8 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.065684:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d428000/0x87925e4cb73b6b72 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a18 expref: 8 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.065712:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.065743:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625277312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 597us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.065749:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8452 00000100:00100000:0.0:1746143849.069609:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.070776:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.070867:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625277440 00000100:00100000:3.0:1746143849.070876:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625277440 00010000:00010000:3.0:1746143849.070983:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.071017:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625277568 00000100:00100000:3.0:1746143849.071021:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625277568 00010000:00010000:3.0:1746143849.071032:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 10 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.071063:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8453 00000100:00100000:3.0:1746143849.071071:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625277440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.071084:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.071101:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.071109:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.071128:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd86600/0x87925e4cb73b6b79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a1f expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.071146:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.071148:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.071153:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.071159:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.071188:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.071198:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627585152:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143849.071279:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.071558:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8454 00000100:00100000:0.0:1746143849.071565:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625277568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143849.071575:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143849.071586:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 10 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.071593:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 10 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.071605:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b6bd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2174975) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a42 expref: 10 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.071627:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.071628:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.071632:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.071638:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.071654:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143849.071661:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627585280:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143849.071682:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.079954:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627585152:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.079975:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.080014:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625277440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8943us (10410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.080024:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8453 00000100:00100000:0.0:1746143849.081608:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627585280:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143849.081624:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143849.081664:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625277568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10099us (10891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.081673:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8454 00000100:00100000:0.0:1746143849.086129:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.086181:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.086286:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625277952 00000100:00100000:2.0:1746143849.086297:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625277952 00002000:00100000:2.0:1746143849.086341:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880129e6ea00 x1830963625277952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.086355:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6ea00 with x1830963625277952 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.086360:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6ea00 00000100:00100000:2.0:1746143849.086378:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625278080 00000100:00100000:2.0:1746143849.086380:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625278080 00002000:00100000:2.0:1746143849.086391:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c6b480 x1830963625278080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.086396:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6b480 with x1830963625278080 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.086398:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6b480 00000100:00100000:2.0:1746143849.086410:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7538 00000100:00100000:2.0:1746143849.086415:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625277952:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143849.087568:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7539 00000100:00100000:2.0:1746143849.087578:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625278080:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143849.093222:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.093279:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.093305:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625278208 00000100:00100000:0.0:1746143849.093314:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625278208 00000100:00100000:0.0:1746143849.093364:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625278336 00000100:00100000:0.0:1746143849.093366:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625278336 00000100:00100000:0.0:1746143849.093383:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17249 00000100:00100000:0.0:1746143849.093390:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625278208:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.093410:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143849.093425:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17250 00010000:00010000:0.0:1746143849.093428:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a81 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.093439:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625278336:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.093453:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.093455:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.093456:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.093465:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.093470:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b6c52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a88 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.093482:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.093493:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429600, rc 0) 00000100:00100000:3.0:1746143849.093513:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627585408:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143849.093532:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625278208:12345-192.168.202.3@tcp:101:cat.0 Request processed in 140us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.093540:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17249 00000100:00100000:3.0:1746143849.093559:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.108596:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627585408:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143849.108629:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b6c52 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a88 expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.108642:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32600/0x87925e4cb73b6c52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a88 expref: 8 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.108657:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32600, rc 0) 00000100:00100000:3.0:1746143849.108717:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+7:2011:x1830963625278336:12345-192.168.202.3@tcp:101:cat.0 Request processed in 15282us (15437us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143849.108725:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17250 00000100:00100000:0.0:1746143849.115585:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625277952:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 29161us (29460us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143849.115594:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7538 00002000:00100000:0.0:1746143849.115605:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880129e6ea00 x1830963625277952/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.115613:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6ea00 with x1830963625277952 ext(2097152->4194303) 00002000:00010000:0.0:1746143849.115619:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6ea00 00000100:00100000:2.0:1746143849.126075:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625278080:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 38491us (39884us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143849.126086:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7539 00002000:00100000:2.0:1746143849.126094:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095c6b480 x1830963625278080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.126102:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6b480 with x1830963625278080 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.126107:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c6b480 00000100:00100000:0.0:1746143849.134578:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.134905:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625278848 00000100:00100000:1.0:1746143849.134938:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625278848 00000100:00100000:1.0:1746143849.135707:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14133 00000100:00100000:1.0:1746143849.135715:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3113:x1830963625278848:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143849.135737:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.135753:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73b6c59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a8f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.135807:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135817:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135825:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135836:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135841:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135845:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135952:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b6c6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135960:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b6c6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.135967:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b6c6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143849.135976:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143849.136030:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136036:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136041:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136046:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136050:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012323b200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.136053:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136058:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136066:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143849.136069:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.136072:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136076:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323b200/0x87925e4cb73b6c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136089:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136098:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136102:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136106:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012323ac00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.136108:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136112:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136116:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600b000) 00010000:00010000:1.0:1746143849.136118:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.136120:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136124:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323ac00/0x87925e4cb73b6c67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.136152:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323a600/0x87925e4cb73b6c59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a8f expref: 18 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.136161:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b6c6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a8f expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.136166:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.136168:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143849.136170:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323bc00, rc 0) 00000100:00100000:1.0:1746143849.136208:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3113:x1830963625278848:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 494us (1638us total) trans 8589945232 rc 0/0 00000100:00100000:1.0:1746143849.136215:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14133 00000100:00100000:0.0:1746143849.140395:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.140442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.140444:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625278592 00000100:00100000:2.0:1746143849.140451:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625278592 00002000:00100000:2.0:1746143849.140492:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880135b09500 x1830963625278592/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.140504:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09500 with x1830963625278592 ext(2097152->3145727) 00002000:00010000:2.0:1746143849.140509:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135b09500 00000100:00100000:2.0:1746143849.140525:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7540 00000100:00100000:2.0:1746143849.140532:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625278592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.140986:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625278976 00000100:00100000:3.0:1746143849.140990:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625278976 00000100:00100000:3.0:1746143849.141022:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17251 00000100:00100000:3.0:1746143849.141027:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:3104:x1830963625278976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143849.141038:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.141055:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a96 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.141076:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.141082:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.141088:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.141089:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.141092:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3743743] (req 3145728->3743743) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.141115:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.141124:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 11 pid: 12327 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143849.141135:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627585536:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.141219:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.141227:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 25 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.141240:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627585664:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.141258:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.147021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.148056:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625279232 00000100:00100000:2.0:1746143849.148063:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625279232 00002000:00100000:2.0:1746143849.148101:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880135b08e00 x1830963625279232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.148110:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08e00 with x1830963625279232 ext(4194304->4853759) 00010000:00010000:2.0:1746143849.148118:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.148129:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143849.148135:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b08e00 00000100:00100000:2.0:1746143849.148169:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2760 00000100:00100000:2.0:1746143849.148176:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625279232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.167982:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627585536:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143849.170645:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.171228:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627585664:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.171257:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3743743] (req 3145728->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 27 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.171283:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:3.0:1746143849.171953:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:3104:x1830963625278976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 30924us (31509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.171961:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17251 00000100:00100000:1.0:1746143849.172380:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625279360 00000100:00100000:1.0:1746143849.172386:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625279360 00000100:00100000:1.0:1746143849.172422:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1017 00000100:00100000:1.0:1746143849.172427:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625279360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.172438:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.172457:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b6c6e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a8f expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.172473:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.172476:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.172493:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625279360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.172498:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1017 00000100:00100000:0.0:1746143849.172742:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625279232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24566us (25727us total) trans 0 rc 659456/659456 00000100:00100000:0.0:1746143849.172749:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2760 00002000:00100000:0.0:1746143849.172756:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880135b08e00 x1830963625279232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.172765:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b08e00 with x1830963625279232 ext(4194304->4853759) 00010000:00010000:0.0:1746143849.172771:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 25 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.172779:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 25 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.172789:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b08e00 00000100:00100000:3.0:1746143849.172873:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625278592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 32342us (32486us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.172878:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7540 00002000:00100000:3.0:1746143849.172883:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880135b09500 x1830963625278592/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.172889:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135b09500 with x1830963625278592 ext(2097152->3145727) 00010000:00010000:3.0:1746143849.172893:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143849.172900:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 1008 lvb_type: 1 00002000:00010000:3.0:1746143849.172929:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135b09500 00000100:00100000:0.0:1746143849.178992:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.179050:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.179998:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625279488 00000100:00100000:3.0:1746143849.180010:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625279488 00000100:00100000:3.0:1746143849.180082:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17252 00000100:00100000:3.0:1746143849.180093:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625279488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143849.180117:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.180139:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73b6c83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412a9d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.180164:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.180178:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73b6c83 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a9d expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.180191:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32a00/0x87925e4cb73b6c83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a9d expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.180223:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32a00, rc 0) 00000100:00100000:0.0:1746143849.181029:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.181077:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.181107:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625279616 00000100:00100000:0.0:1746143849.181111:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625279616 00010000:00010000:0.0:1746143849.181131:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143849.181148:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625279872 00000100:00100000:0.0:1746143849.181150:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625279872 00010000:00010000:0.0:1746143849.181157:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143849.181172:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8455 00000100:00100000:0.0:1746143849.181177:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625279616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143849.181187:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143849.181207:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.181217:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.181236:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6c36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a73 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.181255:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143849.181289:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625279616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 111us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.181295:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8455 00000100:00100000:0.0:1746143849.181310:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8456 00000100:00100000:0.0:1746143849.181314:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625279872:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143849.181320:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143849.181326:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746143849.181335:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746143849.181346:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d429600/0x87925e4cb73b6c4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a81 expref: 10 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:0.0:1746143849.181354:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.181355:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.181362:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.181369:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.181399:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143849.181411:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627585792:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143849.181466:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.181753:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625279744 00000100:00100000:1.0:1746143849.181758:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625279744 00000100:00100000:1.0:1746143849.181785:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17253 00000100:00100000:1.0:1746143849.181789:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+7:3111:x1830963625279744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.181798:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.181809:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412aa4 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.181824:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.181830:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.181831:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.181834:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 8 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.181850:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.181859:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 24 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143849.181867:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627585920:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.181887:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.182810:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625279488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2715us (3826us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143849.182818:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17252 00000100:00100000:2.0:1746143849.186378:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627585792:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.186398:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.186448:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625279872:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5132us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.186460:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8456 00000100:00100000:0.0:1746143849.188612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.188881:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625280128 00000100:00100000:3.0:1746143849.188891:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625280128 00002000:00100000:3.0:1746143849.188965:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3739648->3743743) req@ffff880090e58a80 x1830963625280128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.188975:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58a80 with x1830963625280128 ext(3739648->3743743) 00002000:00010000:3.0:1746143849.188980:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58a80 00000100:00100000:3.0:1746143849.189005:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7541 00000100:00100000:3.0:1746143849.189013:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625280128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143849.189071:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627585920:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.189102:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 8 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.189118:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a400, rc 0) 00000100:00100000:3.0:1746143849.189149:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625280128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 136us (560us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143849.189156:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7541 00002000:00100000:3.0:1746143849.189161:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3739648->3743743) req@ffff880090e58a80 x1830963625280128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.189169:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58a80 with x1830963625280128 ext(3739648->3743743) 00002000:00010000:3.0:1746143849.189171:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58a80 00000100:00100000:1.0:1746143849.189279:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+8:3111:x1830963625279744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7488us (8251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.189286:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17253 00000100:00100000:0.0:1746143849.189364:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.189449:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625280256 00000100:00100000:3.0:1746143849.189453:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625280256 00002000:00100000:3.0:1746143849.189468:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2813952->3145727) req@ffff880090e5a300 x1830963625280256/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.189475:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963625280256 ext(2813952->3145727) 00010000:00010000:3.0:1746143849.189489:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 25 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.189501:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 25 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.189507:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e5a300 00000100:00100000:3.0:1746143849.189527:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2761 00000100:00100000:3.0:1746143849.189533:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625280256:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143849.192544:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.192791:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625280384 00000100:00100000:1.0:1746143849.192801:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625280384 00000100:00100000:1.0:1746143849.192857:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17254 00000100:00100000:1.0:1746143849.192866:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625280384:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.192884:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.192901:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6c91 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412aab expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143849.192990:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627586048:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143849.193077:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.203439:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627586048:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143849.203476:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6c91 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aab expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.203492:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a200/0x87925e4cb73b6c91 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aab expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.203522:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a200, rc 0) 00000100:00100000:1.0:1746143849.203568:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625280384:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10702us (11034us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143849.203576:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17254 00000100:00100000:0.0:1746143849.204596:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625280256:12345-192.168.202.3@tcp:4:cat.0 Request processed in 15054us (15223us total) trans 21474841366 rc 0/0 00000100:00100000:0.0:1746143849.204609:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2761 00002000:00100000:0.0:1746143849.204619:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2813952->3145727) req@ffff880090e5a300 x1830963625280256/t21474841366(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.204629:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a300 with x1830963625280256 ext(2813952->3145727) 00010000:00010000:0.0:1746143849.204638:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 27 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.204652:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 27 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.204659:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e5a300 00000100:00100000:0.0:1746143849.211973:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.212230:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625280512 00000100:00100000:2.0:1746143849.212237:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625280512 00010000:00010000:2.0:1746143849.212275:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 27 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.212314:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8457 00000100:00100000:2.0:1746143849.212320:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625280512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.212331:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.212346:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 27 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.212356:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 27 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.212374:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e7ec00/0x87925e4cb73b6c44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2813952->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a7a expref: 27 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.212389:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.212390:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.212396:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 7 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.212403:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 7 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143849.212421:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143849.212428:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 7 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.212442:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627586176:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143849.212479:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625280768 00000100:00100000:1.0:1746143849.212487:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625280768 00000100:00100000:2.0:1746143849.212495:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00002000:00100000:1.0:1746143849.212529:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880136635880 x1830963625280768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.212538:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635880 with x1830963625280768 ext(4849664->4853759) 00002000:00010000:1.0:1746143849.212543:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635880 00000100:00100000:1.0:1746143849.212561:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7542 00000100:00100000:1.0:1746143849.212568:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625280768:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143849.214400:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625280768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 170us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143849.214413:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7542 00002000:00100000:1.0:1746143849.214426:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4849664->4853759) req@ffff880136635880 x1830963625280768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.214435:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136635880 with x1830963625280768 ext(4849664->4853759) 00002000:00010000:1.0:1746143849.214441:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136635880 00000100:00100000:0.0:1746143849.220315:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.220408:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625281024 00000100:00100000:3.0:1746143849.220420:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625281024 00000100:00100000:3.0:1746143849.220484:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5513 00000100:00100000:3.0:1746143849.220492:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+267:3107:x1830963625281024:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143849.220576:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627586176:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.220603:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.220696:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625280512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8374us (8728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.220706:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8457 00000100:00100000:3.0:1746143849.221134:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+268:3107:x1830963625281024:12345-192.168.202.3@tcp:35:cat.0 Request processed in 642us (830us total) trans 8589945233 rc 0/0 00000100:00100000:3.0:1746143849.221142:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5513 00000100:00100000:0.0:1746143849.222080:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.222140:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625281280 00000100:00100000:1.0:1746143849.222147:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625281280 00002000:00100000:1.0:1746143849.222181:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012d840000 x1830963625281280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.222191:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840000 with x1830963625281280 ext(2097152->3145727) 00002000:00010000:1.0:1746143849.222196:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d840000 00000100:00100000:1.0:1746143849.222221:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7543 00000100:00100000:1.0:1746143849.222227:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625281280:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.232931:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625281280:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10672us (11180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143849.232946:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7543 00002000:00100000:2.0:1746143849.232958:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->3145727) req@ffff88012d840000 x1830963625281280/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.232967:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d840000 with x1830963625281280 ext(2097152->3145727) 00002000:00010000:2.0:1746143849.232973:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d840000 00000100:00100000:0.0:1746143849.243695:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.243836:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625281408 00000100:00100000:1.0:1746143849.243845:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625281408 00000100:00100000:1.0:1746143849.243904:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17255 00000100:00100000:1.0:1746143849.243940:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3111:x1830963625281408:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.243959:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.243978:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ab2 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.244008:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.244019:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.244021:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.244023:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.244053:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.244065:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 23 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143849.244077:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627586304:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.244172:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.256561:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627586304:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.256601:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.256619:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55bc00, rc 0) 00000100:00100000:1.0:1746143849.256668:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3111:x1830963625281408:12345-192.168.202.3@tcp:101:cat.0 Request processed in 12756us (12985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.256678:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17255 00000100:00100000:0.0:1746143849.257285:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.257350:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625281536 00000100:00100000:2.0:1746143849.257358:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625281536 00002000:00100000:2.0:1746143849.257397:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3743743) req@ffff880095c3bb80 x1830963625281536/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.257407:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3bb80 with x1830963625281536 ext(3145728->3743743) 00010000:00010000:2.0:1746143849.257413:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 24 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.257426:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 24 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143849.257433:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c3bb80 00000100:00100000:2.0:1746143849.257465:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2762 00000100:00100000:2.0:1746143849.257472:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625281536:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143849.270934:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.271478:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625281664 00000100:00100000:3.0:1746143849.271485:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625281664 00000100:00100000:3.0:1746143849.271564:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14134 00000100:00100000:3.0:1746143849.271570:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+6:3116:x1830963625281664:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143849.271589:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.271602:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b6c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ab9 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.271648:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271658:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271666:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271677:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271682:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271687:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271743:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271752:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.271760:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.271785:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 267 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.271794:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 267 pid: 10936 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.271802:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627586432:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.271879:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.273667:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625281536:12345-192.168.202.3@tcp:4:cat.0 Request processed in 16186us (16374us total) trans 17179874107 rc 0/0 00000100:00100000:0.0:1746143849.273680:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2762 00002000:00100000:0.0:1746143849.273692:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3743743) req@ffff880095c3bb80 x1830963625281536/t17179874107(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.273703:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c3bb80 with x1830963625281536 ext(3145728->3743743) 00010000:00010000:0.0:1746143849.273714:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.273726:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.273733:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095c3bb80 00000100:00100000:3.0:1746143849.280321:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627586432:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.280345:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143849.280444:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.280668:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.280802:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625281792 00000100:00100000:2.0:1746143849.280808:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625281792 00010000:00010000:2.0:1746143849.280838:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.280856:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625282048 00000100:00100000:3.0:1746143849.280860:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625282048 00000100:00100000:2.0:1746143849.280874:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8458 00000100:00100000:2.0:1746143849.280881:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625281792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.280954:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.280971:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.280980:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.280999:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e32c00/0x87925e4cb73b6c7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3743743) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a96 expref: 26 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.281015:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.281016:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.281023:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.281034:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.281059:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 9 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.281068:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627586560:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.281133:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.281318:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5514 00000100:00100000:3.0:1746143849.281324:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+268:30658:x1830963625282048:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143849.281465:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+269:30658:x1830963625282048:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 140us (1028us total) trans 8589945234 rc 0/0 00000100:00100000:3.0:1746143849.281473:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5514 00000100:00100000:0.0:1746143849.286633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.288675:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627586560:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.288693:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.288744:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625281792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7863us (8075us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.288753:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8458 00000100:00100000:3.0:1746143849.288776:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625282176 00000100:00100000:3.0:1746143849.288780:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625282176 00010000:00010000:3.0:1746143849.288803:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 269 pid: 10936 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143849.289067:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.289117:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625282432 00000100:00100000:0.0:1746143849.289120:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625282432 00002000:00100000:0.0:1746143849.289145:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009391fb80 x1830963625282432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.289154:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391fb80 with x1830963625282432 ext(3145728->4194303) 00002000:00010000:0.0:1746143849.289157:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391fb80 00000100:00100000:0.0:1746143849.289173:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7544 00000100:00100000:0.0:1746143849.289178:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625282432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.291029:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8459 00000100:00100000:3.0:1746143849.291042:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+269:2008:x1830963625282176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.291054:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.291062:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 269 pid: 10936 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.291076:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 269 pid: 10936 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.291095:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84fe00/0x87925e4cb73b6ad8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412993 expref: 269 pid: 10936 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.291149:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.291153:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.291165:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.291171:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.291193:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143849.291214:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746143849.291221:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+268:2008:x1830963625282176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 184us (4595us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143849.291221:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746143849.291227:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8459 00000004:00200000:2.0:1746143849.291260:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143849.291384:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143849.291403:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291412:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291421:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291426:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291430:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291438:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291443:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143849.291446:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291452:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291459:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143849.291461:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143849.291464:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291468:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084c00/0x87925e4cb73b6ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291480:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291484:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291487:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291491:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143849.291492:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291497:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291505:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e623900) 00010000:00010000:2.0:1746143849.291507:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143849.291509:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291512:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084800/0x87925e4cb73b6cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.291539:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b6c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.291549:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 7 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.291555:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.291556:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143849.291558:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084e00, rc 0) 00000100:00100000:2.0:1746143849.291578:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3116:x1830963625281664:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 20008us (20666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.291584:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14134 00000100:00100000:0.0:1746143849.293650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.293753:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625282688 00000100:00100000:2.0:1746143849.293763:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625282688 00002000:00100000:2.0:1746143849.293986:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009391ce00 x1830963625282688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.293997:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ce00 with x1830963625282688 ext(3145728->4194303) 00002000:00010000:2.0:1746143849.294002:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ce00 00000100:00100000:2.0:1746143849.294035:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7545 00000100:00100000:2.0:1746143849.294044:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625282688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143849.296025:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625282432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6840us (6952us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143849.296035:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7544 00002000:00100000:1.0:1746143849.296045:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009391fb80 x1830963625282432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.296052:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391fb80 with x1830963625282432 ext(3145728->4194303) 00002000:00010000:1.0:1746143849.296057:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391fb80 00000100:00100000:0.0:1746143849.297138:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.297163:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625282816 00000100:00100000:1.0:1746143849.297170:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625282816 00000100:00100000:0.0:1746143849.297188:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.297221:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625282944 00000100:00100000:1.0:1746143849.297224:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625282944 00000100:00100000:1.0:1746143849.297254:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17256 00000100:00100000:1.0:1746143849.297260:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625282816:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143849.297279:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.297292:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ac0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.297307:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17257 00010000:00010000:1.0:1746143849.297313:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.297314:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746143849.297317:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625282944:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143849.297321:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.297329:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.297334:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.297341:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ac7 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.297344:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a200, rc 0) 00010000:00010000:2.0:1746143849.297358:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.297360:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.297366:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.297378:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.297386:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c000, rc 0) 00000100:00100000:1.0:1746143849.297387:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625282816:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 127us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.297393:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17256 00000100:00100000:2.0:1746143849.297413:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625282944:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.297419:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17257 00000100:00100000:0.0:1746143849.301146:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.301222:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625283072 00000100:00100000:3.0:1746143849.301230:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625283072 00000100:00100000:3.0:1746143849.301284:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17258 00000100:00100000:3.0:1746143849.301291:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625283072:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143849.301305:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.301318:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ace expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.301337:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.301339:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.301347:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.301359:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.301367:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084800, rc 0) 00000100:00100000:3.0:1746143849.301410:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625283072:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.301416:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17258 00000100:00100000:3.0:1746143849.305188:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625282688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11137us (11537us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.305198:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7545 00002000:00100000:3.0:1746143849.305208:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009391ce00 x1830963625282688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.305215:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ce00 with x1830963625282688 ext(3145728->4194303) 00002000:00010000:3.0:1746143849.305220:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ce00 00000100:00100000:0.0:1746143849.307531:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.307711:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625283328 00000100:00100000:2.0:1746143849.307721:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625283328 00000100:00100000:2.0:1746143849.307780:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14135 00000100:00100000:2.0:1746143849.307787:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3116:x1830963625283328:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143849.307803:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.307826:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c200/0x87925e4cb73b6cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ad5 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.307908:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.307941:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.307948:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.307976:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.307985:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 8 pid: 7243 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.307995:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627586688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.308079:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.312123:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.312429:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625283584 00000100:00100000:3.0:1746143849.312437:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625283584 00002000:00100000:3.0:1746143849.312473:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009391df80 x1830963625283584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.312482:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963625283584 ext(4194304->4853759) 00002000:00010000:3.0:1746143849.312486:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391df80 00000100:00100000:2.0:1746143849.312992:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627586688:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.313017:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746143849.313075:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7546 00000100:00100000:3.0:1746143849.313083:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625283584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143849.314974:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.315361:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625283712 00000100:00100000:3.0:1746143849.315368:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625283712 00010000:00010000:3.0:1746143849.315398:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 9 pid: 7243 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.315432:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8460 00000100:00100000:3.0:1746143849.315439:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625283712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.315450:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.315455:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 9 pid: 7243 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.315465:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 9 pid: 7243 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.315482:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084e00/0x87925e4cb73b6cb4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab9 expref: 9 pid: 7243 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.315506:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.315511:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.315520:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.315526:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.315544:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.315586:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625283712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 147us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.315592:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8460 00010000:00010000:3.0:1746143849.315618:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.315624:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143849.315639:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143849.315733:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55c200/0x87925e4cb73b6cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ad5 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.315750:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ad5 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.315755:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.315757:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143849.315759:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d000, rc 0) 00000100:00100000:3.0:1746143849.315781:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3116:x1830963625283328:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 7995us (8262us total) trans 8589945235 rc 0/0 00000100:00100000:3.0:1746143849.315787:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14135 00000100:00100000:3.0:1746143849.319707:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625283584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6616us (7582us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143849.320044:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7546 00002000:00100000:3.0:1746143849.320054:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009391df80 x1830963625283584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.320062:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391df80 with x1830963625283584 ext(4194304->4853759) 00002000:00010000:3.0:1746143849.320067:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391df80 00000100:00100000:0.0:1746143849.321440:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.321562:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625283968 00000100:00100000:3.0:1746143849.321573:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625283968 00000100:00100000:3.0:1746143849.321630:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14136 00000100:00100000:3.0:1746143849.321638:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3116:x1830963625283968:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143849.321665:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.321669:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143849.321700:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55d000/0x87925e4cb73b6cd7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ad5 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.321721:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.321726:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143849.321738:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6ce5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412adc expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.321835:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321848:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321857:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321868:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321873:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321879:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321885:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143849.321889:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321894:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321900:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.321902:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143849.321906:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.321980:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6cec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.322005:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6ce5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412adc expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.322013:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6ce5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412adc expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.322019:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084a00, rc 0) 00000100:00100000:3.0:1746143849.322636:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3116:x1830963625283968:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 422us (627us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143849.322645:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14136 00000100:00100000:0.0:1746143849.325557:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.326404:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625284224 00000100:00100000:1.0:1746143849.326416:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625284224 00000100:00100000:0.0:1746143849.326429:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.326605:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.326647:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625284608 00000100:00100000:2.0:1746143849.326654:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625284608 00000100:00100000:2.0:1746143849.326698:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17259 00000100:00100000:2.0:1746143849.326705:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3113:x1830963625284608:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143849.326723:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.326740:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ae3 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.326768:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.326776:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.326784:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.326789:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.326790:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.326793:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [929792->1048575] (req 929792->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.326821:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.326830:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.326841:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627586816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.326957:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 24 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.326965:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 24 pid: 3134 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.326975:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627586944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.327005:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 9 pid: 12328 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.327012:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 9 pid: 12328 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.327018:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627587072:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.327031:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.327288:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625284480 00000100:00100000:1.0:1746143849.327292:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625284480 00000100:00100000:3.0:1746143849.327295:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5515 00000100:00100000:3.0:1746143849.327305:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:3111:x1830963625284224:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143849.327311:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5516 00000100:00100000:1.0:1746143849.327317:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3116:x1830963625284480:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:3.0:1746143849.327507:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3111:x1830963625284224:12345-192.168.202.3@tcp:35:cat.0 Request processed in 202us (1956us total) trans 8589945236 rc 0/0 00000100:00100000:3.0:1746143849.327514:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5515 00000100:00100000:1.0:1746143849.328476:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3116:x1830963625284480:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 1153us (2042us total) trans 8589945237 rc 0/0 00000100:00100000:1.0:1746143849.328484:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5516 00000100:00100000:2.0:1746143849.330164:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627586816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.330174:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627586944:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.330181:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627587072:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.330206:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [929792->1048575] (req 929792->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 11 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.330221:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55c600, rc 0) 00000100:00100000:2.0:1746143849.330256:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3113:x1830963625284608:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3551us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.330271:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17259 00000100:00100000:0.0:1746143849.334750:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.334793:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.334868:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625284864 00000100:00100000:2.0:1746143849.334875:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625284864 00010000:00010000:2.0:1746143849.334907:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 25 pid: 3134 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.334961:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625284736 00000100:00100000:2.0:1746143849.334963:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625284736 00010000:00010000:2.0:1746143849.334974:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.335002:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8461 00000100:00100000:2.0:1746143849.335009:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625284864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.335019:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.335036:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 25 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.335045:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 25 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.335064:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e33e00/0x87925e4cb73b6aca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841298c expref: 25 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.335082:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.335117:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625284864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.335123:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8461 00000100:00100000:2.0:1746143849.335136:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8462 00000100:00100000:2.0:1746143849.335140:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625284736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.335146:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.335152:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.335160:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.335170:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x87925e4cb73b6ac3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412985 expref: 11 pid: 3135 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.335176:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.335192:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625284736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.335197:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8462 00000100:00100000:0.0:1746143849.337818:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.338192:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625284992 00000100:00100000:2.0:1746143849.338202:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625284992 00010000:00010000:2.0:1746143849.338241:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 10 pid: 12328 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.338285:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8463 00000100:00100000:2.0:1746143849.338293:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625284992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.338308:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.338328:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 10 pid: 12328 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.338340:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 10 pid: 12328 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.338361:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24800/0x87925e4cb73b69f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841293f expref: 10 pid: 12328 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.338375:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.338378:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.338385:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.338392:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.338427:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.338440:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627587200:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.339241:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.341175:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.341237:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625285248 00000100:00100000:3.0:1746143849.341245:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625285248 00002000:00100000:3.0:1746143849.341301:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (929792->933887) req@ffff88009391d500 x1830963625285248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.341312:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963625285248 ext(929792->933887) 00002000:00010000:3.0:1746143849.341317:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:3.0:1746143849.341352:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7547 00000100:00100000:3.0:1746143849.341360:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625285248:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143849.341557:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627587200:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.341576:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.341617:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625284992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3324us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.341628:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8463 00000100:00100000:3.0:1746143849.341866:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625285248:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 506us (697us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143849.341871:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7547 00002000:00100000:3.0:1746143849.341877:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (929792->933887) req@ffff88009391d500 x1830963625285248/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.341883:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d500 with x1830963625285248 ext(929792->933887) 00002000:00010000:3.0:1746143849.341886:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391d500 00000100:00100000:0.0:1746143849.344742:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.345189:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625285504 00000100:00100000:3.0:1746143849.345197:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625285504 00000100:00100000:3.0:1746143849.345246:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14137 00000100:00100000:3.0:1746143849.345253:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+268:3121:x1830963625285504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143849.345283:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.345305:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73b6cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412aea expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.345374:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345386:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345396:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345408:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345412:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345418:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345506:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345513:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345519:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143849.345527:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143849.345602:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345608:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345613:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345620:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345625:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082085a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143849.345629:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345635:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345646:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143849.345649:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143849.345653:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345658:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345684:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345690:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345694:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345698:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880082084a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143849.345700:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345705:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345711:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e623900) 00010000:00010000:3.0:1746143849.345713:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143849.345715:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345719:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084a00/0x87925e4cb73b6d08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.345752:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084600/0x87925e4cb73b6cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 271 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.345761:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 270 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.345767:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.345769:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143849.345771:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082084200, rc 0) 00000100:00100000:3.0:1746143849.347071:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+270:3121:x1830963625285504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1812us (2332us total) trans 8589945238 rc 0/0 00000100:00100000:3.0:1746143849.347079:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14137 00000100:00100000:1.0:1746143849.347534:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.347665:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625285632 00000100:00100000:2.0:1746143849.347672:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625285632 00000100:00100000:2.0:1746143849.347714:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17260 00000100:00100000:2.0:1746143849.347720:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+8:3113:x1830963625285632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143849.347734:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.347751:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412af1 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.347774:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.347787:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.347793:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.347798:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.347799:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.347802:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1048576->1839103] (req 1048576->1839103) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.348034:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.348045:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.348055:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627587328:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.348149:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 25 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.348156:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 25 pid: 3134 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.348172:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627587456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.348202:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.348209:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 9 pid: 9585 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.348217:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627587584:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.348232:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.352339:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.352374:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.352403:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.352417:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.352442:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625285760 00000100:00100000:0.0:1746143849.352451:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625285760 00000100:00100000:0.0:1746143849.352490:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17261 00000100:00100000:0.0:1746143849.352498:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963625285760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.352517:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.352533:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6d24 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412af8 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.352582:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627587328:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.352592:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627587456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.352600:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627587584:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.352626:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [1048576->1839103] (req 1048576->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.352640:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84800, rc 0) 00000100:00100000:1.0:1746143849.352652:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625285888 00000100:00100000:1.0:1746143849.352656:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625285888 00000100:00100000:1.0:1746143849.352676:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286016 00000100:00100000:1.0:1746143849.352678:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286016 00000100:00100000:2.0:1746143849.352683:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3113:x1830963625285632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4962us (5150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.352687:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286144 00000100:00100000:2.0:1746143849.352689:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17260 00000100:00100000:1.0:1746143849.352689:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286144 00000100:00100000:1.0:1746143849.352702:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17262 00000100:00100000:1.0:1746143849.352707:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625285888:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143849.352710:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17263 00000100:00100000:2.0:1746143849.352715:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625286016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.352716:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.352721:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.352726:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6d2b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412aff expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.352728:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b06 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.352738:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.352744:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.352746:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.352747:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6d2b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aff expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.352754:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.352756:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b6d2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aff expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.352767:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.352773:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d200, rc 0) 00010000:00010000:1.0:1746143849.352788:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55be00, rc 0) 00000100:00100000:1.0:1746143849.352807:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625285888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 99us (432us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143849.352811:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625286016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 95us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.352813:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17262 00000100:00100000:2.0:1746143849.352816:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17263 00000100:00100000:1.0:1746143849.352824:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17264 00000100:00100000:1.0:1746143849.352828:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625286144:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:2.0:1746143849.352848:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.352863:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286272 00000100:00100000:3.0:1746143849.352867:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286272 00010000:00010000:3.0:1746143849.352886:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 10 pid: 9585 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.352901:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.352904:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8464 00000100:00100000:3.0:1746143849.352935:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625286272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143849.352939:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286400 00000100:00100000:2.0:1746143849.352941:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286400 00010000:00010000:3.0:1746143849.352944:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.352951:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.352964:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 10 pid: 9585 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.352965:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8465 00000100:00100000:2.0:1746143849.352969:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2009:x1830963625286400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.352973:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 10 pid: 9585 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143849.352973:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627587712:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143849.352974:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.352981:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.352988:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d200/0x87925e4cb73b69f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412946 expref: 10 pid: 9585 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.352989:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.353000:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143849.353000:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e33600/0x87925e4cb73b6aed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a1 expref: 9 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.353011:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.353015:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625286272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.353020:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2009:x1830963625286400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.353021:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8464 00000100:00100000:2.0:1746143849.353025:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8465 00000100:00100000:0.0:1746143849.353227:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.353475:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.353493:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286528 00000100:00100000:3.0:1746143849.353497:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286528 00010000:00010000:3.0:1746143849.353509:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 27 pid: 3134 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.353525:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8466 00000100:00100000:3.0:1746143849.353530:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625286528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.353536:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.353543:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 27 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.353543:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.353551:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 27 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.353552:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b0d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.353563:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32800/0x87925e4cb73b6af4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129a8 expref: 28 pid: 3134 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.353563:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.353565:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.353569:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.353571:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.353573:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.353576:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.353579:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.353582:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.353586:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b800, rc 0) 00010000:00010000:3.0:1746143849.353601:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143849.353604:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625286144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 776us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.353609:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627587840:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143849.353609:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17264 00000100:00100000:3.0:1746143849.353630:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143849.354510:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime: 1746143848 -> 1746143849 00002000:00010000:2.0:1746143849.354514:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143848 -> 1746143849 00002000:00010000:2.0:1746143849.354516:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime: 1746143848 -> 1746143849 00000100:00100000:2.0:1746143849.354530:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627587712:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143849.354548:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6d24 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af8 expref: 26 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.354559:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d428600/0x87925e4cb73b6d24 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af8 expref: 26 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.354567:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d428600, rc 0) 00000100:00100000:2.0:1746143849.354590:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963625285760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2094us (2262us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143849.354596:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17261 00000100:00100000:3.0:1746143849.355471:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627587840:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.355481:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.355514:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625286528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1983us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.355521:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8466 00000100:00100000:0.0:1746143849.357089:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.357171:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286656 00000100:00100000:2.0:1746143849.357178:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286656 00000100:00100000:2.0:1746143849.357225:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17265 00000100:00100000:2.0:1746143849.357232:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:3121:x1830963625286656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143849.357247:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.357273:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b14 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.357299:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.357305:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143849.357307:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143849.357309:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.357337:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 9 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.357349:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 9 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.357360:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627587968:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.357430:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.360514:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627587968:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.360548:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.360565:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ca00, rc 0) 00000100:00100000:2.0:1746143849.360626:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:3121:x1830963625286656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3393us (3538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.360638:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17265 00000100:00100000:0.0:1746143849.361532:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.361848:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625286784 00000100:00100000:3.0:1746143849.361856:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625286784 00002000:00100000:3.0:1746143849.361897:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (929792->1048575) req@ffff880092ef0700 x1830963625286784/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.361907:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0700 with x1830963625286784 ext(929792->1048575) 00010000:00010000:3.0:1746143849.361936:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.361948:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.361955:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef0700 00000100:00100000:3.0:1746143849.361974:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2763 00000100:00100000:3.0:1746143849.361981:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625286784:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143849.364765:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.364952:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625287040 00000100:00100000:1.0:1746143849.364961:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625287040 00002000:00100000:1.0:1746143849.365005:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1835008->1839103) req@ffff880092ef0e00 x1830963625287040/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.365020:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0e00 with x1830963625287040 ext(1835008->1839103) 00002000:00010000:1.0:1746143849.365025:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0e00 00000100:00100000:1.0:1746143849.365058:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7548 00000100:00100000:1.0:1746143849.365066:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625287040:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143849.365209:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625287040:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 143us (453us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143849.365216:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7548 00002000:00100000:1.0:1746143849.365222:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1835008->1839103) req@ffff880092ef0e00 x1830963625287040/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.365228:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0e00 with x1830963625287040 ext(1835008->1839103) 00002000:00010000:1.0:1746143849.365231:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef0e00 00000100:00100000:0.0:1746143849.366964:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625286784:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4977us (5428us total) trans 17179874108 rc 0/0 00000100:00100000:0.0:1746143849.366974:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2763 00002000:00100000:0.0:1746143849.366983:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (929792->1048575) req@ffff880092ef0700 x1830963625286784/t17179874108(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.366991:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0700 with x1830963625286784 ext(929792->1048575) 00010000:00010000:0.0:1746143849.367003:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 12 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.367194:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 12 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.367202:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef0700 00000100:00100000:0.0:1746143849.369279:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.369353:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625287168 00000100:00100000:3.0:1746143849.369361:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625287168 00010000:00010000:3.0:1746143849.369390:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 12 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.369446:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8467 00000100:00100000:3.0:1746143849.369452:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625287168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.369464:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.369479:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 12 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.369487:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 12 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.369504:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c600/0x87925e4cb73b6cf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 929792->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ae3 expref: 12 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.370101:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.370104:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.370112:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.370121:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.370154:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.370167:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627588096:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143849.370663:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.372143:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.372159:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627588096:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.372175:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.372218:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625287424 00000100:00100000:1.0:1746143849.372225:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625287424 00000100:00100000:3.0:1746143849.372362:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625287168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2845us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.372370:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5517 00000100:00100000:3.0:1746143849.372372:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8467 00000100:00100000:1.0:1746143849.372377:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3113:x1830963625287424:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143849.372800:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3113:x1830963625287424:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 422us (659us total) trans 8589945239 rc 0/0 00000100:00100000:1.0:1746143849.372807:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5517 00000100:00100000:0.0:1746143849.376553:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.376721:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625287680 00000100:00100000:2.0:1746143849.376731:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625287680 00002000:00100000:2.0:1746143849.376780:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092ef1f80 x1830963625287680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.376791:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963625287680 ext(0->1048575) 00002000:00010000:2.0:1746143849.376797:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:2.0:1746143849.376864:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7549 00000100:00100000:2.0:1746143849.376872:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625287680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.384568:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625287680:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7683us (8014us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143849.384581:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7549 00002000:00100000:2.0:1746143849.384593:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092ef1f80 x1830963625287680/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.384602:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1f80 with x1830963625287680 ext(0->1048575) 00002000:00010000:2.0:1746143849.384607:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef1f80 00000100:00100000:0.0:1746143849.392837:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.392909:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625287808 00000100:00100000:2.0:1746143849.392946:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625287808 00000100:00100000:2.0:1746143849.393045:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17266 00000100:00100000:2.0:1746143849.393054:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:3121:x1830963625287808:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143849.393076:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.393096:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b1b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.393137:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.393144:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143849.393146:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143849.393150:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.393182:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 7 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.393193:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 7 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.393205:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627588224:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.393540:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.395176:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627588224:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.395200:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.395216:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55d800, rc 0) 00000100:00100000:2.0:1746143849.395272:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:3121:x1830963625287808:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2210us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.395280:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17266 00000100:00100000:0.0:1746143849.396011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.396229:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625287936 00000100:00100000:2.0:1746143849.396236:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625287936 00002000:00100000:2.0:1746143849.396282:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1839103) req@ffff880092ef2300 x1830963625287936/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.396292:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2300 with x1830963625287936 ext(1048576->1839103) 00010000:00010000:2.0:1746143849.396299:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 8 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.396311:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 8 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143849.396318:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef2300 00000100:00100000:2.0:1746143849.396380:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2764 00000100:00100000:2.0:1746143849.396388:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2008:x1830963625287936:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:0.0:1746143849.407665:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625287936:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 11265us (11641us total) trans 21474841367 rc 0/0 00000100:00100000:0.0:1746143849.407680:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2764 00002000:00100000:0.0:1746143849.407695:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->1839103) req@ffff880092ef2300 x1830963625287936/t21474841367(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.407704:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2300 with x1830963625287936 ext(1048576->1839103) 00010000:00010000:0.0:1746143849.407714:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.407732:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.407739:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ef2300 00000100:00100000:0.0:1746143849.410460:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.410534:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625288064 00000100:00100000:3.0:1746143849.410543:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625288064 00010000:00010000:3.0:1746143849.410582:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.410621:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8468 00000100:00100000:3.0:1746143849.410629:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625288064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.410645:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143849.410660:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143848 -> 1746143849 00002000:00010000:3.0:1746143849.410663:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143848 -> 1746143849 00010000:00010000:3.0:1746143849.410668:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.410679:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.410700:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412af1 expref: 10 pid: 13436 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.410727:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.410729:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.410737:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.410745:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.410774:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.410784:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627588352:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143849.410866:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.415898:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.415986:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625288320 00000100:00100000:0.0:1746143849.415997:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625288320 00002000:00100000:0.0:1746143849.416046:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009610ce00 x1830963625288320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.416055:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610ce00 with x1830963625288320 ext(1048576->2097151) 00002000:00010000:0.0:1746143849.416060:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009610ce00 00000100:00100000:0.0:1746143849.416096:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7550 00000100:00100000:0.0:1746143849.416104:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625288320:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.416412:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627588352:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.416430:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.416491:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625288064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5862us (6042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.416499:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8468 00000100:00100000:2.0:1746143849.423846:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625288320:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7731us (7949us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143849.423861:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7550 00002000:00100000:2.0:1746143849.423875:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009610ce00 x1830963625288320/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.423884:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610ce00 with x1830963625288320 ext(1048576->2097151) 00002000:00010000:2.0:1746143849.423891:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009610ce00 00000100:00100000:0.0:1746143849.432753:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.432990:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625288576 00000100:00100000:3.0:1746143849.433001:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625288576 00000100:00100000:3.0:1746143849.433627:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14138 00000100:00100000:3.0:1746143849.433647:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+270:3124:x1830963625288576:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143849.433675:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.433700:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b6d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b22 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.433809:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.433824:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 271 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.433838:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143849.433870:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 271 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.433880:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 271 pid: 7243 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.433892:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627588480:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.434014:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.437137:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627588480:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.437166:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143849.437656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.438455:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625288704 00000100:00100000:3.0:1746143849.438463:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625288704 00010000:00010000:3.0:1746143849.438493:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 272 pid: 7243 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.439216:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8469 00000100:00100000:2.0:1746143849.439229:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:2009:x1830963625288704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.439243:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.439250:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 272 pid: 7243 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.439272:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 272 pid: 7243 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.439295:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082084200/0x87925e4cb73b6d0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aea expref: 272 pid: 7243 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.439314:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.439319:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.439329:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.439335:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.439353:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.439411:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+271:2009:x1830963625288704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 186us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.439418:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8469 00010000:00010000:2.0:1746143849.439450:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.439456:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746143849.439475:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143849.440240:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085e00/0x87925e4cb73b6d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 272 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.440268:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 271 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.440275:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.440278:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746143849.440280:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082085a00, rc 0) 00000100:00100000:2.0:1746143849.440687:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+271:3124:x1830963625288576:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 7050us (7944us total) trans 8589945240 rc 0/0 00000100:00100000:2.0:1746143849.440693:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14138 00000100:00100000:0.0:1746143849.444081:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.444201:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.444280:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625288960 00000100:00100000:2.0:1746143849.444290:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625288960 00002000:00100000:2.0:1746143849.444337:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880092ef0000 x1830963625288960/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.444346:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0000 with x1830963625288960 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.444351:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0000 00000100:00100000:2.0:1746143849.444600:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625289216 00000100:00100000:2.0:1746143849.444604:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625289216 00002000:00100000:2.0:1746143849.444619:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092ef1c00 x1830963625289216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.444625:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1c00 with x1830963625289216 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.444629:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef1c00 00000100:00100000:3.0:1746143849.444654:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7551 00000100:00100000:3.0:1746143849.444664:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625288960:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.445456:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7552 00000100:00100000:2.0:1746143849.445464:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625289216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.469750:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625288960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25079us (25669us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143849.469761:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7551 00002000:00100000:3.0:1746143849.469772:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880092ef0000 x1830963625288960/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.469782:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0000 with x1830963625288960 ext(2097152->4194303) 00002000:00010000:3.0:1746143849.469786:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0000 00000100:00100000:0.0:1746143849.481606:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625289216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 36132us (37393us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746143849.481619:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7552 00002000:00100000:0.0:1746143849.481633:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092ef1c00 x1830963625289216/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.481641:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1c00 with x1830963625289216 ext(2097152->4194303) 00002000:00010000:0.0:1746143849.481647:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef1c00 00000100:00100000:1.0:1746143849.481685:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.482537:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625289344 00000100:00100000:3.0:1746143849.482545:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625289344 00000100:00100000:3.0:1746143849.482590:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17267 00000100:00100000:3.0:1746143849.482596:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:3124:x1830963625289344:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143849.482609:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.482624:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b29 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.482651:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.482658:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.482665:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.482670:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.482672:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.482675:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3190784->3309567] (req 3190784->3309567) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.482702:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 8 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.482717:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 8 pid: 3135 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143849.482726:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627588608:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.484104:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.484114:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143849.484124:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627588736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.485009:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.485019:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 10 pid: 13430 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.485028:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627588864:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.485050:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.495500:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627588608:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.495513:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627588736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143849.495519:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627588864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143849.495549:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3190784->3309567] (req 3190784->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.495564:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ea00, rc 0) 00000100:00100000:3.0:1746143849.496325:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:3124:x1830963625289344:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 13727us (14638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.496333:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17267 00000100:00100000:0.0:1746143849.499749:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.499786:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.500442:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.500471:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.500811:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625289856 00000100:00100000:0.0:1746143849.500817:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625289856 00000100:00100000:0.0:1746143849.500859:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17268 00000100:00100000:0.0:1746143849.500866:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625289856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.500880:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.500894:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73b6d6a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b30 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.500925:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.500935:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73b6d6a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b30 expref: 28 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.500945:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e7ec00/0x87925e4cb73b6d6a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b30 expref: 28 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.500957:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e7ec00, rc 0) 00000100:00100000:0.0:1746143849.500989:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625289856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 124us (547us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143849.500994:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17268 00000100:00100000:2.0:1746143849.501457:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625289472 00000100:00100000:2.0:1746143849.501462:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625289472 00010000:00010000:2.0:1746143849.501483:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 9 pid: 3135 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.501500:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625289600 00000100:00100000:2.0:1746143849.501502:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625289600 00010000:00010000:2.0:1746143849.501509:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.501526:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625289728 00000100:00100000:2.0:1746143849.501528:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625289728 00010000:00010000:2.0:1746143849.501536:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 11 pid: 13430 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.501548:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8470 00000100:00100000:2.0:1746143849.501552:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625289472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.501559:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.501575:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 9 pid: 3135 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.501583:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 9 pid: 3135 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.501598:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55c000/0x87925e4cb73b6cc2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac7 expref: 9 pid: 3135 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.501611:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.501629:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625289472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 76us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.501635:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8470 00000100:00100000:2.0:1746143849.501668:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8471 00000100:00100000:2.0:1746143849.501673:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625289600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.501679:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.501685:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.501692:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.501702:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55d200/0x87925e4cb73b6d32 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b06 expref: 27 pid: 13436 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.501709:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.501721:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625289600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 48us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.501726:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8471 00000100:00100000:2.0:1746143849.501733:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8472 00000100:00100000:2.0:1746143849.501737:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625289728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.501742:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.501748:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 11 pid: 13430 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.501756:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 11 pid: 13430 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.501771:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55bc00/0x87925e4cb73b6c98 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ab2 expref: 11 pid: 13430 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.501778:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.501780:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.501785:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.501792:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.501815:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.501824:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627588992:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.501856:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.505443:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627588992:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143849.505458:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143849.505501:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625289728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3762us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.505510:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8472 00000100:00100000:0.0:1746143849.505953:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.506008:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625290112 00000100:00100000:2.0:1746143849.506013:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625290112 00002000:00100000:2.0:1746143849.506041:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3190784->3194879) req@ffff8801373b8e00 x1830963625290112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.506049:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8e00 with x1830963625290112 ext(3190784->3194879) 00002000:00010000:2.0:1746143849.506053:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8e00 00000100:00100000:2.0:1746143849.506075:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7553 00000100:00100000:2.0:1746143849.506080:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625290112:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.506166:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625290112:12345-192.168.202.3@tcp:3:cat.0 Request processed in 86us (214us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143849.506172:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7553 00002000:00100000:2.0:1746143849.506176:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3190784->3194879) req@ffff8801373b8e00 x1830963625290112/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.506183:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8e00 with x1830963625290112 ext(3190784->3194879) 00002000:00010000:2.0:1746143849.506185:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8e00 00000100:00100000:0.0:1746143849.508100:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.508172:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625290368 00000100:00100000:3.0:1746143849.508179:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625290368 00002000:00100000:3.0:1746143849.508207:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8801373b8000 x1830963625290368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.508214:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8000 with x1830963625290368 ext(4194304->4853759) 00002000:00010000:3.0:1746143849.508218:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8000 00000100:00100000:3.0:1746143849.508430:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7554 00000100:00100000:3.0:1746143849.508438:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625290368:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143849.511413:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.511502:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625290624 00000100:00100000:2.0:1746143849.511511:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625290624 00002000:00100000:2.0:1746143849.511550:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3305472->3309567) req@ffff8801373b9180 x1830963625290624/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.511559:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963625290624 ext(3305472->3309567) 00002000:00010000:2.0:1746143849.511564:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b9180 00000100:00100000:2.0:1746143849.511584:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7555 00000100:00100000:2.0:1746143849.511590:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625290624:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.511714:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625290624:12345-192.168.202.3@tcp:3:cat.0 Request processed in 123us (309us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143849.511720:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7555 00002000:00100000:2.0:1746143849.511727:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3305472->3309567) req@ffff8801373b9180 x1830963625290624/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.511733:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9180 with x1830963625290624 ext(3305472->3309567) 00002000:00010000:2.0:1746143849.511736:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b9180 00000100:00100000:3.0:1746143849.512788:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625290368:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4348us (4690us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143849.512796:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7554 00002000:00100000:3.0:1746143849.512801:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8801373b8000 x1830963625290368/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.512808:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8000 with x1830963625290368 ext(4194304->4853759) 00002000:00010000:3.0:1746143849.512811:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8000 00000100:00100000:0.0:1746143849.533532:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.533614:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625290880 00000100:00100000:1.0:1746143849.533623:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625290880 00000100:00100000:1.0:1746143849.533675:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5518 00000100:00100000:1.0:1746143849.533682:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+271:3121:x1830963625290880:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143849.533860:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+272:3121:x1830963625290880:12345-192.168.202.3@tcp:35:cat.0 Request processed in 177us (335us total) trans 8589945241 rc 0/0 00000100:00100000:1.0:1746143849.533866:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5518 00000100:00100000:0.0:1746143849.573539:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.573737:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625291136 00000100:00100000:2.0:1746143849.573745:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625291136 00000100:00100000:2.0:1746143849.580248:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14139 00000100:00100000:2.0:1746143849.580276:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3129:x1830963625291136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143849.580299:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.580324:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b37 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.580386:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580396:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580404:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580416:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580421:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580426:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580510:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b6d86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580518:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b6d86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580524:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b6d86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746143849.580531:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143849.580590:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580599:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580604:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580608:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580613:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd85e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143849.580616:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580629:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580638:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143849.580640:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143849.580644:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580648:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd85e00/0x87925e4cb73b6d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580670:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580674:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580994:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.580997:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c2dba00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143849.581000:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.581004:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.581011:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937acd00) 00010000:00010000:2.0:1746143849.581013:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143849.581015:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.581019:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2dba00/0x87925e4cb73b6d7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.581052:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd84800/0x87925e4cb73b6d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b37 expref: 21 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.581061:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b6d86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b37 expref: 20 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.581066:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.581067:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143849.581069:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7fc00, rc 0) 00000100:00100000:2.0:1746143849.581116:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3129:x1830963625291136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 858us (7584us total) trans 8589945242 rc 0/0 00000100:00100000:2.0:1746143849.581121:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14139 00000100:00100000:0.0:1746143849.584540:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.585040:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.585062:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.585081:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625291520 00000100:00100000:0.0:1746143849.585088:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625291520 00000100:00100000:0.0:1746143849.585118:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625291392 00000100:00100000:0.0:1746143849.585120:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625291392 00000100:00100000:0.0:1746143849.585132:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17269 00000100:00100000:0.0:1746143849.585137:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625291520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.585151:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.585165:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b45 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.585183:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.585185:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.585192:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.585210:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 10 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.585219:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408cc00, rc 0) 00000100:00100000:0.0:1746143849.585256:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625291520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 118us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.585272:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17269 00000100:00100000:0.0:1746143849.585285:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17270 00000100:00100000:0.0:1746143849.585289:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2011:x1830963625291392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.585296:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.585304:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b3e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.585314:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.585315:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.585318:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.585327:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 11 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.585333:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c800, rc 0) 00000100:00100000:0.0:1746143849.585346:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625291392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 58us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.585347:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.585351:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17270 00000100:00100000:0.0:1746143849.585358:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625291648 00000100:00100000:0.0:1746143849.585360:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625291648 00000100:00100000:0.0:1746143849.585379:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17271 00000100:00100000:0.0:1746143849.585383:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625291648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143849.585389:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.585395:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b6da2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b4c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143849.585425:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627589120:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143849.585872:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625291264 00000100:00100000:2.0:1746143849.585877:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625291264 00000100:00100000:0.0:1746143849.586503:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.586671:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1018 00000100:00100000:3.0:1746143849.586677:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625291264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.586687:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.586706:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7fc00/0x87925e4cb73b6d86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b37 expref: 20 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.586720:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143849.586724:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.586746:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625291264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 69us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.586751:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1018 00000100:00100000:1.0:1746143849.590705:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627589120:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143849.590733:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b6da2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b4c expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.590746:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b6da2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b4c expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.590759:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c400, rc 0) 00000100:00100000:1.0:1746143849.590795:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625291648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5410us (5447us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143849.590802:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17271 00000100:00100000:0.0:1746143849.600170:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.600558:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625291904 00000100:00100000:2.0:1746143849.600566:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625291904 00000100:00100000:1.0:1746143849.601841:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14140 00000100:00100000:1.0:1746143849.601850:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+19:3131:x1830963625291904:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143849.601872:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.601887:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6da9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b53 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.602266:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602278:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602290:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602300:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602304:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602309:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602376:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dbe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602384:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dbe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602388:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dbe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143849.602395:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143849.602447:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602452:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602457:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602462:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602467:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2db400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.602470:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602475:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602484:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143849.602486:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.602490:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602494:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602520:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602525:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602530:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602533:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2da800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.602536:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602539:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602545:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600b000) 00010000:00010000:1.0:1746143849.602547:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.602549:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602555:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b6db7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.602586:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6da9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b53 expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.602595:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dbe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b53 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.602600:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.602602:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143849.602604:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da000, rc 0) 00000100:00100000:1.0:1746143849.604275:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3131:x1830963625291904:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2421us (4107us total) trans 8589945243 rc 0/0 00000100:00100000:1.0:1746143849.604285:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14140 00000100:00100000:0.0:1746143849.604780:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.604817:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.605081:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625292416 00000100:00100000:1.0:1746143849.605088:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625292416 00002000:00100000:1.0:1746143849.605118:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8801373b8700 x1830963625292416/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.605126:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8700 with x1830963625292416 ext(0->1048575) 00002000:00010000:1.0:1746143849.605130:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8700 00000100:00100000:1.0:1746143849.605306:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625292288 00000100:00100000:1.0:1746143849.605309:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625292288 00000100:00100000:3.0:1746143849.605311:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7556 00000100:00100000:3.0:1746143849.605320:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625292416:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:1.0:1746143849.605321:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8801373baa00 x1830963625292288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.605329:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373baa00 with x1830963625292288 ext(1048576->2097151) 00002000:00010000:1.0:1746143849.605331:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801373baa00 00000100:00100000:1.0:1746143849.605347:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7557 00000100:00100000:1.0:1746143849.605351:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625292288:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.610167:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.610208:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.610249:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625292672 00000100:00100000:2.0:1746143849.610256:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625292672 00000100:00100000:2.0:1746143849.610325:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1019 00000100:00100000:2.0:1746143849.610333:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625292672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143849.610469:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625292544 00000100:00100000:0.0:1746143849.610473:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625292544 00000100:00100000:0.0:1746143849.610494:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17272 00000100:00100000:0.0:1746143849.610499:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3131:x1830963625292544:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143849.610510:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.610527:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b5a expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.610550:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.610558:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.610568:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.610570:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.610573:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [2027520->2088959] (req 2027520->2088959) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.610600:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 13 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.610609:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 13 pid: 1945 timeout: 1008 lvb_type: 1 00000100:00100000:0.0:1746143849.610619:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589248:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143849.610679:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.610687:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 26 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:0.0:1746143849.610694:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589376:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143849.610708:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143849.610814:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.610830:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dbe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b53 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.610846:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.610849:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.610868:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625292672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 536us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.610874:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1019 00000100:00100000:3.0:1746143849.622321:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625292416:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16994us (17533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.622331:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7556 00002000:00100000:3.0:1746143849.622341:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8801373b8700 x1830963625292416/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.622349:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b8700 with x1830963625292416 ext(0->1048575) 00002000:00010000:3.0:1746143849.622354:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801373b8700 00000100:00100000:1.0:1746143849.623148:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625292288:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17795us (18329us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143849.623155:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7557 00002000:00100000:1.0:1746143849.623162:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff8801373baa00 x1830963625292288/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.623169:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373baa00 with x1830963625292288 ext(1048576->2097151) 00010000:00010000:1.0:1746143849.623176:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 12 pid: 1945 timeout: 1008 lvb_type: 1 00010000:00010000:1.0:1746143849.623187:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 12 pid: 1945 timeout: 1008 lvb_type: 1 00002000:00010000:1.0:1746143849.623192:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373baa00 00000100:00100000:0.0:1746143849.623512:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589248:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.624828:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589376:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.624853:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [2027520->2088959] (req 2027520->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.624866:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408dc00, rc 0) 00000100:00100000:1.0:1746143849.624905:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3131:x1830963625292544:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 14404us (14744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.624934:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17272 00000100:00100000:0.0:1746143849.629108:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.629217:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625292800 00000100:00100000:3.0:1746143849.629225:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625292800 00010000:00010000:3.0:1746143849.629256:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 27 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:3.0:1746143849.629704:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8473 00000100:00100000:3.0:1746143849.629712:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625292800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.629726:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.629743:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 27 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.629754:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 27 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.629773:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55d800/0x87925e4cb73b6d47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b1b expref: 27 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.629803:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.630513:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625292800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 799us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.630520:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8473 00000100:00100000:0.0:1746143849.632627:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.632991:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625292928 00000100:00100000:3.0:1746143849.632998:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625292928 00010000:00010000:3.0:1746143849.633027:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 11 pid: 1945 timeout: 1008 lvb_type: 1 00000100:00100000:3.0:1746143849.633351:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8474 00000100:00100000:3.0:1746143849.633359:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2010:x1830963625292928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.633371:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.633389:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 11 pid: 1945 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143849.633400:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 11 pid: 1945 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143849.633418:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408cc00/0x87925e4cb73b6d94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b45 expref: 11 pid: 1945 timeout: 1008 lvb_type: 1 00010000:00010000:3.0:1746143849.633430:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.633432:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.633437:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.633444:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.633472:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 10 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.633483:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627589504:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143849.633558:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bdbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.637625:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.637760:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625293056 00000100:00100000:1.0:1746143849.637768:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625293056 00000100:00100000:1.0:1746143849.637808:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17273 00000100:00100000:1.0:1746143849.637815:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3129:x1830963625293056:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.637828:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.637841:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b61 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.637864:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.637871:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.637872:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.637876:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.637899:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.637909:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143849.637937:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589632:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.638011:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.638730:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627589504:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.638743:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.638755:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.638988:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625292928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5628us (6365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.638997:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8474 00000100:00100000:0.0:1746143849.639523:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625293312 00000100:00100000:0.0:1746143849.639528:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625293312 00002000:00100000:0.0:1746143849.639554:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (2027520->2031615) req@ffff88009610dc00 x1830963625293312/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.639562:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610dc00 with x1830963625293312 ext(2027520->2031615) 00010000:00010000:0.0:1746143849.639568:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.639578:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.639584:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009610dc00 00000100:00100000:0.0:1746143849.639607:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2765 00000100:00100000:0.0:1746143849.639613:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625293312:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143849.639701:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625293312:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 87us (946us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143849.639707:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2765 00002000:00100000:0.0:1746143849.639712:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (2027520->2031615) req@ffff88009610dc00 x1830963625293312/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.639718:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610dc00 with x1830963625293312 ext(2027520->2031615) 00010000:00010000:0.0:1746143849.639723:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:0.0:1746143849.639732:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 12 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:0.0:1746143849.639737:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009610dc00 00000100:00100000:0.0:1746143849.642516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.642931:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589632:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.642957:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.642970:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2db400, rc 0) 00000100:00100000:1.0:1746143849.643015:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3129:x1830963625293056:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5201us (5397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.643022:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17273 00000100:00100000:3.0:1746143849.643037:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625293568 00000100:00100000:3.0:1746143849.643042:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625293568 00002000:00100000:3.0:1746143849.643070:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (2084864->2088959) req@ffff8801373bb800 x1830963625293568/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.643082:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963625293568 ext(2084864->2088959) 00010000:00010000:3.0:1746143849.643088:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.643099:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.643105:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373bb800 00000100:00100000:3.0:1746143849.643135:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2766 00000100:00100000:3.0:1746143849.643141:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625293568:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143849.643235:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625293568:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 94us (726us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143849.643241:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2766 00002000:00100000:3.0:1746143849.643246:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bd:0x0] (2084864->2088959) req@ffff8801373bb800 x1830963625293568/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.643252:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373bb800 with x1830963625293568 ext(2084864->2088959) 00010000:00010000:3.0:1746143849.643257:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.643277:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.643282:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373bb800 00000100:00100000:0.0:1746143849.647718:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.647772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.648066:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625293824 00000100:00100000:2.0:1746143849.648074:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625293824 00002000:00100000:2.0:1746143849.648107:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (2027520->2088959) req@ffff8801373b9c00 x1830963625293824/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.648116:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963625293824 ext(2027520->2088959) 00010000:00010000:2.0:1746143849.648124:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.648137:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 11 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:2.0:1746143849.648144:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373b9c00 00000100:00100000:2.0:1746143849.648567:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2767 00000100:00100000:2.0:1746143849.648576:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625293824:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143849.648883:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625294080 00000100:00100000:3.0:1746143849.648887:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625294080 00000100:00100000:0.0:1746143849.649122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.649155:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5519 00000100:00100000:3.0:1746143849.649163:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3131:x1830963625294080:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143849.649170:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625294336 00000100:00100000:1.0:1746143849.649174:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625294336 00000100:00100000:3.0:1746143849.649392:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3131:x1830963625294080:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 229us (1619us total) trans 8589945244 rc 0/0 00000100:00100000:3.0:1746143849.649398:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5519 00000100:00100000:1.0:1746143849.649613:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14141 00000100:00100000:1.0:1746143849.649619:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+272:3133:x1830963625294336:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143849.649629:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.649853:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dbe00/0x87925e4cb73b6dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b68 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.649897:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.649908:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650378:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650391:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650397:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650401:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650461:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b6def lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650469:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b6def lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.650475:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b6def lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143849.651032:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143849.651079:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651085:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651090:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651094:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651099:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2dae00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.651102:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651108:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651117:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143849.651120:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.651123:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651127:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dae00/0x87925e4cb73b6de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651152:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651161:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651165:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651168:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2db600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.651170:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651174:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651179:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600b600) 00010000:00010000:1.0:1746143849.651180:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.651182:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651186:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db600/0x87925e4cb73b6de8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.651213:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dbe00/0x87925e4cb73b6dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b68 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.651221:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b6def lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b68 expref: 274 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.651226:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.651228:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143849.651229:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2dba00, rc 0) 00000100:00100000:1.0:1746143849.651255:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:3133:x1830963625294336:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1636us (2133us total) trans 8589945245 rc 0/0 00000100:00100000:1.0:1746143849.651272:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14141 00000100:00100000:3.0:1746143849.653645:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625293824:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5064us (5933us total) trans 21474841368 rc 0/0 00000100:00100000:3.0:1746143849.653655:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2767 00002000:00100000:3.0:1746143849.653665:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (2027520->2088959) req@ffff8801373b9c00 x1830963625293824/t21474841368(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.653673:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801373b9c00 with x1830963625293824 ext(2027520->2088959) 00010000:00010000:3.0:1746143849.653682:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.653694:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.653700:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801373b9c00 00000100:00100000:0.0:1746143849.655583:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.655762:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625294592 00000100:00100000:3.0:1746143849.655768:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625294592 00000100:00100000:3.0:1746143849.655847:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5520 00000100:00100000:3.0:1746143849.655853:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:3133:x1830963625294592:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143849.658049:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:3133:x1830963625294592:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 2189us (2464us total) trans 8589945246 rc 0/0 00000100:00100000:3.0:1746143849.658062:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5520 00000100:00100000:2.0:1746143849.658273:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.658337:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.658354:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625294720 00000100:00100000:2.0:1746143849.658359:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625294720 00000100:00100000:2.0:1746143849.658385:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625294848 00000100:00100000:2.0:1746143849.658387:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625294848 00010000:00010000:2.0:1746143849.658398:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.658414:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8475 00000100:00100000:2.0:1746143849.658419:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625294848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.658428:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143849.658441:0:16784:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143849 -> 1746143850 00002000:00010000:2.0:1746143849.658443:0:16784:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143849 -> 1746143850 00010000:00010000:2.0:1746143849.658447:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.658456:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.658475:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012408dc00/0x87925e4cb73b6dcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2088959) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b5a expref: 13 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.658490:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.658491:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.658498:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.658505:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.658530:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.658540:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627589760:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.658579:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.658594:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1020 00000100:00100000:2.0:1746143849.658599:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+275:2011:x1830963625294720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.658606:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.658617:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2dba00/0x87925e4cb73b6def lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b68 expref: 275 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.658628:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.658631:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.658645:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+274:2011:x1830963625294720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.658650:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1020 00000100:00100000:0.0:1746143849.664428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.664598:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627589760:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.664615:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.664650:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625294848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6230us (6313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.664663:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8475 00000100:00100000:1.0:1746143849.664742:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625294976 00000100:00100000:1.0:1746143849.664747:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625294976 00000100:00100000:1.0:1746143849.664776:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17274 00000100:00100000:1.0:1746143849.664782:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:3133:x1830963625294976:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143849.664794:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.664807:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b6f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.664827:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.664835:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.664842:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.664847:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.664848:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.664851:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [4079616->4145151] (req 4079616->4145151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.664874:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.664884:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 8 pid: 12327 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746143849.664895:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.664961:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.664969:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 1008 lvb_type: 1 00000100:00100000:1.0:1746143849.664976:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627590016:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.664998:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 11 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.665005:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 11 pid: 13430 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143849.665012:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627590144:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.665026:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.672650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.672724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.672764:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.672848:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625295232 00000100:00100000:3.0:1746143849.672855:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625295232 00002000:00100000:3.0:1746143849.672892:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009391f480 x1830963625295232/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.672901:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f480 with x1830963625295232 ext(1048576->2097151) 00002000:00010000:3.0:1746143849.672906:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f480 00000100:00100000:3.0:1746143849.672948:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7558 00000100:00100000:3.0:1746143849.672954:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625295232:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143849.674435:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627589888:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.674446:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627590016:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.674453:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627590144:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.674483:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [4079616->4145151] (req 4079616->4145151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 27 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.674501:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da000, rc 0) 00000100:00100000:1.0:1746143849.674528:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:3133:x1830963625294976:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9746us (10108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.674535:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17274 00000100:00100000:2.0:1746143849.674854:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625295488 00000100:00100000:2.0:1746143849.674863:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625295488 00010000:00010000:2.0:1746143849.674887:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 14 pid: 13430 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.674904:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625295360 00000100:00100000:2.0:1746143849.674906:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625295360 00010000:00010000:2.0:1746143849.674927:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 9 pid: 12327 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.674940:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8476 00000100:00100000:2.0:1746143849.674946:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625295488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.674955:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.674968:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 14 pid: 13430 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.674977:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 14 pid: 13430 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.674995:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55a400/0x87925e4cb73b6c8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412aa4 expref: 14 pid: 13430 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.675007:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.675025:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625295488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.675033:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8476 00000100:00100000:2.0:1746143849.675044:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8477 00000100:00100000:2.0:1746143849.675048:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625295360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.675054:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.675059:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 9 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.675066:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 9 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.675076:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082084800/0x87925e4cb73b6cc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ace expref: 9 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.675082:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.675094:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625295360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.675098:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8477 00000100:00100000:0.0:1746143849.680280:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.680970:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625295616 00000100:00100000:2.0:1746143849.680977:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625295616 00010000:00010000:2.0:1746143849.681009:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 1008 lvb_type: 1 00000100:00100000:2.0:1746143849.681047:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8478 00000100:00100000:2.0:1746143849.681054:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625295616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.681065:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.681084:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.681095:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.681113:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b800/0x87925e4cb73b6d39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b0d expref: 27 pid: 12327 timeout: 1008 lvb_type: 1 00010000:00010000:2.0:1746143849.681137:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.681140:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.681145:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.681153:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.681178:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 26 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.681189:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627590272:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.683940:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746143849.684352:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625295232:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 11393us (11704us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.684362:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7558 00002000:00100000:3.0:1746143849.684371:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009391f480 x1830963625295232/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.684378:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f480 with x1830963625295232 ext(1048576->2097151) 00002000:00010000:3.0:1746143849.684382:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391f480 00000100:00100000:2.0:1746143849.684966:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627590272:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.684983:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.685017:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625295616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3963us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.685025:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8478 00000100:00100000:0.0:1746143849.687287:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.687350:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625295872 00000100:00100000:3.0:1746143849.687357:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625295872 00002000:00100000:3.0:1746143849.687391:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (4079616->4083711) req@ffff88009391ea00 x1830963625295872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.687400:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963625295872 ext(4079616->4083711) 00002000:00010000:3.0:1746143849.687404:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ea00 00000100:00100000:3.0:1746143849.687431:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7559 00000100:00100000:3.0:1746143849.687438:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625295872:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143849.687668:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625295872:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 230us (386us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143849.687675:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7559 00002000:00100000:3.0:1746143849.687679:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (4079616->4083711) req@ffff88009391ea00 x1830963625295872/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.687685:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ea00 with x1830963625295872 ext(4079616->4083711) 00002000:00010000:3.0:1746143849.687687:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ea00 00000100:00100000:0.0:1746143849.698167:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.698253:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.698327:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625296128 00000100:00100000:2.0:1746143849.698335:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625296128 00000100:00100000:2.0:1746143849.698382:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625296000 00000100:00100000:2.0:1746143849.698384:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625296000 00000100:00100000:2.0:1746143849.698401:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17275 00000100:00100000:2.0:1746143849.698406:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625296128:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143849.698410:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17276 00000100:00100000:0.0:1746143849.698417:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625296000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143849.698421:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.698425:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.698434:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7e200/0x87925e4cb73b6e04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b7d expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.698434:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b6e0b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b76 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.698475:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627590400:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143849.698475:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627590528:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143849.698548:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.698873:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.699146:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.699207:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625296384 00000100:00100000:3.0:1746143849.699211:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625296384 00002000:00100000:3.0:1746143849.699232:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (4141056->4145151) req@ffff880093415880 x1830963625296384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.699239:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415880 with x1830963625296384 ext(4141056->4145151) 00002000:00010000:3.0:1746143849.699243:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093415880 00000100:00100000:3.0:1746143849.699272:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7560 00000100:00100000:3.0:1746143849.699277:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625296384:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143849.699368:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625296384:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 90us (222us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143849.699374:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7560 00002000:00100000:3.0:1746143849.699379:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (4141056->4145151) req@ffff880093415880 x1830963625296384/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.699385:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415880 with x1830963625296384 ext(4141056->4145151) 00002000:00010000:3.0:1746143849.699388:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093415880 00002000:00010000:2.0:1746143849.704270:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143849 -> 1746143850 00002000:00010000:2.0:1746143849.704276:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143849 -> 1746143850 00000100:00100000:2.0:1746143849.704296:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627590400:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143849.704325:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7e200/0x87925e4cb73b6e04 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b7d expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.704337:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7e200/0x87925e4cb73b6e04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b7d expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.704363:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7e200, rc 0) 00000100:00100000:2.0:1746143849.704407:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625296128:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5996us (6242us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143849.704415:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17275 00002000:00010000:1.0:1746143849.705403:0:9585:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143849 -> 1746143850 00002000:00010000:1.0:1746143849.705407:0:9585:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime: 1746143849 -> 1746143850 00000100:00100000:1.0:1746143849.705418:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093416d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627590528:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143849.705437:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b6e0b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b76 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.705446:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b6e0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b76 expref: 12 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.705468:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c400, rc 0) 00000100:00100000:1.0:1746143849.705490:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625296000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7074us (7237us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143849.705495:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17276 00000100:00100000:0.0:1746143849.712422:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.712555:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625296512 00000100:00100000:1.0:1746143849.712564:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625296512 00000100:00100000:1.0:1746143849.713051:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17277 00000100:00100000:1.0:1746143849.713060:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3129:x1830963625296512:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.713075:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.713089:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b84 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.713118:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.713124:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.713126:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.713129:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.713153:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.713164:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 25 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143849.713174:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627590656:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.714158:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.716359:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627590656:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.716385:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.716399:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7dc00, rc 0) 00000100:00100000:1.0:1746143849.716433:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3129:x1830963625296512:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3374us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.716441:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17277 00000100:00100000:0.0:1746143849.717038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.717142:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625296640 00000100:00100000:1.0:1746143849.717148:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625296640 00002000:00100000:1.0:1746143849.717176:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3190784->3309567) req@ffff880093416680 x1830963625296640/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.717185:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416680 with x1830963625296640 ext(3190784->3309567) 00010000:00010000:1.0:1746143849.717190:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 26 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:1.0:1746143849.717201:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 26 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:1.0:1746143849.717561:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093416680 00000100:00100000:3.0:1746143849.717733:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2768 00000100:00100000:3.0:1746143849.717742:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625296640:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143849.722605:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625296640:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4857us (5560us total) trans 17179874109 rc 0/0 00000100:00100000:3.0:1746143849.722617:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2768 00002000:00100000:3.0:1746143849.722626:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (3190784->3309567) req@ffff880093416680 x1830963625296640/t17179874109(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.722635:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416680 with x1830963625296640 ext(3190784->3309567) 00010000:00010000:3.0:1746143849.722644:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.722656:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.722662:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093416680 00000100:00100000:0.0:1746143849.725605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.725683:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625296768 00000100:00100000:2.0:1746143849.725690:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625296768 00010000:00010000:2.0:1746143849.725719:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.725739:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8479 00000100:00100000:2.0:1746143849.725744:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625296768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.725754:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.725770:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.725779:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.725796:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408ea00/0x87925e4cb73b6d63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3190784->3309567) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b29 expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.726026:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.726028:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.726034:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.726042:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.726071:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.726080:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627590784:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.726339:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.729324:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627590784:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.729344:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.729393:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625296768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3648us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.729402:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8479 00000100:00100000:0.0:1746143849.731015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.731101:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297024 00000100:00100000:3.0:1746143849.731108:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297024 00002000:00100000:3.0:1746143849.731142:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093416300 x1830963625297024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.731150:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416300 with x1830963625297024 ext(2097152->3145727) 00002000:00010000:3.0:1746143849.731154:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416300 00000100:00100000:3.0:1746143849.731173:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7561 00000100:00100000:3.0:1746143849.731179:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625297024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.740099:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625297024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8911us (9077us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.740112:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7561 00002000:00100000:3.0:1746143849.740123:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093416300 x1830963625297024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.740133:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416300 with x1830963625297024 ext(2097152->3145727) 00002000:00010000:3.0:1746143849.740138:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416300 00000100:00100000:0.0:1746143849.745068:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.745155:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297152 00000100:00100000:1.0:1746143849.745161:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297152 00000100:00100000:1.0:1746143849.745206:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17278 00000100:00100000:1.0:1746143849.745213:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3129:x1830963625297152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.745228:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.745245:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b8b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.745277:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.745284:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.745285:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143849.745288:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.745312:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 25 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.745323:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 25 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:1.0:1746143849.745332:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627590912:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.746908:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143849.754429:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627590912:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.754463:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.754477:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e513200, rc 0) 00000100:00100000:1.0:1746143849.754516:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3129:x1830963625297152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9302us (9454us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.754524:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17278 00000100:00100000:0.0:1746143849.755095:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.755196:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297280 00000100:00100000:3.0:1746143849.755202:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297280 00002000:00100000:3.0:1746143849.755233:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (4079616->4145151) req@ffff880129e6ce00 x1830963625297280/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.755241:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6ce00 with x1830963625297280 ext(4079616->4145151) 00010000:00010000:3.0:1746143849.755248:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 26 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.755266:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 26 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.755272:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6ce00 00000100:00100000:3.0:1746143849.755287:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2769 00000100:00100000:3.0:1746143849.755293:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625297280:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:3.0:1746143849.759710:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625297280:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 4409us (4607us total) trans 21474841369 rc 0/0 00000100:00100000:3.0:1746143849.759721:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2769 00002000:00100000:3.0:1746143849.759732:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x3bf:0x0] (4079616->4145151) req@ffff880129e6ce00 x1830963625297280/t21474841369(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/448 e 0 to 0 dl 1746143860 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.759744:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6ce00 with x1830963625297280 ext(4079616->4145151) 00010000:00010000:3.0:1746143849.759752:0:20387:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:3.0:1746143849.759766:0:20387:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00002000:00010000:3.0:1746143849.759771:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6ce00 00000100:00100000:0.0:1746143849.769718:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.770018:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297408 00000100:00100000:2.0:1746143849.770026:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297408 00010000:00010000:2.0:1746143849.770056:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00000100:00100000:2.0:1746143849.770088:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8480 00000100:00100000:2.0:1746143849.770095:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625297408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.770106:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.770125:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.770135:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.770153:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2da000/0x87925e4cb73b6dfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4079616->4145151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b6f expref: 28 pid: 1945 timeout: 1008 lvb_type: 0 00010000:00010000:2.0:1746143849.770183:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.770185:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.770192:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.770203:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.770231:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.770242:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627591040:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.770328:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.771696:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.771830:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297664 00000100:00100000:1.0:1746143849.771836:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297664 00000100:00100000:1.0:1746143849.771880:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14142 00000100:00100000:1.0:1746143849.771886:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:3138:x1830963625297664:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.771907:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.771945:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b6e20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b92 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.772001:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772012:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772021:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772033:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772038:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772042:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772119:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b6e35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772128:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b6e35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772133:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b6e35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746143849.772140:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143849.772199:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772203:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772207:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772212:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772216:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e513600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.772219:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772225:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772233:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143849.772235:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.772238:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772241:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513600/0x87925e4cb73b6e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772255:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772270:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772273:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772277:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e512200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143849.772279:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772283:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772289:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009600b800) 00010000:00010000:1.0:1746143849.772291:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143849.772293:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772301:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b6e2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746143849.772328:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513400/0x87925e4cb73b6e20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b92 expref: 277 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.772336:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b6e35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b92 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.772342:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.772343:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746143849.772345:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9d200, rc 0) 00000100:00100000:1.0:1746143849.772375:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:3138:x1830963625297664:12345-192.168.202.3@tcp:101:cat.0 Request processed in 489us (681us total) trans 8589945247 rc 0/0 00000100:00100000:1.0:1746143849.772380:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14142 00000100:00100000:0.0:1746143849.776649:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.776755:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627591040:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.776778:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.776817:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625297408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6722us (7104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.776827:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8480 00000100:00100000:1.0:1746143849.776929:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297792 00000100:00100000:1.0:1746143849.776935:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297792 00000100:00100000:1.0:1746143849.776973:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17279 00000100:00100000:1.0:1746143849.776979:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625297792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143849.776992:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.777005:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412b99 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.777021:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.777022:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.777029:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.777047:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 28 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.777056:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551600, rc 0) 00000100:00100000:1.0:1746143849.777074:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625297792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.777078:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17279 00000100:00100000:0.0:1746143849.777800:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.777836:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.778097:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625297920 00000100:00100000:2.0:1746143849.778101:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625297920 00000100:00100000:2.0:1746143849.778141:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1021 00000100:00100000:2.0:1746143849.778146:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+276:2009:x1830963625297920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.778155:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.778172:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9d200/0x87925e4cb73b6e35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b92 expref: 276 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.778188:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.778191:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.778213:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+275:2009:x1830963625297920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 66us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.778219:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1021 00000100:00100000:1.0:1746143849.778654:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.778673:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625298048 00000100:00100000:3.0:1746143849.778677:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625298048 00000100:00100000:3.0:1746143849.778699:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625298176 00000100:00100000:3.0:1746143849.778701:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625298176 00000100:00100000:3.0:1746143849.778714:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17280 00000100:00100000:3.0:1746143849.778719:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625298048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143849.778728:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.778737:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ba0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.778750:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.778752:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.778757:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.778768:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.778776:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1a00, rc 0) 00000100:00100000:3.0:1746143849.778809:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625298048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 89us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.778814:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17280 00000100:00100000:3.0:1746143849.778826:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17281 00000100:00100000:3.0:1746143849.778830:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625298176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143849.778836:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143849.778843:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ba7 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.778854:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.778855:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.778859:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.778868:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 29 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143849.778874:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c1800, rc 0) 00000100:00100000:3.0:1746143849.778893:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625298176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 63us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.778898:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17281 00000100:00100000:0.0:1746143849.788480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.788584:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.788670:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625298432 00000100:00100000:1.0:1746143849.788677:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625298432 00002000:00100000:1.0:1746143849.788714:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1d9f80 x1830963625298432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.788724:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9f80 with x1830963625298432 ext(2097152->4194303) 00002000:00010000:1.0:1746143849.788728:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9f80 00000100:00100000:1.0:1746143849.788741:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625298688 00000100:00100000:1.0:1746143849.788743:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625298688 00002000:00100000:1.0:1746143849.788752:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095e33b80 x1830963625298688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.788758:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33b80 with x1830963625298688 ext(3145728->4194303) 00002000:00010000:1.0:1746143849.788760:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33b80 00000100:00100000:1.0:1746143849.789030:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7562 00000100:00100000:1.0:1746143849.789036:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625298432:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143849.789967:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7563 00000100:00100000:0.0:1746143849.789975:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625298688:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143849.796130:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.796203:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625298944 00000100:00100000:0.0:1746143849.796211:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625298944 00002000:00100000:0.0:1746143849.796246:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092ef1180 x1830963625298944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.796255:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1180 with x1830963625298944 ext(1048576->2097151) 00002000:00010000:0.0:1746143849.796268:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef1180 00000100:00100000:0.0:1746143849.796288:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7564 00000100:00100000:0.0:1746143849.796295:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625298944:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.817046:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625298688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27064us (28453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143849.817311:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7563 00002000:00100000:3.0:1746143849.817322:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880095e33b80 x1830963625298688/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143849.817338:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33b80 with x1830963625298688 ext(3145728->4194303) 00002000:00010000:3.0:1746143849.817342:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e33b80 00000100:00100000:1.0:1746143849.822488:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625298432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 33442us (34005us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143849.822503:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7562 00002000:00100000:1.0:1746143849.822515:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88012b1d9f80 x1830963625298432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143849.822524:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1d9f80 with x1830963625298432 ext(2097152->4194303) 00002000:00010000:1.0:1746143849.822529:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1d9f80 00000100:00100000:2.0:1746143849.825571:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625298944:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29268us (29440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143849.825581:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7564 00002000:00100000:2.0:1746143849.825591:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880092ef1180 x1830963625298944/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.825600:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef1180 with x1830963625298944 ext(1048576->2097151) 00002000:00010000:2.0:1746143849.825605:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef1180 00000100:00100000:0.0:1746143849.845299:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.845741:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.846508:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.847681:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625299328 00000100:00100000:2.0:1746143849.847690:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625299328 00002000:00100000:2.0:1746143849.847730:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880095e31180 x1830963625299328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.847738:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963625299328 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.847742:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:2.0:1746143849.847761:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625299584 00000100:00100000:2.0:1746143849.847763:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625299584 00002000:00100000:2.0:1746143849.847775:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095e33480 x1830963625299584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.847781:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963625299584 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.847784:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:2.0:1746143849.847792:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625299712 00000100:00100000:2.0:1746143849.847794:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625299712 00002000:00100000:2.0:1746143849.847804:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095e31f80 x1830963625299712/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.847813:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31f80 with x1830963625299712 ext(4194304->4853759) 00002000:00010000:2.0:1746143849.847815:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31f80 00000100:00100000:2.0:1746143849.847835:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7565 00000100:00100000:2.0:1746143849.847841:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625299328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143849.848319:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7566 00000100:00100000:1.0:1746143849.848327:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625299584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143849.848414:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7567 00000100:00100000:0.0:1746143849.848420:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625299712:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143849.856320:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.856481:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625299968 00000100:00100000:0.0:1746143849.856490:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625299968 00000100:00100000:0.0:1746143849.856550:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14143 00000100:00100000:0.0:1746143849.856558:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+275:3140:x1830963625299968:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143849.856580:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.856594:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b6e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bae expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.856657:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.856668:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.856678:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.856689:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.856694:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.856699:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859751:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26c00/0x87925e4cb73b6e6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859768:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26c00/0x87925e4cb73b6e6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859778:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26c00/0x87925e4cb73b6e6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746143849.859790:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143849.859863:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859869:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859874:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859879:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859884:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b26400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143849.859887:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859893:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859903:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143849.859905:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143849.859909:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859933:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26400/0x87925e4cb73b6e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859960:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859965:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859969:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859976:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b26800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143849.859978:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859983:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859989:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5be3c00) 00010000:00010000:0.0:1746143849.859991:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143849.859992:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.859996:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26800/0x87925e4cb73b6e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746143849.860645:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b27000/0x87925e4cb73b6e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bae expref: 278 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.860661:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26c00/0x87925e4cb73b6e6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bae expref: 277 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.860666:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143849.860668:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746143849.860671:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00000100:00100000:0.0:1746143849.860710:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+277:3140:x1830963625299968:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4153us (4396us total) trans 8589945248 rc 0/0 00000100:00100000:0.0:1746143849.860716:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14143 00000100:00100000:0.0:1746143849.864844:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625299712:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16416us (18328us total) trans 0 rc 659456/659456 00000100:00100000:0.0:1746143849.864857:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7567 00002000:00100000:0.0:1746143849.864868:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880095e31f80 x1830963625299712/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143849.864876:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31f80 with x1830963625299712 ext(4194304->4853759) 00002000:00010000:0.0:1746143849.864882:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31f80 00000100:00100000:2.0:1746143849.869758:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625299328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 21908us (24457us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143849.869769:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7565 00002000:00100000:2.0:1746143849.869781:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff880095e31180 x1830963625299328/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.869790:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e31180 with x1830963625299328 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.869795:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095e31180 00000100:00100000:2.0:1746143849.886742:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625299584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 38408us (40993us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143849.886753:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7566 00002000:00100000:2.0:1746143849.886762:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880095e33480 x1830963625299584/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.886770:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33480 with x1830963625299584 ext(2097152->4194303) 00002000:00010000:2.0:1746143849.886774:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095e33480 00000100:00100000:0.0:1746143849.891611:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.892360:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.892857:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625300224 00000100:00100000:3.0:1746143849.892865:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625300224 00000100:00100000:3.0:1746143849.892907:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5521 00000100:00100000:3.0:1746143849.892926:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+277:3140:x1830963625300224:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143849.893105:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+278:3140:x1830963625300224:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 179us (1500us total) trans 8589945249 rc 0/0 00000100:00100000:3.0:1746143849.893111:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5521 00000100:00100000:0.0:1746143849.893491:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.893619:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625300352 00000100:00100000:1.0:1746143849.893624:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625300352 00000100:00100000:1.0:1746143849.893665:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1022 00000100:00100000:1.0:1746143849.893670:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+278:2011:x1830963625300352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.893679:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.893698:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b26c00/0x87925e4cb73b6e6d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bae expref: 278 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.893973:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625300608 00000100:00100000:3.0:1746143849.893976:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625300608 00000100:00100000:3.0:1746143849.893994:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5522 00000100:00100000:3.0:1746143849.893998:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3129:x1830963625300608:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143849.894071:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3129:x1830963625300608:12345-192.168.202.3@tcp:35:cat.0 Request processed in 72us (580us total) trans 8589945250 rc 0/0 00000100:00100000:3.0:1746143849.894077:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5522 00000100:00100000:0.0:1746143849.894219:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.894283:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625300864 00000100:00100000:2.0:1746143849.894287:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625300864 00000100:00100000:2.0:1746143849.894319:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14144 00000100:00100000:2.0:1746143849.894324:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3142:x1830963625300864:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143849.894334:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.894344:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73b6e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bb5 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.894385:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894395:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894404:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894414:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894419:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894424:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894481:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010200/0x87925e4cb73b6e90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894489:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096010200/0x87925e4cb73b6e90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894494:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096010200/0x87925e4cb73b6e90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746143849.894501:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143849.894535:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894542:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894547:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894552:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894556:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096010c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143849.894559:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894565:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894573:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143849.894576:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143849.894579:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894583:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096010c00/0x87925e4cb73b6e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894594:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894599:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894603:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894607:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096010600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143849.894609:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894613:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894619:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac900) 00010000:00010000:2.0:1746143849.894621:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143849.894623:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894627:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096010600/0x87925e4cb73b6e89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143849.894651:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73b6e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bb5 expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.894658:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096010200/0x87925e4cb73b6e90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bb5 expref: 24 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.894664:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143849.894666:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143849.894668:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010200, rc 0) 00000100:00100000:2.0:1746143849.894690:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3142:x1830963625300864:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 365us (778us total) trans 8589945251 rc 0/0 00000100:00100000:2.0:1746143849.894695:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14144 00010000:00010000:1.0:1746143849.895063:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.895067:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.895087:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+277:2011:x1830963625300352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1417us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.895093:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1022 00000100:00100000:0.0:1746143849.906728:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.906791:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625301120 00000100:00100000:2.0:1746143849.906800:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625301120 00002000:00100000:2.0:1746143849.906841:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f7b100 x1830963625301120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.906859:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f7b100 with x1830963625301120 ext(4194304->4853759) 00002000:00010000:2.0:1746143849.906864:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f7b100 00000100:00100000:2.0:1746143849.906892:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7568 00000100:00100000:2.0:1746143849.906899:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625301120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143849.914774:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.915122:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625301120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8221us (8400us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143849.915131:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7568 00002000:00100000:2.0:1746143849.915141:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093f7b100 x1830963625301120/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/440 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.915149:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f7b100 with x1830963625301120 ext(4194304->4853759) 00002000:00010000:2.0:1746143849.915154:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f7b100 00000100:00100000:1.0:1746143849.918018:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625301248 00000100:00100000:1.0:1746143849.918030:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625301248 00000100:00100000:1.0:1746143849.918090:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1023 00000100:00100000:1.0:1746143849.918098:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625301248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.918114:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.918136:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096010200/0x87925e4cb73b6e90 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bb5 expref: 24 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.918166:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143849.918170:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.918207:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625301248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 109us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.918213:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1023 00000100:00100000:0.0:1746143849.926881:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.927396:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625301504 00000100:00100000:3.0:1746143849.927404:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625301504 00000100:00100000:3.0:1746143849.927468:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5523 00000100:00100000:3.0:1746143849.927477:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+277:3138:x1830963625301504:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1746143849.927680:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+278:3138:x1830963625301504:12345-192.168.202.3@tcp:35:cat.0 Request processed in 202us (805us total) trans 8589945252 rc 0/0 00000100:00100000:3.0:1746143849.927687:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5523 00000100:00100000:0.0:1746143849.937139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.937358:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625301632 00000100:00100000:2.0:1746143849.937366:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625301632 00000100:00100000:2.0:1746143849.937405:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17282 00000100:00100000:2.0:1746143849.937413:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3142:x1830963625301632:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143849.937429:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.937444:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bbc expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.937469:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.937477:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.937488:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.937490:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.937493:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3096576->3145727] (req 3096576->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.937516:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 28 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.937527:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 28 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143849.937536:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.937723:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.937731:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143849.937738:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591296:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.937757:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.949454:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.949469:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591296:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.949494:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3096576->3145727] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.949516:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010200, rc 0) 00000100:00100000:2.0:1746143849.949577:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3142:x1830963625301632:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12164us (12445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.949585:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17282 00000100:00100000:0.0:1746143849.951690:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.951794:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.951876:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625301760 00000100:00100000:1.0:1746143849.951883:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625301760 00010000:00010000:1.0:1746143849.951938:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143849.952191:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625301888 00000100:00100000:1.0:1746143849.952194:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625301888 00010000:00010000:1.0:1746143849.952206:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 29 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143849.952238:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8481 00000100:00100000:2.0:1746143849.952248:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625301760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.952270:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.952288:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143849.952298:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143849.952317:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e513200/0x87925e4cb73b6e19 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b8b expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143849.952345:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.952377:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2011:x1830963625301760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 131us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.952383:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8481 00000100:00100000:2.0:1746143849.952398:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8482 00000100:00100000:2.0:1746143849.952403:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625301888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143849.952410:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143849.952416:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 29 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143849.952425:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 29 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143849.952437:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800969c1800/0x87925e4cb73b6e51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba7 expref: 29 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143849.952445:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.952447:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.952452:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.952461:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.952487:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143849.952499:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627591424:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143849.952545:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.954446:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627591424:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143849.954460:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143849.954484:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625301888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2080us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.954493:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8482 00000100:00100000:2.0:1746143849.954572:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.954610:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302144 00000100:00100000:2.0:1746143849.954615:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302144 00002000:00100000:2.0:1746143849.954643:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3096576->3100671) req@ffff880092ef2680 x1830963625302144/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.954652:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2680 with x1830963625302144 ext(3096576->3100671) 00002000:00010000:2.0:1746143849.954655:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2680 00000100:00100000:2.0:1746143849.954675:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7569 00000100:00100000:2.0:1746143849.954680:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625302144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143849.954768:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625302144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 88us (196us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143849.954773:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7569 00002000:00100000:2.0:1746143849.954778:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (3096576->3100671) req@ffff880092ef2680 x1830963625302144/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.954783:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef2680 with x1830963625302144 ext(3096576->3100671) 00002000:00010000:2.0:1746143849.954786:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef2680 00000100:00100000:0.0:1746143849.958194:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.958273:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302272 00000100:00100000:2.0:1746143849.958280:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302272 00000100:00100000:2.0:1746143849.959040:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17283 00000100:00100000:2.0:1746143849.959052:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:3140:x1830963625302272:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143849.959066:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143849.959080:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bc3 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.959103:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.959114:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.959120:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.959125:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.959126:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143849.959129:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1646592->2097151] (req 1646592->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.959150:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.959159:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 11 pid: 3135 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143849.959167:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.959249:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.959264:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143849.959271:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591680:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.959292:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143849.959299:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 7 pid: 9585 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143849.959305:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591808:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.959317:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.961006:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.961064:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302400 00000100:00100000:0.0:1746143849.961071:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302400 00000100:00100000:0.0:1746143849.961114:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17284 00000100:00100000:0.0:1746143849.961120:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3142:x1830963625302400:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143849.961135:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143849.961148:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bca expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.961171:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.961183:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.961189:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.961190:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143849.961193:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.961215:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 27 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143849.961223:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 27 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143849.961233:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627591936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143849.961322:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.961330:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143849.961337:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592064:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143849.961354:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.963025:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591552:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.963034:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591680:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.963270:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627591808:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143849.963293:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1646592->2097151] (req 1646592->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143849.963305:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010e00, rc 0) 00000100:00100000:2.0:1746143849.963333:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:3140:x1830963625302272:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4286us (5146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.963340:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17283 00000100:00100000:0.0:1746143849.965084:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143849.965141:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302528 00000100:00100000:3.0:1746143849.965148:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302528 00010000:00010000:3.0:1746143849.965175:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143849.965208:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8483 00000100:00100000:3.0:1746143849.965215:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625302528:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.965230:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.965248:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143849.965267:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143849.965289:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011de82600/0x87925e4cb73b6b41 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129e7 expref: 29 pid: 3135 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143849.965311:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.965338:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625302528:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 123us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.965344:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8483 00000100:00100000:2.0:1746143849.965617:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.965632:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302656 00000100:00100000:1.0:1746143849.965635:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302656 00010000:00010000:1.0:1746143849.965648:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 8 pid: 9585 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143849.965695:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8484 00000100:00100000:1.0:1746143849.965701:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625302656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.965707:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.965715:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 8 pid: 9585 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143849.965722:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 8 pid: 9585 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143849.965734:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7de00/0x87925e4cb73b6a06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841294d expref: 8 pid: 9585 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143849.965755:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.965776:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963625302656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.965781:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8484 00000100:00100000:0.0:1746143849.970052:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.971139:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.971242:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627591936:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.971253:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.971285:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.971301:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26200, rc 0) 00000100:00100000:1.0:1746143849.971349:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3142:x1830963625302400:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10228us (10441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.971357:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17284 00000100:00100000:1.0:1746143849.971389:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302784 00000100:00100000:1.0:1746143849.971393:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302784 00010000:00010000:1.0:1746143849.971414:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 12 pid: 3135 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143849.971435:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625302912 00000100:00100000:1.0:1746143849.971437:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625302912 00010000:00010000:1.0:1746143849.971444:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 28 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143849.971458:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8485 00000100:00100000:1.0:1746143849.971463:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625302784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.971473:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.971487:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 12 pid: 3135 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143849.971496:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 12 pid: 3135 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143849.971513:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b6b1e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129c4 expref: 12 pid: 3135 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143849.971524:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.971525:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.971531:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.971538:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143849.971538:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8486 00000100:00100000:0.0:1746143849.971544:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2010:x1830963625302912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143849.971551:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.971560:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143849.971563:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 28 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143849.971569:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 28 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143849.971570:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627592192:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143849.971580:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c1a00/0x87925e4cb73b6e4a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ba0 expref: 28 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143849.971591:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143849.971603:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625302912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143849.971608:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8486 00000100:00100000:1.0:1746143849.971615:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.974241:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.974587:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627592192:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143849.974598:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625303040 00000100:00100000:3.0:1746143849.974603:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625303040 00010000:00010000:1.0:1746143849.974606:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143849.974627:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143849.974634:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625302784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3171us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.974641:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8485 00000100:00100000:3.0:1746143849.974647:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8487 00000100:00100000:3.0:1746143849.974651:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625303040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143849.974660:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143849.974673:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143849.974682:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143849.974699:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x87925e4cb73b6e12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b84 expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143849.974722:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.974724:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143849.974729:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.974736:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143849.975693:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143849.975706:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627592320:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143849.975767:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143849.976517:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143849.977073:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625303296 00000100:00100000:2.0:1746143849.977079:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625303296 00002000:00100000:2.0:1746143849.977112:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1646592->1650687) req@ffff880092b72d80 x1830963625303296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.977120:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72d80 with x1830963625303296 ext(1646592->1650687) 00002000:00010000:2.0:1746143849.977125:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72d80 00000100:00100000:2.0:1746143849.977142:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7570 00000100:00100000:2.0:1746143849.977149:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625303296:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143849.977265:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625303296:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 108us (741us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143849.977270:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7570 00002000:00100000:2.0:1746143849.977275:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1646592->1650687) req@ffff880092b72d80 x1830963625303296/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.977281:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72d80 with x1830963625303296 ext(1646592->1650687) 00002000:00010000:2.0:1746143849.977283:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72d80 00000100:00100000:3.0:1746143849.979302:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627592320:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143849.979321:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143849.979350:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625303040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4697us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143849.979359:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8487 00000100:00100000:0.0:1746143849.987385:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143849.989884:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.989953:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625303552 00000100:00100000:1.0:1746143849.989960:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625303552 00000100:00100000:1.0:1746143849.990004:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17285 00000100:00100000:1.0:1746143849.990011:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:3140:x1830963625303552:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143849.990027:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143849.990040:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bd1 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.990062:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.990070:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 7 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.990075:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.990085:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.990086:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.990089:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.990112:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.990120:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 11 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143849.990128:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592448:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.990187:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 7 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143849.990194:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 7 pid: 13430 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143849.990200:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592576:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.990217:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.990223:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143849.990233:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592704:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143849.990237:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625303680 00000100:00100000:2.0:1746143849.990242:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625303680 00000100:00100000:1.0:1746143849.990244:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00002000:00100000:2.0:1746143849.990273:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3473408->3477503) req@ffff880092b70380 x1830963625303680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/0 e 0 to 0 dl 1746143860 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.990281:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70380 with x1830963625303680 ext(3473408->3477503) 00002000:00010000:2.0:1746143849.990285:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70380 00000100:00100000:2.0:1746143849.990297:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7571 00000100:00100000:2.0:1746143849.990302:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625303680:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143849.990394:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2010:x1830963625303680:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 91us (515us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143849.990400:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7571 00002000:00100000:2.0:1746143849.990405:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3473408->3477503) req@ffff880092b70380 x1830963625303680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:245/0 lens 488/4536 e 0 to 0 dl 1746143860 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143849.990415:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70380 with x1830963625303680 ext(3473408->3477503) 00002000:00010000:2.0:1746143849.990417:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b70380 00010000:00010000:3.0:1746143849.993207:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143849.998010:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592448:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143849.998010:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.998020:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592576:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143849.998027:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592704:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143849.998058:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 28 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.998072:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093716600, rc 0) 00000100:00100000:0.0:1746143849.998088:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.998107:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+28:3140:x1830963625303552:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8096us (10728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.998115:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17285 00000100:00100000:0.0:1746143849.998145:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625303936 00000100:00100000:0.0:1746143849.998150:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625303936 00010000:00010000:0.0:1746143849.998176:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 8 pid: 13430 timeout: 1009 lvb_type: 1 00000100:00100000:0.0:1746143849.998205:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625303808 00000100:00100000:0.0:1746143849.998208:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625303808 00010000:00010000:0.0:1746143849.998217:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 12 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143849.998223:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8488 00000100:00100000:1.0:1746143849.998228:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625303936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143849.998230:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8489 00000100:00100000:0.0:1746143849.998234:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2011:x1830963625303808:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.998238:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143849.998239:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.998254:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 8 pid: 13430 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143849.998262:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 12 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143849.998272:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 12 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143849.998979:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 8 pid: 13430 timeout: 1009 lvb_type: 1 00010000:00010000:0.0:1746143849.998997:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6c3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a6c expref: 12 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143849.998999:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b6cbb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ac0 expref: 8 pid: 13430 timeout: 1009 lvb_type: 1 00010000:00010000:1.0:1746143849.999042:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143849.999042:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143849.999063:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963625303936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 834us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143849.999069:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8488 00000100:00100000:0.0:1746143849.999080:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143849.999098:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625304064 00000100:00100000:1.0:1746143849.999100:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625304064 00010000:00010000:1.0:1746143849.999111:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143849.999129:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8490 00000100:00100000:1.0:1746143849.999134:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625304064:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143849.999140:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143849.999150:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143849.999158:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143849.999169:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d429000/0x87925e4cb73b6c0c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a5e expref: 28 pid: 13436 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143849.999177:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.999179:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143849.999184:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.999195:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143849.999218:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 27 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143849.999229:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627592832:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143849.999291:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143849.999443:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2011:x1830963625303808:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1207us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143849.999450:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8489 00000100:00100000:1.0:1746143850.003424:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627592832:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143850.003445:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.003495:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625304064:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4358us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.003504:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8490 00000100:00100000:0.0:1746143850.005499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.006072:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625304448 00000100:00100000:2.0:1746143850.006080:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625304448 00000100:00100000:2.0:1746143850.007304:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5524 00000100:00100000:2.0:1746143850.007316:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3142:x1830963625304448:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143850.007497:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3142:x1830963625304448:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 184us (2003us total) trans 8589945253 rc 0/0 00000100:00100000:2.0:1746143850.007503:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5524 00000100:00100000:2.0:1746143850.008472:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.008683:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625304576 00000100:00100000:0.0:1746143850.008690:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625304576 00002000:00100000:0.0:1746143850.008720:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1110016->1114111) req@ffff880092ef3100 x1830963625304576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143850.008728:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3100 with x1830963625304576 ext(1110016->1114111) 00002000:00010000:0.0:1746143850.008734:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3100 00000100:00100000:0.0:1746143850.008762:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7572 00000100:00100000:0.0:1746143850.008768:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625304576:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143850.008860:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625304576:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 92us (389us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143850.008866:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7572 00002000:00100000:0.0:1746143850.008870:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1110016->1114111) req@ffff880092ef3100 x1830963625304576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143850.008876:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3100 with x1830963625304576 ext(1110016->1114111) 00002000:00010000:0.0:1746143850.008879:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef3100 00000100:00100000:0.0:1746143850.020545:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.020641:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625304832 00000100:00100000:2.0:1746143850.020650:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625304832 00000100:00100000:2.0:1746143850.020689:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14145 00000100:00100000:2.0:1746143850.020695:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3148:x1830963625304832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.020714:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.020728:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76200/0x87925e4cb73b6eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bd8 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.020784:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020795:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020808:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020818:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020823:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020827:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020897:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b6ecf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020905:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b6ecf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020934:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b6ecf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746143850.020941:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143850.020991:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.020996:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.021001:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.021006:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.021011:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143850.021014:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.021020:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.021028:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143850.021030:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143850.021034:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.021038:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b6ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022632:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022642:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022647:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022651:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143850.022654:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022659:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022669:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac000) 00010000:00010000:2.0:1746143850.022671:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143850.022673:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022681:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76c00/0x87925e4cb73b6ec8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746143850.022725:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76200/0x87925e4cb73b6eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd8 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.022735:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b6ecf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd8 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.022741:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143850.022743:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746143850.022745:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:2.0:1746143850.023874:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+26:3148:x1830963625304832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3173us (3330us total) trans 8589945254 rc 0/0 00000100:00100000:2.0:1746143850.023882:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14145 00000100:00100000:0.0:1746143850.026882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.026975:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625304960 00000100:00100000:1.0:1746143850.026983:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625304960 00000100:00100000:1.0:1746143850.027036:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1024 00000100:00100000:1.0:1746143850.027042:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625304960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.027053:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.027075:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77800/0x87925e4cb73b6ecf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd8 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.027092:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.027096:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.027127:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625304960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.027133:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1024 00000100:00100000:0.0:1746143850.028826:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.029397:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305216 00000100:00100000:1.0:1746143850.029404:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305216 00000100:00080000:2.0:1746143850.029446:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143850.029995:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.030371:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305088 00000100:00100000:1.0:1746143850.030376:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305088 00000100:00080000:2.0:1746143850.030432:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143850.030534:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17286 00000100:00100000:1.0:1746143850.030542:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625305216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143850.030557:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.030572:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b6edd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412be6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143850.030616:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592960:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143850.030686:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.030728:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17287 00000100:00100000:2.0:1746143850.030736:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625305088:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.030743:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.030752:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b6ee4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bdf expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.030774:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627593088:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143850.030796:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00002000:00010000:1.0:1746143850.032679:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143849 -> 1746143850 00002000:00010000:1.0:1746143850.032684:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143849 -> 1746143850 00002000:00010000:1.0:1746143850.032686:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143849 -> 1746143850 00000100:00100000:1.0:1746143850.032701:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627592960:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143850.032726:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b6edd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412be6 expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.032737:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801338b5000/0x87925e4cb73b6edd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412be6 expref: 12 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.032746:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801338b5000, rc 0) 00000100:00100000:1.0:1746143850.032777:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625305216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2236us (3955us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143850.032786:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17286 00002000:00010000:2.0:1746143850.032865:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143848 -> 1746143850 00002000:00010000:2.0:1746143850.032868:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143848 -> 1746143850 00002000:00010000:2.0:1746143850.032870:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143848 -> 1746143850 00000100:00100000:2.0:1746143850.032879:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627593088:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.032896:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b6ee4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bdf expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.032904:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e76a00/0x87925e4cb73b6ee4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bdf expref: 12 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.032936:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76a00, rc 0) 00000100:00100000:2.0:1746143850.032956:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625305088:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2222us (2962us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.032961:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17287 00000100:00100000:0.0:1746143850.043978:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.044454:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305344 00000100:00100000:2.0:1746143850.044462:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305344 00000100:00100000:2.0:1746143850.044512:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17288 00000100:00100000:2.0:1746143850.044520:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3148:x1830963625305344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.044535:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.044989:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bed expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.045014:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.045020:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143850.045022:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143850.045025:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.045054:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 27 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.045065:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 27 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.045075:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627593216:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.046374:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.049754:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.049854:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305472 00000100:00100000:1.0:1746143850.049862:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305472 00002000:00100000:1.0:1746143850.049900:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1646592->2097151) req@ffff880095c30700 x1830963625305472/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.049909:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30700 with x1830963625305472 ext(1646592->2097151) 00010000:00010000:1.0:1746143850.049942:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 28 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.049954:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 28 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:1.0:1746143850.049960:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c30700 00000100:00100000:2.0:1746143850.050104:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627593216:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.050125:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 12 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.050137:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:2.0:1746143850.050174:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3148:x1830963625305344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5655us (6203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.050181:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17288 00000100:00100000:1.0:1746143850.050992:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2770 00000100:00100000:1.0:1746143850.051001:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+28:2011:x1830963625305472:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:1.0:1746143850.060342:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625305472:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9314us (10566us total) trans 21474841370 rc 0/0 00000100:00100000:1.0:1746143850.060353:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2770 00002000:00100000:1.0:1746143850.060363:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1646592->2097151) req@ffff880095c30700 x1830963625305472/t21474841370(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.060371:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c30700 with x1830963625305472 ext(1646592->2097151) 00010000:00010000:1.0:1746143850.060379:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.060396:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:1.0:1746143850.060402:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c30700 00000100:00100000:0.0:1746143850.065335:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.065389:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.065421:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305856 00000100:00100000:0.0:1746143850.065428:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305856 00010000:00010000:0.0:1746143850.065458:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.065496:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8491 00000100:00100000:0.0:1746143850.065505:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625305856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143850.065519:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143850.065536:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.065547:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.065567:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096010e00/0x87925e4cb73b6ea5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1646592->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bc3 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.065584:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.065587:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.065593:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.065600:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.065625:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 11 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.065637:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627593344:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143850.065703:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.066236:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305728 00000100:00100000:3.0:1746143850.066240:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305728 00000100:00100000:3.0:1746143850.066286:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14146 00000100:00100000:3.0:1746143850.066292:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+278:3153:x1830963625305728:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.066314:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.066326:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b6ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bf4 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.066380:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066389:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066398:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066409:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066415:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066419:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066497:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066506:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066512:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143850.066519:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143850.066577:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066583:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066588:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066592:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066597:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.066601:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066606:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066614:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143850.066616:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.066619:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066623:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467800/0x87925e4cb73b6ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066636:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066644:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066648:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066652:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.066654:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066658:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066663:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8b00) 00010000:00010000:3.0:1746143850.066665:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.066667:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066671:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.066699:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b6ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bf4 expref: 281 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.066708:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bf4 expref: 280 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.066714:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.066715:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143850.066717:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:3.0:1746143850.066744:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:3153:x1830963625305728:12345-192.168.202.3@tcp:101:cat.0 Request processed in 451us (1417us total) trans 8589945255 rc 0/0 00000100:00100000:3.0:1746143850.066750:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14146 00000100:00080000:0.0:1746143850.069077:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143850.069232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.069454:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627593344:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143850.069469:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143850.069509:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2010:x1830963625305856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4005us (4119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.069518:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8491 00000100:00100000:3.0:1746143850.070535:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625305984 00000100:00100000:3.0:1746143850.070541:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625305984 00000100:00100000:0.0:1746143850.071399:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.071418:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625306240 00000100:00100000:0.0:1746143850.071422:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625306240 00000100:00100000:3.0:1746143850.071489:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17289 00000100:00100000:3.0:1746143850.071496:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625305984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.071510:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.071525:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412bfb expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.071542:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.071544:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.071551:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 30 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.071564:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 30 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.071572:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d7fa00, rc 0) 00000100:00100000:1.0:1746143850.073865:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1025 00000100:00100000:1.0:1746143850.073880:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+280:2011:x1830963625306240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.073896:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.073942:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bf4 expref: 280 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.073965:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.073969:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.074093:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625305984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2596us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.074100:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17289 00000100:00100000:0.0:1746143850.074288:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.074384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.074416:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.074435:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625306112 00000100:00100000:0.0:1746143850.074440:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625306112 00000100:00100000:0.0:1746143850.074463:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625306624 00000100:00100000:0.0:1746143850.074465:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625306624 00000100:00100000:0.0:1746143850.074477:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17290 00000100:00100000:0.0:1746143850.074481:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625306112:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143850.074493:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.074503:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b6f1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c02 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.074540:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012457ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627593472:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143850.074588:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.074671:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17291 00000100:00100000:3.0:1746143850.074678:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625306624:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.074684:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.074693:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c09 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.074719:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627593600:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.074753:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.074841:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625306496 00000100:00100000:2.0:1746143850.074845:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625306496 00002000:00100000:2.0:1746143850.074870:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c32d80 x1830963625306496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.074878:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32d80 with x1830963625306496 ext(1048576->2097151) 00002000:00010000:2.0:1746143850.074881:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c32d80 00000100:00100000:2.0:1746143850.074905:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7573 00000100:00100000:2.0:1746143850.074924:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625306496:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143850.075993:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+279:2011:x1830963625306240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2114us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.076001:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1025 00002000:00010000:2.0:1746143850.085836:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143849 -> 1746143850 00000100:00100000:2.0:1746143850.085861:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012457ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627593472:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.085887:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b6f1c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c02 expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.085898:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27800/0x87925e4cb73b6f1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c02 expref: 28 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.085949:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b27800, rc 0) 00000100:00100000:2.0:1746143850.085995:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625306112:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11511us (11609us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.086002:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17290 00002000:00010000:3.0:1746143850.086235:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143849 -> 1746143850 00000100:00100000:3.0:1746143850.086248:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627593600:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.086274:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f23 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c09 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.086282:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c09 expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.086294:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d467600, rc 0) 00000100:00100000:3.0:1746143850.086316:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625306624:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11639us (11899us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.086322:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17291 00000100:00100000:2.0:1746143850.087767:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625306496:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12853us (13475us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143850.087776:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7573 00002000:00100000:2.0:1746143850.087783:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c32d80 x1830963625306496/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.087791:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c32d80 with x1830963625306496 ext(1048576->2097151) 00002000:00010000:2.0:1746143850.087794:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c32d80 00000100:00100000:0.0:1746143850.094561:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.096022:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625306752 00000100:00100000:3.0:1746143850.096035:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625306752 00000100:00100000:3.0:1746143850.096084:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17292 00000100:00100000:3.0:1746143850.096090:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3148:x1830963625306752:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.096104:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.096116:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c10 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.096141:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.096156:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.096157:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.096160:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.096187:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 26 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.096197:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 26 pid: 13430 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.096205:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627593728:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.097153:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.097864:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.098331:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625307008 00000100:00100000:2.0:1746143850.098336:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625307008 00002000:00100000:2.0:1746143850.098368:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092b72300 x1830963625307008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.098377:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72300 with x1830963625307008 ext(1048576->2097151) 00002000:00010000:2.0:1746143850.098382:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72300 00000100:00100000:2.0:1746143850.098413:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7574 00000100:00100000:2.0:1746143850.098419:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625307008:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.102472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.102814:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625307264 00000100:00100000:3.0:1746143850.102822:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625307264 00002000:00100000:3.0:1746143850.102855:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1114112->2097151) req@ffff880092ef3480 x1830963625307264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.102864:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3480 with x1830963625307264 ext(1114112->2097151) 00010000:00010000:3.0:1746143850.102872:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 27 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.102885:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 27 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:3.0:1746143850.102891:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef3480 00000100:00100000:0.0:1746143850.102949:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627593728:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143850.103240:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.103264:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096010600, rc 0) 00000100:00100000:0.0:1746143850.103561:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012457ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3148:x1830963625306752:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7469us (9006us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.103568:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17292 00000100:00100000:1.0:1746143850.103571:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2771 00000100:00100000:1.0:1746143850.103578:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625307264:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143850.104159:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.106139:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625307392 00000100:00100000:3.0:1746143850.106148:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625307392 00002000:00100000:3.0:1746143850.106182:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1114111) req@ffff880092b73480 x1830963625307392/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.106190:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73480 with x1830963625307392 ext(1048576->1114111) 00010000:00010000:3.0:1746143850.106199:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 29 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.106211:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 29 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:3.0:1746143850.106216:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b73480 00000100:00100000:3.0:1746143850.106250:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2772 00000100:00100000:3.0:1746143850.106268:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625307392:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143850.108469:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625307008:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10043us (10600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143850.108479:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7574 00002000:00100000:2.0:1746143850.108488:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880092b72300 x1830963625307008/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.108496:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b72300 with x1830963625307008 ext(1048576->2097151) 00002000:00010000:2.0:1746143850.108501:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b72300 00000100:00100000:1.0:1746143850.108639:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625307264:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5061us (6174us total) trans 0 rc 983040/983040 00000100:00100000:1.0:1746143850.108646:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2771 00002000:00100000:1.0:1746143850.108650:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1114112->2097151) req@ffff880092ef3480 x1830963625307264/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.108663:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3480 with x1830963625307264 ext(1114112->2097151) 00010000:00010000:1.0:1746143850.108670:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.108681:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:1.0:1746143850.108686:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ef3480 00000100:00100000:3.0:1746143850.109081:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625307392:12345-192.168.202.3@tcp:4:cat.0 Request processed in 2823us (4921us total) trans 17179874110 rc 0/0 00000100:00100000:3.0:1746143850.109088:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2772 00002000:00100000:3.0:1746143850.109093:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1114111) req@ffff880092b73480 x1830963625307392/t17179874110(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.109100:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b73480 with x1830963625307392 ext(1048576->1114111) 00010000:00010000:3.0:1746143850.109105:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 29 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.109113:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 29 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:3.0:1746143850.109122:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092b73480 00000100:00100000:0.0:1746143850.114207:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.114287:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625307520 00000100:00100000:2.0:1746143850.114295:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625307520 00000100:00100000:2.0:1746143850.114349:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17293 00000100:00100000:2.0:1746143850.114357:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+29:3153:x1830963625307520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.114372:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.114386:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c17 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.114407:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143850.114413:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.114423:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.114436:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b400, rc 0) 00000100:00100000:2.0:1746143850.114487:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:3153:x1830963625307520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.114492:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17293 00000100:00100000:2.0:1746143850.115387:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.115442:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625307648 00000100:00100000:1.0:1746143850.115446:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625307648 00010000:00010000:1.0:1746143850.115464:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 30 pid: 13430 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.115493:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8492 00000100:00100000:1.0:1746143850.115499:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625307648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.115511:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.115528:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 30 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.115539:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 30 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.115555:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093716600/0x87925e4cb73b6eb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bd1 expref: 30 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.115578:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.115580:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.115585:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.115593:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.115599:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.115600:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.115603:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.115609:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.115634:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143850.115644:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627593856:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143850.115712:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143850.115720:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627593984:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143850.115736:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143850.119536:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627593856:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143850.119838:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627593984:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143850.119859:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.119893:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625307648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4393us (4506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.119902:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8492 00000100:00100000:0.0:1746143850.121575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.121628:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625307904 00000100:00100000:3.0:1746143850.121634:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625307904 00002000:00100000:3.0:1746143850.121667:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800939a5f80 x1830963625307904/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.121676:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5f80 with x1830963625307904 ext(1048576->2097151) 00002000:00010000:3.0:1746143850.121680:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5f80 00000100:00100000:3.0:1746143850.121705:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7575 00000100:00100000:3.0:1746143850.121710:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625307904:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143850.122846:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.122978:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625308160 00000100:00100000:1.0:1746143850.122983:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625308160 00002000:00100000:1.0:1746143850.123005:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800921cf100 x1830963625308160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.123013:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf100 with x1830963625308160 ext(1048576->2097151) 00002000:00010000:1.0:1746143850.123017:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cf100 00000100:00100000:1.0:1746143850.123046:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7576 00000100:00100000:1.0:1746143850.123052:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625308160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143850.135422:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800939a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625307904:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13703us (13841us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143850.135432:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7575 00002000:00100000:3.0:1746143850.135442:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800939a5f80 x1830963625307904/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.135451:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800939a5f80 with x1830963625307904 ext(1048576->2097151) 00002000:00010000:3.0:1746143850.135456:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800939a5f80 00000100:00100000:1.0:1746143850.139473:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625308160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16413us (16621us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143850.139485:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7576 00002000:00100000:1.0:1746143850.139495:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff8800921cf100 x1830963625308160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.139504:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800921cf100 with x1830963625308160 ext(1048576->2097151) 00002000:00010000:1.0:1746143850.139509:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800921cf100 00000100:00100000:0.0:1746143850.150520:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.150591:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625308288 00000100:00100000:1.0:1746143850.150599:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625308288 00000100:00100000:1.0:1746143850.150666:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14147 00000100:00100000:1.0:1746143850.150674:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3156:x1830963625308288:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143850.150695:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.150709:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73b6f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c1e expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.150805:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150814:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150822:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150831:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150836:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150840:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150886:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150894:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 278 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.150899:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.150937:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 278 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.150946:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 278 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.150960:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627594112:192.168.202.3@tcp:104: 00000100:00080000:0.0:1746143850.150961:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746143850.151252:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.153171:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.153225:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.153226:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625308416 00000100:00100000:2.0:1746143850.153232:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625308416 00000100:00100000:3.0:1746143850.153283:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625308544 00000100:00100000:3.0:1746143850.153286:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625308544 00000100:00100000:3.0:1746143850.153629:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17294 00000100:00100000:3.0:1746143850.153638:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625308544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.153651:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.153664:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c2c expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.153708:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627594240:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143850.153797:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17295 00000100:00100000:2.0:1746143850.153804:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625308416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.153812:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.153820:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b6400/0x87925e4cb73b6f5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c25 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.153843:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627594368:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.154490:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.154552:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.159869:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.159905:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.159944:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.160009:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627594240:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.160039:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f54 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c2c expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.160052:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d466e00/0x87925e4cb73b6f54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c2c expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.160070:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d466e00, rc 0) 00000100:00100000:2.0:1746143850.160107:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625308544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6470us (6881us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.160114:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17294 00000100:00100000:2.0:1746143850.160212:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627594368:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.160230:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6400/0x87925e4cb73b6f5b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c25 expref: 30 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.160237:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6400/0x87925e4cb73b6f5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c25 expref: 30 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.160244:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6400, rc 0) 00000100:00100000:2.0:1746143850.160272:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625308416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6469us (7105us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.160278:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17295 00000100:00100000:1.0:1746143850.160283:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627594112:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143850.160300:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746143850.160353:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625308800 00000100:00100000:3.0:1746143850.160359:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625308800 00000100:00100000:3.0:1746143850.160385:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5525 00000100:00100000:3.0:1746143850.160391:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+279:30658:x1830963625308800:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143850.160502:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625309056 00000100:00100000:0.0:1746143850.160507:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625309056 00002000:00100000:0.0:1746143850.160535:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009391f800 x1830963625309056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 504/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143850.160542:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963625309056 ext(2097152->4194303) 00002000:00010000:0.0:1746143850.160547:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391f800 00000100:00100000:0.0:1746143850.160560:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625309312 00000100:00100000:0.0:1746143850.160562:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625309312 00002000:00100000:0.0:1746143850.160573:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009391ed80 x1830963625309312/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 504/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143850.160587:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ed80 with x1830963625309312 ext(2097152->4194303) 00002000:00010000:0.0:1746143850.160590:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ed80 00000100:00100000:0.0:1746143850.160613:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7577 00000100:00100000:0.0:1746143850.160619:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625309056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143850.160627:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7578 00000100:00100000:1.0:1746143850.160633:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625309312:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143850.165219:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+280:30658:x1830963625308800:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 4818us (5348us total) trans 8589945256 rc 0/0 00000100:00100000:3.0:1746143850.165231:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5525 00000100:00100000:3.0:1746143850.170636:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.170661:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625309568 00000100:00100000:3.0:1746143850.170668:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625309568 00000100:00100000:3.0:1746143850.170705:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14148 00000100:00100000:3.0:1746143850.170712:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:3155:x1830963625309568:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143850.170729:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.170743:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b6f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c33 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.170801:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170812:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170820:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170831:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170836:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170841:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170935:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6f77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170945:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6f77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.170950:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6f77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143850.170958:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143850.173113:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173125:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173131:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173137:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173141:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.173145:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173151:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173163:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143850.173165:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.173168:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173172:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b6f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173183:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173187:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173190:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173194:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.173195:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173199:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173205:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009737db00) 00010000:00010000:3.0:1746143850.173207:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.173209:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173212:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467600/0x87925e4cb73b6f70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143850.173249:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467400/0x87925e4cb73b6f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c33 expref: 283 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.173270:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6f77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c33 expref: 282 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.173275:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.173277:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143850.173280:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.173285:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.173290:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3b400, rc 0) 00000100:00100000:3.0:1746143850.173318:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+282:3155:x1830963625309568:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2605us (2687us total) trans 8589945257 rc 0/0 00000100:00100000:3.0:1746143850.173326:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14148 00000100:00100000:0.0:1746143850.174889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.174963:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625309696 00000100:00100000:3.0:1746143850.174970:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625309696 00000100:00100000:3.0:1746143850.175000:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17296 00000100:00100000:3.0:1746143850.175005:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+29:3153:x1830963625309696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.175018:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.175031:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c3a expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.175052:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.175062:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.175064:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.175066:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.175090:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 13 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.175099:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 13 pid: 13430 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.175108:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627594496:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.175575:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.184498:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625309056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23870us (24583us total) trans 0 rc 1765376/1765376 00000100:00100000:2.0:1746143850.184508:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7577 00002000:00100000:2.0:1746143850.184518:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88009391f800 x1830963625309056/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 504/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1765376/1765376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.184526:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391f800 with x1830963625309056 ext(2097152->4194303) 00010000:00010000:2.0:1746143850.184535:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.184552:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.184559:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391f800 00000100:00100000:0.0:1746143850.185749:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.185851:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625309824 00000100:00100000:1.0:1746143850.185859:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625309824 00010000:00010000:1.0:1746143850.185886:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 282 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.185908:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8493 00000100:00100000:1.0:1746143850.185936:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+282:2010:x1830963625309824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.185948:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.185953:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 282 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.185961:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 282 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.185978:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880082085a00/0x87925e4cb73b6d55 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b22 expref: 282 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.186011:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.186015:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186023:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186030:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186051:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.186076:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+281:2010:x1830963625309824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 163us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.186082:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8493 00010000:00010000:1.0:1746143850.186100:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186105:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143850.186295:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:1.0:1746143850.186299:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143850.186314:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186323:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186332:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186338:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186344:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186349:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186354:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa16000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143850.186356:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186363:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186370:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143850.186373:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143850.186376:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186380:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16000/0x87925e4cb73b6f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186389:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186394:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186399:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186404:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa16e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143850.186406:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186414:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186419:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009737db00) 00010000:00010000:1.0:1746143850.186421:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143850.186422:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186427:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa16e00/0x87925e4cb73b6f46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.186453:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096011000/0x87925e4cb73b6f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.186463:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.186468:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.186470:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143850.186472:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa17600, rc 0) 00000100:00100000:1.0:1746143850.186506:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800921cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3156:x1830963625308288:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 35832us (35992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.186512:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14147 00000100:00100000:0.0:1746143850.199403:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.199461:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625309952 00000100:00100000:2.0:1746143850.199469:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625309952 00002000:00100000:2.0:1746143850.199505:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3477503) req@ffff880093634a80 x1830963625309952/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.199514:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093634a80 with x1830963625309952 ext(3145728->3477503) 00010000:00010000:2.0:1746143850.199522:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.199534:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 12 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.199541:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093634a80 00000100:00100000:2.0:1746143850.199558:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2773 00000100:00100000:2.0:1746143850.199565:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2008:x1830963625309952:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143850.199649:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627594496:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.199672:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 30 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.199685:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3b200, rc 0) 00000100:00100000:1.0:1746143850.200128:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2009:x1830963625309312:12345-192.168.202.3@tcp:3:cat.0 Request processed in 39493us (40181us total) trans 0 rc 2048000/2048000 00000100:00100000:1.0:1746143850.200137:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7578 00002000:00100000:1.0:1746143850.200143:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009391ed80 x1830963625309312/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 504/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 2048000/2048000 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.200155:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391ed80 with x1830963625309312 ext(2097152->4194303) 00002000:00010000:1.0:1746143850.200158:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391ed80 00000100:00100000:3.0:1746143850.200999:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+30:3153:x1830963625309696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 25991us (26111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.201006:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17296 00000100:00100000:0.0:1746143850.204515:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.204554:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.204577:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310080 00000100:00100000:0.0:1746143850.204584:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310080 00000100:00100000:0.0:1746143850.204622:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310208 00000100:00100000:0.0:1746143850.204624:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310208 00000100:00100000:0.0:1746143850.204660:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17297 00000100:00100000:0.0:1746143850.204666:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2010:x1830963625310080:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143850.204680:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.204693:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c41 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.204711:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.204712:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.204720:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.204732:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.204740:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:0.0:1746143850.204768:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625310080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.204774:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17297 00000100:00100000:0.0:1746143850.204787:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17298 00000100:00100000:0.0:1746143850.204791:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963625310208:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143850.204798:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.204805:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c48 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.204817:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.204818:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.204822:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.204831:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 8 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.204838:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74a00, rc 0) 00000100:00100000:0.0:1746143850.204852:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625310208:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.204856:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17298 00000100:00080000:0.0:1746143850.204872:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746143850.204874:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746143850.204895:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.204905:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310336 00000100:00100000:0.0:1746143850.204908:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310336 00000100:00100000:0.0:1746143850.204948:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17299 00000100:00100000:0.0:1746143850.204952:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625310336:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143850.204959:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.204964:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c4f expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.204973:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.204975:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.204979:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.204987:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 9 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.204993:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:0.0:1746143850.205010:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625310336:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.205014:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17299 00000100:00100000:0.0:1746143850.205039:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.205048:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310592 00000100:00100000:0.0:1746143850.205050:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310592 00000100:00100000:0.0:1746143850.205062:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17300 00000100:00100000:0.0:1746143850.205066:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625310592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143850.205072:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.205077:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73b6fa1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c5d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.205111:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627594624:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143850.205160:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.205188:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.205203:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310848 00000100:00100000:0.0:1746143850.205205:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310848 00000100:00100000:0.0:1746143850.205238:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1026 00000100:00100000:0.0:1746143850.205243:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+281:2010:x1830963625310848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143850.205279:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143850.205297:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3b400/0x87925e4cb73b6f77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c33 expref: 281 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.205313:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143850.205317:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143850.205331:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+280:2010:x1830963625310848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 88us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.205335:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1026 00000100:00100000:0.0:1746143850.205357:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.205365:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310464 00000100:00100000:0.0:1746143850.205368:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310464 00000100:00100000:0.0:1746143850.205379:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17301 00000100:00100000:0.0:1746143850.205383:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625310464:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143850.205388:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.205393:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c56 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.205401:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.205402:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.205406:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.205413:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 11 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.205419:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75200, rc 0) 00000100:00100000:0.0:1746143850.205428:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625310464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 46us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.205432:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17301 00000100:00100000:0.0:1746143850.205462:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.205471:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310720 00000100:00100000:0.0:1746143850.205474:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310720 00000100:00100000:0.0:1746143850.205488:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17302 00000100:00100000:0.0:1746143850.205492:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625310720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143850.205497:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.205502:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b6faf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c64 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.205523:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627594752:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143850.205545:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143850.212408:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627594752:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143850.212443:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b6faf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c64 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.212455:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b6faf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c64 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.212480:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:1.0:1746143850.212516:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625310720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7023us (7052us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143850.212523:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17302 00000100:00100000:3.0:1746143850.212582:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627594624:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.212601:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73b6fa1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c5d expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.212616:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75a00/0x87925e4cb73b6fa1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c5d expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.212626:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75a00, rc 0) 00000100:00100000:3.0:1746143850.212660:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625310592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7592us (7619us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.212665:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17300 00000100:00100000:2.0:1746143850.212988:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625309952:12345-192.168.202.3@tcp:4:cat.0 Request processed in 13422us (13590us total) trans 17179874111 rc 0/0 00000100:00100000:2.0:1746143850.212995:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2773 00002000:00100000:2.0:1746143850.213003:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3477503) req@ffff880093634a80 x1830963625309952/t17179874111(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.213011:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093634a80 with x1830963625309952 ext(3145728->3477503) 00010000:00010000:2.0:1746143850.213018:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 14 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.213029:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 14 pid: 13430 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.213035:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093634a80 00000100:00100000:0.0:1746143850.218581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.218650:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625310976 00000100:00100000:3.0:1746143850.218658:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625310976 00000100:00100000:3.0:1746143850.218713:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17303 00000100:00100000:3.0:1746143850.218721:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3148:x1830963625310976:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.218736:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.218750:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c6b expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.218777:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.218779:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.218783:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.218797:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.218806:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eca00, rc 0) 00000100:00100000:3.0:1746143850.218843:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3148:x1830963625310976:12345-192.168.202.3@tcp:101:cat.0 Request processed in 124us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.218851:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17303 00000100:00100000:0.0:1746143850.221866:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.221932:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625311232 00000100:00100000:1.0:1746143850.221939:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625311232 00000100:00100000:1.0:1746143850.221984:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14149 00000100:00100000:1.0:1746143850.221991:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3156:x1830963625311232:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143850.222008:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.222025:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b6fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c72 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.222105:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.222118:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.222130:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.222155:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.222164:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 10 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.222174:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627594880:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.223786:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.228656:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.228832:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625311360 00000100:00100000:2.0:1746143850.228839:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625311360 00010000:00010000:2.0:1746143850.228868:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.228906:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8494 00000100:00100000:2.0:1746143850.228936:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625311360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.228948:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.228953:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.228963:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.228983:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143850.228987:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.228995:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.229001:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.229016:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.229048:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625311360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 135us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.229055:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8494 00010000:00010000:1.0:1746143850.229387:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa17600/0x87925e4cb73b6f4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c1e expref: 10 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.229598:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627594880:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143850.229619:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.229625:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.229629:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143850.229644:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143850.229742:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c4abc00/0x87925e4cb73b6fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.229753:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.229759:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.229761:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746143850.229763:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75a00, rc 0) 00000100:00100000:1.0:1746143850.229791:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3156:x1830963625311232:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7800us (7930us total) trans 8589945258 rc 0/0 00000100:00100000:1.0:1746143850.229796:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14149 00000100:00100000:0.0:1746143850.230320:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.230336:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625311488 00000100:00100000:0.0:1746143850.230339:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625311488 00010000:00010000:0.0:1746143850.230355:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 15 pid: 13430 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.230887:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8495 00000100:00100000:0.0:1746143850.230894:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2011:x1830963625311488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143850.230903:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143850.231121:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 15 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.231131:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 15 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.231144:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b26200/0x87925e4cb73b6eac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bca expref: 15 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.231157:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.231159:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.231164:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 29 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.231171:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 29 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.231178:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.231179:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.231181:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.231188:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.231211:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.231221:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093637b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627595008:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143850.231285:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 29 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.231292:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093635c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627595136:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143850.231307:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.236512:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.236749:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093637b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627595008:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143850.236760:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093635c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627595136:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143850.236782:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.236824:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625311488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5929us (6502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.236834:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8495 00000100:00100000:1.0:1746143850.236979:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625311616 00000100:00100000:1.0:1746143850.236985:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625311616 00000100:00100000:1.0:1746143850.237014:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14150 00000100:00100000:1.0:1746143850.237019:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3156:x1830963625311616:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143850.237036:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.237050:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b6fd2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c79 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.237111:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.237122:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.237128:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.237148:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.237156:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.237170:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627595264:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.237642:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.238893:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.238973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.239044:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312128 00000100:00100000:2.0:1746143850.239056:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312128 00002000:00100000:2.0:1746143850.239106:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093635c00 x1830963625312128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.239115:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093635c00 with x1830963625312128 ext(2097152->3145727) 00002000:00010000:2.0:1746143850.239120:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093635c00 00000100:00100000:2.0:1746143850.239150:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312000 00000100:00100000:2.0:1746143850.239153:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312000 00002000:00100000:2.0:1746143850.239165:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093637b80 x1830963625312000/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.239172:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093637b80 with x1830963625312000 ext(3145728->4194303) 00002000:00010000:2.0:1746143850.239175:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093637b80 00000100:00100000:2.0:1746143850.239195:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7579 00000100:00100000:2.0:1746143850.239201:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625312128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143850.239939:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7580 00000100:00100000:1.0:1746143850.239946:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625312000:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143850.241440:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.242448:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312256 00000100:00100000:2.0:1746143850.242455:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312256 00010000:00010000:2.0:1746143850.242482:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 12 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.242516:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8496 00000100:00100000:2.0:1746143850.242523:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625312256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.242533:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.242538:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 12 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.242548:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 12 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.242567:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143850.242571:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.242579:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.242585:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.242599:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.242627:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625312256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.242634:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8496 00010000:00010000:1.0:1746143850.243761:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fc4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c72 expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.243789:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627595264:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143850.243806:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.243812:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.243816:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143850.243896:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:1.0:1746143850.243900:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746143850.243935:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.243961:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b6fd2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.243972:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.243982:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.243984:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143850.243986:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75400, rc 0) 00000100:00100000:1.0:1746143850.244015:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3156:x1830963625311616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 6996us (7510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.244021:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14150 00000100:00100000:2.0:1746143850.252976:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625312128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13767us (14077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143850.252986:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7579 00002000:00100000:2.0:1746143850.252996:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093635c00 x1830963625312128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.253003:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093635c00 with x1830963625312128 ext(2097152->3145727) 00002000:00010000:2.0:1746143850.253008:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093635c00 00000100:00100000:2.0:1746143850.253513:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625312000:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13567us (14540us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143850.253520:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7580 00002000:00100000:2.0:1746143850.253526:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880093637b80 x1830963625312000/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.253533:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093637b80 with x1830963625312000 ext(3145728->4194303) 00002000:00010000:2.0:1746143850.253536:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093637b80 00000100:00100000:0.0:1746143850.255275:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.255278:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.255309:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.255461:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312512 00000100:00100000:1.0:1746143850.255468:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312512 00000100:00100000:1.0:1746143850.255502:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14151 00000100:00100000:1.0:1746143850.255508:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3158:x1830963625312512:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143850.255527:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.255547:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b6fe0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c80 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.255605:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255615:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255624:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255634:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255638:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255643:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255763:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255771:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255777:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746143850.255784:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:1.0:1746143850.255856:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255862:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255867:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255872:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255877:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143850.255880:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255886:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255894:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:1.0:1746143850.255896:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143850.255900:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255908:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75a00/0x87925e4cb73b6fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255942:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255947:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255951:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255955:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d75e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143850.255957:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255961:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255966:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009737da00) 00010000:00010000:1.0:1746143850.255968:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143850.255970:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.255974:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75e00/0x87925e4cb73b6fee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746143850.256000:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75800/0x87925e4cb73b6fe0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.256008:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.256018:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.256019:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746143850.256021:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74600, rc 0) 00000100:00100000:1.0:1746143850.256049:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3158:x1830963625312512:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 541us (779us total) trans 8589945259 rc 0/0 00000100:00100000:1.0:1746143850.256054:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14151 00000100:00100000:3.0:1746143850.257240:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312640 00000100:00100000:0.0:1746143850.257240:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312768 00000100:00100000:3.0:1746143850.257246:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312640 00000100:00100000:0.0:1746143850.257246:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312768 00000100:00100000:3.0:1746143850.257552:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17304 00000100:00100000:3.0:1746143850.257560:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625312640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143850.257572:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.257586:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c87 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.257605:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.257607:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.257613:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.257625:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.257633:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095db2200, rc 0) 00000100:00100000:3.0:1746143850.257663:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625312640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 104us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.257668:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17304 00000100:00100000:3.0:1746143850.257680:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17305 00000100:00100000:3.0:1746143850.257684:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625312768:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143850.257691:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.257699:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73b700a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c8e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.257751:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627595392:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.257792:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.258280:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.259062:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625312896 00000100:00100000:0.0:1746143850.259066:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625312896 00000100:00100000:0.0:1746143850.259096:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17306 00000100:00100000:0.0:1746143850.259101:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+30:3153:x1830963625312896:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143850.259111:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.259119:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c95 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.259134:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.259140:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143850.259141:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143850.259144:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.259164:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 11 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.259173:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 11 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.259181:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093635f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627595520:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143850.259237:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.260124:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627595392:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.260143:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73b700a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c8e expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.260152:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800972eda00/0x87925e4cb73b700a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c8e expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.260174:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800972eda00, rc 0) 00000100:00100000:3.0:1746143850.260693:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625312768:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3007us (5413us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.260700:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17305 00000100:00100000:2.0:1746143850.261014:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093635f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627595520:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.261035:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 31 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.261045:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e32c00, rc 0) 00000100:00100000:2.0:1746143850.261066:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:3153:x1830963625312896:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1965us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.261071:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17306 00000100:00100000:0.0:1746143850.262387:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.262441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.262560:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625313152 00000100:00100000:2.0:1746143850.262569:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625313152 00000100:00100000:3.0:1746143850.262589:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625313280 00000100:00100000:3.0:1746143850.262596:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625313280 00002000:00100000:2.0:1746143850.262619:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093637480 x1830963625313152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.262624:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (3096576->3145727) req@ffff880093637800 x1830963625313280/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.262630:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093637480 with x1830963625313152 ext(4194304->4853759) 00002000:00100000:3.0:1746143850.262634:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093637800 with x1830963625313280 ext(3096576->3145727) 00002000:00010000:2.0:1746143850.262637:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093637480 00010000:00010000:3.0:1746143850.262643:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 12 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.262658:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7581 00010000:00010000:3.0:1746143850.262659:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 12 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.262666:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625313152:12345-192.168.202.3@tcp:3:cat.0 00002000:00010000:3.0:1746143850.262670:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093637800 00000100:00100000:3.0:1746143850.262710:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2774 00000100:00100000:3.0:1746143850.262719:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+12:2011:x1830963625313280:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143850.271105:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625313152:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8433us (8718us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143850.271116:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7581 00002000:00100000:2.0:1746143850.271126:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093637480 x1830963625313152/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.271134:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093637480 with x1830963625313152 ext(4194304->4853759) 00002000:00010000:2.0:1746143850.271139:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093637480 00000100:00100000:0.0:1746143850.271688:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.272430:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625313536 00000100:00100000:2.0:1746143850.272437:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625313536 00000100:00100000:2.0:1746143850.272482:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14152 00000100:00100000:2.0:1746143850.272489:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3156:x1830963625313536:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143850.272504:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.272518:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55bc00/0x87925e4cb73b7018 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412c9c expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.272591:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272607:0:10936:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272616:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272626:0:10936:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272631:0:10936:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272635:0:10936:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272640:0:10936:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55a400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143850.272644:0:10936:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272650:0:10936:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272658:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143850.272660:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746143850.272663:0:10936:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272667:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a400/0x87925e4cb73b701f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10936 initiator: MDT0 00010000:00010000:2.0:1746143850.272691:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55bc00/0x87925e4cb73b7018 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c9c expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.272702:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55bc00/0x87925e4cb73b7018 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c9c expref: 11 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.272708:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55bc00, rc 0) 00000100:00100000:2.0:1746143850.272730:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3156:x1830963625313536:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 242us (1043us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.272736:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14152 00000100:00100000:3.0:1746143850.273966:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625313280:12345-192.168.202.3@tcp:4:cat.0 Request processed in 11240us (11516us total) trans 21474841371 rc 0/0 00000100:00100000:3.0:1746143850.273975:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2774 00002000:00100000:3.0:1746143850.273984:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (3096576->3145727) req@ffff880093637800 x1830963625313280/t21474841371(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.273992:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093637800 with x1830963625313280 ext(3096576->3145727) 00010000:00010000:3.0:1746143850.273999:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.274016:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:3.0:1746143850.274023:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093637800 00000100:00100000:0.0:1746143850.275820:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.276383:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625313792 00000100:00100000:3.0:1746143850.276391:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625313792 00000100:00100000:3.0:1746143850.276442:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5526 00000100:00100000:3.0:1746143850.276449:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3156:x1830963625313792:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143850.276615:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3156:x1830963625313792:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 165us (799us total) trans 8589945260 rc 0/0 00000100:00100000:3.0:1746143850.276622:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5526 00000100:00100000:0.0:1746143850.283835:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.283979:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625313920 00000100:00100000:3.0:1746143850.283992:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625313920 00010000:00010000:3.0:1746143850.284040:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.284079:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8497 00000100:00100000:3.0:1746143850.284089:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625313920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.284107:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.284134:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.284148:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.284174:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096010200/0x87925e4cb73b6e9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3096576->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bbc expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.284192:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.284194:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.284203:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.284212:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.284265:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 30 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.284286:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627595648:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.284407:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.285105:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.285248:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625314048 00000100:00100000:3.0:1746143850.285262:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625314048 00000100:00100000:3.0:1746143850.285292:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17307 00000100:00100000:3.0:1746143850.285299:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625314048:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.285313:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.285325:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ca3 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.285343:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.285345:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.285351:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.285365:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 15 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.285375:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2600, rc 0) 00000100:00100000:3.0:1746143850.285413:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625314048:12345-192.168.202.3@tcp:101:cat.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.285420:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17307 00000100:00100000:0.0:1746143850.291765:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.292529:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627595648:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.293440:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.294229:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625313920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10136us (10399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.294242:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8497 00000100:00100000:2.0:1746143850.294338:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625314304 00000100:00100000:2.0:1746143850.294347:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625314304 00000100:00100000:2.0:1746143850.294394:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5527 00000100:00100000:2.0:1746143850.294400:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+27:3148:x1830963625314304:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143850.294592:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3148:x1830963625314304:12345-192.168.202.3@tcp:35:cat.0 Request processed in 191us (2836us total) trans 8589945261 rc 0/0 00000100:00100000:2.0:1746143850.294597:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5527 00000100:00100000:0.0:1746143850.296626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.296673:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.296691:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625314688 00000100:00100000:3.0:1746143850.296699:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625314688 00002000:00100000:3.0:1746143850.296741:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800961ece00 x1830963625314688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.296749:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ece00 with x1830963625314688 ext(2097152->4194303) 00002000:00010000:3.0:1746143850.296755:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961ece00 00000100:00100000:2.0:1746143850.296757:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625314816 00000100:00100000:2.0:1746143850.296762:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625314816 00000100:00100000:3.0:1746143850.296773:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7582 00000100:00100000:3.0:1746143850.296780:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625314688:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143850.296782:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800961ed180 x1830963625314816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.296789:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ed180 with x1830963625314816 ext(3145728->4194303) 00002000:00010000:2.0:1746143850.296793:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ed180 00000100:00100000:2.0:1746143850.296822:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7583 00000100:00100000:2.0:1746143850.296828:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625314816:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.324208:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625314816:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27368us (27522us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143850.324223:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7583 00002000:00100000:2.0:1746143850.324236:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800961ed180 x1830963625314816/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.324244:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ed180 with x1830963625314816 ext(3145728->4194303) 00002000:00010000:2.0:1746143850.324249:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ed180 00000100:00100000:3.0:1746143850.329627:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625314688:12345-192.168.202.3@tcp:3:cat.0 Request processed in 32837us (32997us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143850.329639:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7582 00002000:00100000:3.0:1746143850.329651:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800961ece00 x1830963625314688/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.329661:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ece00 with x1830963625314688 ext(2097152->4194303) 00002000:00010000:3.0:1746143850.329668:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961ece00 00000100:00100000:0.0:1746143850.341142:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.341208:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625315072 00000100:00100000:3.0:1746143850.341220:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625315072 00002000:00100000:3.0:1746143850.341279:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800961ed500 x1830963625315072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.341290:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ed500 with x1830963625315072 ext(4194304->4853759) 00002000:00010000:3.0:1746143850.341295:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ed500 00000100:00100000:3.0:1746143850.342092:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7584 00000100:00100000:3.0:1746143850.342101:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625315072:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143850.350759:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2011:x1830963625315072:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8645us (9611us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143850.350771:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7584 00002000:00100000:3.0:1746143850.350784:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800961ed500 x1830963625315072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.350795:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ed500 with x1830963625315072 ext(4194304->4853759) 00002000:00010000:3.0:1746143850.350801:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ed500 00000100:00100000:0.0:1746143850.359244:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.359330:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625315328 00000100:00100000:2.0:1746143850.359341:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625315328 00000100:00100000:2.0:1746143850.359404:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17308 00000100:00100000:2.0:1746143850.359413:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:3155:x1830963625315328:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143850.359435:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.359454:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412caa expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.359485:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.359494:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.359501:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.359507:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.359509:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.359512:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3022848->3145727] (req 3022848->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.359549:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.359562:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 13 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.359574:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627595776:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.359681:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.359689:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 9 pid: 9585 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143850.359697:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627595904:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.359725:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.359732:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.360498:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596032:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.360734:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.364250:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.364874:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625315456 00000100:00100000:2.0:1746143850.364885:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625315456 00000100:00100000:2.0:1746143850.364972:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5528 00000100:00100000:2.0:1746143850.364980:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+280:3153:x1830963625315456:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143850.365643:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.365675:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093415c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627595776:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.365684:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.365687:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627595904:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.365696:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596032:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.365712:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625315584 00000100:00100000:1.0:1746143850.365718:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625315584 00010000:00010000:3.0:1746143850.365729:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3022848->3145727] (req 3022848->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.365746:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a200, rc 0) 00010000:00010000:1.0:1746143850.365750:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 10 pid: 9585 timeout: 1009 lvb_type: 1 00000100:00100000:1.0:1746143850.365781:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625315712 00000100:00100000:1.0:1746143850.365784:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625315712 00000100:00100000:3.0:1746143850.365789:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:3155:x1830963625315328:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6377us (6557us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143850.365792:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.365796:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17308 00000100:00100000:1.0:1746143850.365807:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8498 00000100:00100000:1.0:1746143850.365813:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625315584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.365823:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143850.365829:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8499 00000100:00100000:3.0:1746143850.365835:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625315712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.365840:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 10 pid: 9585 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143850.365844:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.365851:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 10 pid: 9585 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143850.365858:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+281:3153:x1830963625315456:12345-192.168.202.3@tcp:35:cat.0 Request processed in 879us (1619us total) trans 8589945262 rc 0/0 00010000:00010000:3.0:1746143850.365901:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.365932:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.365932:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095db2200/0x87925e4cb73b7003 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c87 expref: 10 pid: 9585 timeout: 1009 lvb_type: 1 00010000:00010000:3.0:1746143850.365949:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800972eca00/0x87925e4cb73b6fb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c6b expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.365950:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143850.365964:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.365982:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625315584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 168us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.365989:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8498 00000100:00100000:2.0:1746143850.366006:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5528 00000100:00100000:3.0:1746143850.366459:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625315712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 623us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.366466:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8499 00000100:00100000:2.0:1746143850.371877:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.371997:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625315840 00000100:00100000:3.0:1746143850.372007:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625315840 00010000:00010000:3.0:1746143850.372048:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.374436:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8500 00000100:00100000:3.0:1746143850.374454:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625315840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.374476:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.374503:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.374520:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.374546:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3b200/0x87925e4cb73b6f85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c3a expref: 31 pid: 13430 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.374577:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.374580:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.374588:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.374596:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.374632:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.374649:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627596160:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.374754:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.380601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.381379:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627596160:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.381402:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.381460:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625315840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7014us (9594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.381471:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8500 00000100:00100000:2.0:1746143850.381663:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625316096 00000100:00100000:2.0:1746143850.381671:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625316096 00002000:00100000:2.0:1746143850.381712:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3022848->3026943) req@ffff8800961edc00 x1830963625316096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.381723:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961edc00 with x1830963625316096 ext(3022848->3026943) 00002000:00010000:2.0:1746143850.381727:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961edc00 00000100:00100000:2.0:1746143850.381756:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7585 00000100:00100000:2.0:1746143850.381762:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625316096:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.381903:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625316096:12345-192.168.202.3@tcp:3:cat.0 Request processed in 141us (1313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143850.381909:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7585 00002000:00100000:2.0:1746143850.382078:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3022848->3026943) req@ffff8800961edc00 x1830963625316096/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.382085:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961edc00 with x1830963625316096 ext(3022848->3026943) 00002000:00010000:2.0:1746143850.382088:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961edc00 00000100:00100000:0.0:1746143850.384215:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.384351:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625316224 00000100:00100000:3.0:1746143850.384360:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625316224 00000100:00100000:3.0:1746143850.384445:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17309 00000100:00100000:3.0:1746143850.384454:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:3155:x1830963625316224:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143850.384470:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.384487:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cb1 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.384521:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.384529:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.384535:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.384537:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.384541:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->2711551] (req 2097152->2711551) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.384571:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 13 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.384582:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 13 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143850.384594:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627596288:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.384829:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.384837:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.384846:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627596416:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.384969:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.388469:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.388554:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627596288:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.388565:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627596416:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.388599:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->2711551] (req 2097152->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 32 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.388617:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d2000, rc 0) 00000100:00100000:3.0:1746143850.388675:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:3155:x1830963625316224:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4222us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.388685:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17309 00000100:00100000:2.0:1746143850.388745:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625316352 00000100:00100000:2.0:1746143850.388752:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625316352 00000100:00100000:0.0:1746143850.388823:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.388873:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625316480 00000100:00100000:1.0:1746143850.388876:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625316480 00010000:00010000:1.0:1746143850.388890:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.388940:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8501 00000100:00100000:1.0:1746143850.388949:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625316480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.388963:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.388987:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.388997:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.389023:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e32c00/0x87925e4cb73b7011 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c95 expref: 32 pid: 12327 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.389068:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.389097:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625316480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 148us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.389103:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8501 00010000:00010000:2.0:1746143850.389267:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 14 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:2.0:1746143850.389290:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8502 00000100:00100000:2.0:1746143850.389296:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625316352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.389304:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.389312:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 14 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143850.389321:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 14 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143850.389333:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2600/0x87925e4cb73b7026 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ca3 expref: 14 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143850.389355:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.389357:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.389365:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.389373:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.389409:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.389419:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627596544:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143850.389484:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.392847:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:16784:1830963627596544:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143850.392877:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.393008:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625316352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3707us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.393020:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8502 00000100:00100000:0.0:1746143850.399074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.399964:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625316736 00000100:00100000:2.0:1746143850.399978:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625316736 00002000:00100000:2.0:1746143850.400045:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2707456->2711551) req@ffff8800961eea00 x1830963625316736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.400056:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961eea00 with x1830963625316736 ext(2707456->2711551) 00002000:00010000:2.0:1746143850.400062:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961eea00 00000100:00100000:2.0:1746143850.400093:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7586 00000100:00100000:2.0:1746143850.400103:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625316736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.400311:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625316736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 209us (1251us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143850.400318:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7586 00002000:00100000:2.0:1746143850.400323:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2707456->2711551) req@ffff8800961eea00 x1830963625316736/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.400330:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961eea00 with x1830963625316736 ext(2707456->2711551) 00002000:00010000:2.0:1746143850.400332:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800961eea00 00000100:00100000:0.0:1746143850.404282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.404411:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625316992 00000100:00100000:2.0:1746143850.404421:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625316992 00000100:00100000:2.0:1746143850.404466:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5529 00000100:00100000:2.0:1746143850.404473:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+281:3155:x1830963625316992:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143850.404699:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+282:3155:x1830963625316992:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 225us (426us total) trans 8589945263 rc 0/0 00000100:00100000:2.0:1746143850.404706:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5529 00000100:00100000:0.0:1746143850.476053:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.476170:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625317120 00000100:00100000:3.0:1746143850.476182:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625317120 00000100:00100000:3.0:1746143850.476540:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17310 00000100:00100000:3.0:1746143850.476550:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3158:x1830963625317120:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143850.476569:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.476663:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cb8 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.476701:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.476709:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.476716:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.476726:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.476729:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.476732:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.476765:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 29 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.476776:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 29 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.476788:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596672:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.477506:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.477515:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 8 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143850.477523:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596800:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.477554:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.477560:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.477572:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596928:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.477589:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143850.484703:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.484805:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596672:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.484882:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.484940:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.484976:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625317248 00000100:00100000:1.0:1746143850.484982:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625317248 00010000:00010000:1.0:1746143850.485017:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.485043:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625317376 00000100:00100000:1.0:1746143850.485045:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625317376 00010000:00010000:1.0:1746143850.485054:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 9 pid: 12327 timeout: 1009 lvb_type: 1 00000100:00100000:3.0:1746143850.485115:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596800:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.485123:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627596928:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.485152:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1720320->2097151] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.485167:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b400, rc 0) 00000100:00100000:3.0:1746143850.485215:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3158:x1830963625317120:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 8667us (9175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.485223:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17310 00000100:00100000:1.0:1746143850.486359:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625317504 00000100:00100000:1.0:1746143850.486367:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625317504 00010000:00010000:1.0:1746143850.486387:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.486780:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8503 00000100:00100000:2.0:1746143850.486794:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625317248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.486810:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.486834:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.486845:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.486873:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8b400/0x87925e4cb73b6f31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c17 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.486892:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.486938:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+29:2008:x1830963625317248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 149us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.486944:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8503 00000100:00100000:2.0:1746143850.486988:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8504 00000100:00100000:2.0:1746143850.486994:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625317376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143850.487011:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8505 00000100:00100000:2.0:1746143850.487015:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625317504:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.487020:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.487028:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.487041:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.487054:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096010600/0x87925e4cb73b6f2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c10 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.487061:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.487075:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625317504:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.487080:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8505 00010000:00010000:2.0:1746143850.487093:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.487101:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 9 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143850.487110:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 9 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143850.487120:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75200/0x87925e4cb73b6fa8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c56 expref: 9 pid: 12327 timeout: 1009 lvb_type: 1 00010000:00010000:2.0:1746143850.487128:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.487130:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.488464:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.488479:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.488514:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 12 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.488527:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627597056:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143850.488943:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.490968:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627597056:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143850.490989:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.491832:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625317376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4834us (6945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.491844:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8504 00000100:00100000:0.0:1746143850.492405:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.492744:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625317760 00000100:00100000:2.0:1746143850.492752:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625317760 00002000:00100000:2.0:1746143850.492793:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1720320->1724415) req@ffff8800961ef480 x1830963625317760/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.492803:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ef480 with x1830963625317760 ext(1720320->1724415) 00002000:00010000:2.0:1746143850.492809:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ef480 00000100:00100000:2.0:1746143850.492827:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7587 00000100:00100000:2.0:1746143850.492833:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625317760:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143850.492988:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625317760:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 155us (585us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143850.492994:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7587 00002000:00100000:2.0:1746143850.492999:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1720320->1724415) req@ffff8800961ef480 x1830963625317760/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.493012:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ef480 with x1830963625317760 ext(1720320->1724415) 00002000:00010000:2.0:1746143850.493015:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ef480 00000100:00100000:0.0:1746143850.497372:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.497473:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625317888 00000100:00100000:3.0:1746143850.497483:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625317888 00000100:00100000:3.0:1746143850.497528:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17311 00000100:00100000:3.0:1746143850.497535:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3158:x1830963625317888:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143850.497555:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.497574:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cbf expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.497604:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.497616:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.497618:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.497621:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->2760703] (req 2097152->2760703) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.497652:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 28 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.497663:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 28 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.497674:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627597184:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.498678:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.500634:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627597184:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.500665:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->2760703] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.500682:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3200, rc 0) 00000100:00100000:3.0:1746143850.500720:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3158:x1830963625317888:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 3185us (3359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.500728:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17311 00000100:00100000:0.0:1746143850.503678:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.503780:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625318016 00000100:00100000:2.0:1746143850.503790:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625318016 00002000:00100000:2.0:1746143850.503836:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3022848->3145727) req@ffff8800961efb80 x1830963625318016/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.503846:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961efb80 with x1830963625318016 ext(3022848->3145727) 00010000:00010000:2.0:1746143850.503856:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 29 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.503869:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 29 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.503876:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800961efb80 00000100:00100000:2.0:1746143850.503894:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2775 00000100:00100000:2.0:1746143850.503901:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625318016:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143850.507275:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625318016:12345-192.168.202.3@tcp:4:cat.0 Request processed in 3365us (3598us total) trans 17179874112 rc 0/0 00000100:00100000:2.0:1746143850.507287:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2775 00002000:00100000:2.0:1746143850.507298:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3022848->3145727) req@ffff8800961efb80 x1830963625318016/t17179874112(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.507308:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961efb80 with x1830963625318016 ext(3022848->3145727) 00010000:00010000:2.0:1746143850.507318:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.507337:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.507344:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800961efb80 00000100:00100000:0.0:1746143850.509079:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.509175:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625318144 00000100:00100000:2.0:1746143850.509185:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625318144 00010000:00010000:2.0:1746143850.509216:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.509243:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8506 00000100:00100000:2.0:1746143850.509260:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625318144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.509274:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.509292:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.509302:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.509325:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b702d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3022848->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412caa expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.509357:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.509360:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.509368:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.509381:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.509414:0:16784:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.509426:0:16784:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627597312:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143850.510268:0:16784:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.516345:0:16784:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:16784:1830963627597312:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.516371:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.516421:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+30:2008:x1830963625318144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7170us (7348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.516433:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8506 00000100:00100000:0.0:1746143850.516837:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.517038:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625318400 00000100:00100000:2.0:1746143850.517046:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625318400 00002000:00100000:2.0:1746143850.517087:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2756608->2760703) req@ffff8800961ee680 x1830963625318400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.517096:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ee680 with x1830963625318400 ext(2756608->2760703) 00002000:00010000:2.0:1746143850.517101:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ee680 00000100:00100000:2.0:1746143850.517119:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7588 00000100:00100000:2.0:1746143850.517126:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625318400:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143850.517446:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625318400:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 319us (609us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143850.517453:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7588 00002000:00100000:2.0:1746143850.517459:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2756608->2760703) req@ffff8800961ee680 x1830963625318400/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.517466:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ee680 with x1830963625318400 ext(2756608->2760703) 00002000:00010000:2.0:1746143850.517469:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ee680 00000100:00100000:0.0:1746143850.524598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.524721:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625318656 00000100:00100000:2.0:1746143850.524732:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625318656 00000100:00100000:2.0:1746143850.524781:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5530 00000100:00100000:2.0:1746143850.524789:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+28:3158:x1830963625318656:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143850.525059:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3158:x1830963625318656:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 270us (470us total) trans 8589945264 rc 0/0 00000100:00100000:2.0:1746143850.525065:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5530 00000100:00100000:0.0:1746143850.542413:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.543491:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625318912 00000100:00100000:2.0:1746143850.543501:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625318912 00000100:00100000:2.0:1746143850.543558:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14153 00000100:00100000:2.0:1746143850.543566:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+29:3165:x1830963625318912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.543592:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.543615:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091380400/0x87925e4cb73b7049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cc6 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.543738:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.543753:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143850.543765:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746143850.543776:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143850.543876:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091380400/0x87925e4cb73b7049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.545360:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.545373:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143850.545376:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143850.545379:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091381200, rc 0) 00000100:00100000:2.0:1746143850.545446:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+31:3165:x1830963625318912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1880us (3044us total) trans 8589945265 rc 0/0 00000100:00100000:2.0:1746143850.545454:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14153 00000100:00100000:0.0:1746143850.548601:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.549394:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625319040 00000100:00100000:3.0:1746143850.549405:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625319040 00000100:00100000:3.0:1746143850.549451:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17312 00000100:00100000:3.0:1746143850.549458:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625319040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.549474:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.549493:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b705e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ccd expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.549546:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627597440:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.549858:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.551175:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627597440:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.551204:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b705e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ccd expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.551212:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b705e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ccd expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.551229:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3000, rc 0) 00000100:00100000:3.0:1746143850.551275:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625319040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1817us (2682us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.551282:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17312 00000100:00100000:0.0:1746143850.557576:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.557634:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625319296 00000100:00100000:2.0:1746143850.557643:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625319296 00002000:00100000:2.0:1746143850.557695:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1720319) req@ffff8800961eca80 x1830963625319296/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.557705:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961eca80 with x1830963625319296 ext(1048576->1720319) 00002000:00010000:2.0:1746143850.557710:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961eca80 00000100:00100000:2.0:1746143850.557742:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7589 00000100:00100000:2.0:1746143850.557751:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625319296:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.562701:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625319296:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4932us (5118us total) trans 0 rc 671744/671744 00000100:00100000:2.0:1746143850.562714:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7589 00002000:00100000:2.0:1746143850.562727:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1720319) req@ffff8800961eca80 x1830963625319296/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 671744/671744 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.562738:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961eca80 with x1830963625319296 ext(1048576->1720319) 00002000:00010000:2.0:1746143850.562744:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961eca80 00000100:00100000:0.0:1746143850.572611:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.572674:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625319552 00000100:00100000:2.0:1746143850.572684:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625319552 00002000:00100000:2.0:1746143850.572730:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2760704->3145727) req@ffff8800961ec700 x1830963625319552/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.572739:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ec700 with x1830963625319552 ext(2760704->3145727) 00002000:00010000:2.0:1746143850.572744:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ec700 00000100:00100000:2.0:1746143850.572772:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7590 00000100:00100000:2.0:1746143850.572777:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625319552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.577086:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625319552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 4297us (4474us total) trans 0 rc 385024/385024 00000100:00100000:2.0:1746143850.577098:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7590 00002000:00100000:2.0:1746143850.577110:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2760704->3145727) req@ffff8800961ec700 x1830963625319552/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 385024/385024 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.577119:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961ec700 with x1830963625319552 ext(2760704->3145727) 00002000:00010000:2.0:1746143850.577124:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800961ec700 00000100:00100000:0.0:1746143850.580772:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.580877:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625319680 00000100:00100000:3.0:1746143850.580888:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625319680 00000100:00100000:3.0:1746143850.580976:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17313 00000100:00100000:3.0:1746143850.580984:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3165:x1830963625319680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.581005:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.581024:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cd4 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.581054:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.581063:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.581064:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143850.581067:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.581098:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.581110:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 30 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.581121:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627597568:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.581221:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.585848:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627597568:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.585882:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 14 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.585901:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801331d3000, rc 0) 00000100:00100000:0.0:1746143850.589145:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.589368:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625319808 00000100:00100000:2.0:1746143850.589379:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625319808 00002000:00100000:2.0:1746143850.589431:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2711551) req@ffff8800961edf80 x1830963625319808/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.589441:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961edf80 with x1830963625319808 ext(2097152->2711551) 00010000:00010000:2.0:1746143850.589452:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.589469:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 31 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.589476:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800961edf80 00000100:00100000:2.0:1746143850.589508:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2776 00000100:00100000:2.0:1746143850.589515:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625319808:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143850.590174:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3165:x1830963625319680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9187us (9408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.590184:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17313 00000100:00100000:1.0:1746143850.600649:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.600728:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320064 00000100:00100000:3.0:1746143850.600739:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320064 00000100:00100000:3.0:1746143850.600795:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14154 00000100:00100000:3.0:1746143850.600804:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+282:3169:x1830963625320064:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.600830:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.600852:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b706c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cdb expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.600948:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.600961:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.600971:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.600983:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.600988:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.600993:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601088:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601098:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601103:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143850.601111:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143850.601163:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601168:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601173:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601178:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601182:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096f6d600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.601186:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601191:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601200:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143850.601202:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.601206:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601210:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096f6d600/0x87925e4cb73b7073 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601232:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601240:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601245:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601257:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55a200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.601260:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601265:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601270:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8400) 00010000:00010000:3.0:1746143850.601272:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.601275:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601279:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55a200/0x87925e4cb73b707a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143850.601311:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331d2600/0x87925e4cb73b706c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 285 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.601321:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 284 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.601326:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.601328:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143850.601330:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55b600, rc 0) 00000100:00100000:3.0:1746143850.601378:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+284:3169:x1830963625320064:12345-192.168.202.3@tcp:101:cat.0 Request processed in 576us (741us total) trans 8589945266 rc 0/0 00000100:00100000:3.0:1746143850.601385:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14154 00000100:00100000:2.0:1746143850.603881:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625319808:12345-192.168.202.3@tcp:4:cat.0 Request processed in 14356us (18199us total) trans 21474841372 rc 0/0 00000100:00100000:2.0:1746143850.603895:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2776 00002000:00100000:2.0:1746143850.603906:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2711551) req@ffff8800961edf80 x1830963625319808/t21474841372(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.603929:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800961edf80 with x1830963625319808 ext(2097152->2711551) 00010000:00010000:2.0:1746143850.603938:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 33 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.603951:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 33 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.603957:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800961edf80 00000100:00100000:0.0:1746143850.605470:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.605504:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.605542:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.605618:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320192 00000100:00100000:3.0:1746143850.605620:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320320 00000100:00100000:3.0:1746143850.605627:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320320 00000100:00100000:1.0:1746143850.605627:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320192 00000100:00100000:3.0:1746143850.605667:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17314 00000100:00100000:1.0:1746143850.605670:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320448 00000100:00100000:1.0:1746143850.605671:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320448 00000100:00100000:3.0:1746143850.605675:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625320320:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143850.605685:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17315 00000100:00100000:1.0:1746143850.605688:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625320192:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.605693:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.605693:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.605707:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55be00/0x87925e4cb73b708f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ce9 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.605707:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b7096 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ce2 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.605756:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627597824:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143850.605756:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627597696:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.605820:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143850.605857:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9600 going to sleep for 11 seconds 00000100:00100000:1.0:1746143850.605881:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17316 00000100:00100000:1.0:1746143850.605886:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625320448:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143850.605894:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.605902:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b709d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cf0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143850.605948:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627597952:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143850.605982:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9d80 going to sleep for 11 seconds 00002000:00010000:3.0:1746143850.609867:0:9585:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143850 -> 1746143851 00000100:00100000:3.0:1746143850.609899:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627597824:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.609962:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55be00/0x87925e4cb73b708f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ce9 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.609977:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55be00/0x87925e4cb73b708f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ce9 expref: 33 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.609987:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55be00, rc 0) 00000100:00100000:3.0:1746143850.610049:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625320320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4374us (4543us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.610058:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17314 00002000:00010000:1.0:1746143850.611170:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143850 -> 1746143851 00000100:00100000:1.0:1746143850.611185:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627597696:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143850.611209:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b7096 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ce2 expref: 32 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.611219:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136800/0x87925e4cb73b7096 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ce2 expref: 32 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.611238:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136800, rc 0) 00000100:00100000:1.0:1746143850.611274:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625320192:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5583us (5807us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143850.611280:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17315 00000100:00100000:0.0:1746143850.612686:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143850.612758:0:1947:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.3@tcp) returned -22 from glimpse AST (req@ffff880136637800 x1830963627597952) - normal race ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 34 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.612784:0:1947:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 34 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.612804:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d2000/0x87925e4cb73b7034 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2711551) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb1 expref: 34 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.612814:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627597952:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143850.612832:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.612834:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.612841:0:1947:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.612849:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.612879:0:1947:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143850.612892:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627598080:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143850.612985:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.613325:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320576 00000100:00100000:3.0:1746143850.613331:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320576 00000100:00100000:3.0:1746143850.613370:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1027 00000100:00100000:3.0:1746143850.613376:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625320576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.613385:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.613387:0:16784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 87925e4cb73b7034) 00010000:00010000:3.0:1746143850.613389:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.613416:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625320576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 40us (735us total) trans 0 rc 116/116 00000100:00100000:3.0:1746143850.613421:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1027 00000100:00100000:1.0:1746143850.615320:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627598080:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143850.615356:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b709d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cf0 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.615375:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b709d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cf0 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.615385:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136600, rc 0) 00000100:00100000:1.0:1746143850.615424:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625320448:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9535us (9879us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143850.615432:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17316 00000100:00100000:0.0:1746143850.621430:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.622678:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320704 00000100:00100000:1.0:1746143850.622690:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320704 00000100:00100000:1.0:1746143850.622750:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17317 00000100:00100000:1.0:1746143850.622759:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625320704:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143850.622775:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.622793:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b70a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cf7 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143850.622850:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627598208:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143850.622959:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.624516:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.624738:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320832 00000100:00100000:3.0:1746143850.624745:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320832 00000100:00100000:3.0:1746143850.624778:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17318 00000100:00100000:3.0:1746143850.624784:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625320832:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.624795:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.624808:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b70ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412cfe expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.624850:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627598336:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.624908:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.625575:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.625669:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625320960 00000100:00100000:1.0:1746143850.625673:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625320960 00000100:00100000:1.0:1746143850.625706:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17319 00000100:00100000:1.0:1746143850.625713:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625320960:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143850.625722:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.625734:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d05 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.625752:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.625753:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.625762:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 33 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.625778:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 33 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.625788:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137a00, rc 0) 00000100:00100000:1.0:1746143850.625815:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625320960:12345-192.168.202.3@tcp:101:cat.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.625822:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17319 00000100:00100000:1.0:1746143850.629305:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627598208:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143850.629349:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b70a4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cf7 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.629362:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136400/0x87925e4cb73b70a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cf7 expref: 33 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.629391:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00000100:00100000:1.0:1746143850.629455:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625320704:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6696us (8035us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143850.629463:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17317 00000100:00100000:0.0:1746143850.630545:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.630579:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.630640:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627598336:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.630661:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b70ab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cfe expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.630669:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b70ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cfe expref: 31 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.631401:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:2.0:1746143850.631449:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:2010:x1830963625320832:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6664us (6936us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.631460:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17318 00000100:00100000:2.0:1746143850.631640:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625321216 00000100:00100000:2.0:1746143850.631647:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625321216 00002000:00100000:2.0:1746143850.631686:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092ef3b80 x1830963625321216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.631695:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3b80 with x1830963625321216 ext(2097152->4194303) 00002000:00010000:2.0:1746143850.631700:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef3b80 00000100:00100000:2.0:1746143850.631714:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625321472 00000100:00100000:2.0:1746143850.631716:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625321472 00002000:00100000:2.0:1746143850.631729:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092ef0380 x1830963625321472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.631735:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963625321472 ext(3145728->4194303) 00002000:00010000:2.0:1746143850.631737:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0380 00000100:00100000:2.0:1746143850.631747:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7591 00000100:00100000:2.0:1746143850.631753:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625321216:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143850.632741:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7592 00000100:00100000:3.0:1746143850.632751:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625321472:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.644379:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.644418:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.644452:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625321856 00000100:00100000:2.0:1746143850.644463:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625321856 00000100:00100000:2.0:1746143850.644516:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17320 00000100:00100000:2.0:1746143850.644524:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+30:3169:x1830963625321856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.644547:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.644566:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d13 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.644602:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.644610:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143850.644611:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143850.644614:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.644648:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.644660:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 15 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:2.0:1746143850.644673:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627598464:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.644746:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.645536:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625321728 00000100:00100000:0.0:1746143850.645541:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625321728 00000100:00100000:0.0:1746143850.645574:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14155 00000100:00100000:0.0:1746143850.645580:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+284:3171:x1830963625321728:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143850.645594:0:10936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.645610:0:10936:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b70c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d0c expref: -99 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645712:0:10936:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143850.645726:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645733:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645738:0:10936:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 285 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645744:0:10936:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143850.645763:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 285 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645776:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 285 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.645784:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627598592:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143850.645831:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645838:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 30 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.645849:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627598720:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143850.645869:0:10936:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.645875:0:10936:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 10 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.645881:0:10936:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627598848:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143850.645893:0:10936:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.649092:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625321472:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16329us (18497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143850.649106:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7592 00002000:00100000:3.0:1746143850.649119:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092ef0380 x1830963625321472/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.649136:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef0380 with x1830963625321472 ext(3145728->4194303) 00002000:00010000:3.0:1746143850.649141:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ef0380 00000100:00100000:2.0:1746143850.656285:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627598464:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.656322:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 31 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.656343:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091380200, rc 0) 00000100:00100000:2.0:1746143850.656397:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:3169:x1830963625321856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11872us (11976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.656406:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17320 00000100:00100000:0.0:1746143850.659722:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.659784:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627598592:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.659795:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627598720:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.661152:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625321216:12345-192.168.202.3@tcp:3:cat.0 Request processed in 29393us (30603us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143850.661166:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7591 00002000:00100000:2.0:1746143850.661178:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092ef3b80 x1830963625321216/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.661187:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ef3b80 with x1830963625321216 ext(2097152->4194303) 00002000:00010000:2.0:1746143850.661193:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ef3b80 00000100:00100000:2.0:1746143850.661221:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625321984 00000100:00100000:2.0:1746143850.661228:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625321984 00002000:00100000:2.0:1746143850.661268:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1720320->2097151) req@ffff880095e33100 x1830963625321984/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746143850.661426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.661443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.661491:0:10936:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10936:1830963627598848:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143850.661520:0:10936:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143850.661588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.661606:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625322112 00000100:00100000:1.0:1746143850.661609:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625322112 00010000:00010000:1.0:1746143850.661628:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 286 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.661658:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625322240 00000100:00100000:1.0:1746143850.661660:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625322240 00010000:00010000:1.0:1746143850.661671:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 31 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.661683:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625322368 00000100:00100000:1.0:1746143850.661685:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625322368 00010000:00010000:1.0:1746143850.661692:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00000100:00100000:1.0:1746143850.661706:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8507 00000100:00100000:1.0:1746143850.661712:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:2009:x1830963625322112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.661726:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.661732:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 286 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661741:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 286 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661761:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e55b600/0x87925e4cb73b7081 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cdb expref: 286 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661777:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.661781:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661790:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661794:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.661811:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+285:2009:x1830963625322112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 100us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.661817:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8507 00000100:00100000:1.0:1746143850.661826:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8508 00000100:00100000:1.0:1746143850.661830:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625322240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.661837:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.661840:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 31 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661852:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 31 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661861:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74600/0x87925e4cb73b6ff5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c80 expref: 31 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661869:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.661872:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661877:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661880:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.661890:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+30:2008:x1830963625322240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.661894:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8508 00000100:00100000:1.0:1746143850.661901:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8509 00000100:00100000:1.0:1746143850.661904:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625322368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.661909:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.661928:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661934:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661944:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d75400/0x87925e4cb73b6fd9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c79 expref: 11 pid: 7243 timeout: 1009 lvb_type: 0 00010000:00010000:1.0:1746143850.661950:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143850.661952:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661958:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661964:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 10936 initiator: MDT0 00010000:00010000:1.0:1746143850.661982:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143850.661987:0:10936:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00010000:00010000:0.0:1746143850.661995:0:10936:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10936 initiator: MDT0 00000100:00100000:1.0:1746143850.661996:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625322368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 91us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.662000:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8509 00000004:00200000:0.0:1746143850.662013:0:10936:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00002000:00100000:2.0:1746143850.662616:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33100 with x1830963625321984 ext(1720320->2097151) 00010000:00010000:2.0:1746143850.662625:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.662636:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 14 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.662642:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095e33100 00000100:00100000:2.0:1746143850.662671:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2777 00000100:00100000:2.0:1746143850.662678:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625321984:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:0.0:1746143850.662936:0:10936:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d428000/0x87925e4cb73b70c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 286 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.662954:0:10936:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 285 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.662960:0:10936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143850.662963:0:10936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746143850.662965:0:10936:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d429a00, rc 0) 00000100:00100000:0.0:1746143850.662987:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7448e42d-373a-41e0-9678-9a18291c6700+285:3171:x1830963625321728:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 17406us (18621us total) trans 8589945267 rc 0/0 00000100:00100000:0.0:1746143850.662993:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14155 00000100:00100000:2.0:1746143850.672648:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625321984:12345-192.168.202.3@tcp:4:cat.0 Request processed in 9963us (12928us total) trans 17179874113 rc 0/0 00000100:00100000:2.0:1746143850.672658:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2777 00002000:00100000:2.0:1746143850.672669:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1720320->2097151) req@ffff880095e33100 x1830963625321984/t17179874113(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.672683:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095e33100 with x1830963625321984 ext(1720320->2097151) 00010000:00010000:2.0:1746143850.672691:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.674538:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.674550:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095e33100 00000100:00100000:0.0:1746143850.675130:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.676856:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625322496 00000100:00100000:2.0:1746143850.676866:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625322496 00000100:00100000:2.0:1746143850.676949:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17321 00000100:00100000:2.0:1746143850.676956:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625322496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.676972:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.676988:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73b70d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d1a expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.677138:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627598976:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143850.677495:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.682580:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627598976:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.682612:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73b70d5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d1a expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.682625:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa17600/0x87925e4cb73b70d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d1a expref: 17 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.682641:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa17600, rc 0) 00000100:00100000:2.0:1746143850.682680:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625322496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5723us (7550us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.682687:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17321 00000100:00100000:0.0:1746143850.683279:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.683334:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625322624 00000100:00100000:3.0:1746143850.683345:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625322624 00010000:00010000:3.0:1746143850.683381:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.683420:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8510 00000100:00100000:3.0:1746143850.683427:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625322624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.683441:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.683456:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.683466:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.683485:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55b400/0x87925e4cb73b703b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1720320->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cb8 expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.683507:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.683509:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.683515:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.683523:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.683558:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 30 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.683571:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627599104:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.684015:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.693695:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627599104:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.693721:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.693784:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625322624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10355us (10504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.693794:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8510 00000100:00100000:0.0:1746143850.696711:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.696789:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.696957:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625322880 00000100:00100000:3.0:1746143850.696968:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625322880 00002000:00100000:3.0:1746143850.697020:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093415f80 x1830963625322880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.697030:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963625322880 ext(1048576->2097151) 00002000:00010000:3.0:1746143850.697035:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415f80 00000100:00100000:3.0:1746143850.697055:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625323136 00000100:00100000:3.0:1746143850.697058:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625323136 00002000:00100000:3.0:1746143850.697068:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093416d80 x1830963625323136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.697074:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963625323136 ext(4194304->4853759) 00002000:00010000:3.0:1746143850.697077:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416d80 00000100:00100000:3.0:1746143850.697287:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7593 00000100:00100000:3.0:1746143850.697295:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625322880:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.697314:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7594 00000100:00100000:2.0:1746143850.697328:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625323136:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143850.711106:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143850.711122:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627599232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746143850.711228:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.711371:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627599232 00000100:00100000:2.0:1746143850.711377:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627599232 00000100:00100000:2.0:1746143850.711411:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1746143850.711418:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3772:x1830963627599232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746143850.711463:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1446088704 avail 1316626432 00000100:00100000:2.0:1746143850.711500:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3772:x1830963627599232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.711506:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1746143850.711616:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627599232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746143850.715560:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093415f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625322880:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18254us (18845us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143850.715573:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7593 00002000:00100000:3.0:1746143850.715585:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093415f80 x1830963625322880/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.715594:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093415f80 with x1830963625322880 ext(1048576->2097151) 00002000:00010000:3.0:1746143850.715601:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093415f80 00000100:00100000:2.0:1746143850.717551:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625323136:12345-192.168.202.3@tcp:3:cat.0 Request processed in 20219us (20752us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143850.717562:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7594 00002000:00100000:2.0:1746143850.717573:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880093416d80 x1830963625323136/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.717582:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093416d80 with x1830963625323136 ext(4194304->4853759) 00002000:00010000:2.0:1746143850.717588:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093416d80 00000100:00100000:3.0:1746143850.728088:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.728140:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.728209:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625323264 00000100:00100000:0.0:1746143850.728219:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625323264 00000100:00100000:0.0:1746143850.728280:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625323392 00000100:00100000:0.0:1746143850.728283:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625323392 00000100:00100000:0.0:1746143850.728304:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17322 00000100:00100000:0.0:1746143850.728310:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625323264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143850.728328:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.728345:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d21 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.728369:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.728371:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143850.728380:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 16 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.728396:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 16 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.728407:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512200, rc 0) 00000100:00100000:0.0:1746143850.728454:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625323264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 144us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.728460:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17322 00000100:00100000:0.0:1746143850.728474:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17323 00000100:00100000:0.0:1746143850.728479:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:3169:x1830963625323392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143850.728485:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.728492:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d28 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.728508:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.728515:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143850.728516:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143850.728519:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.728548:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 15 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143850.728560:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 15 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:0.0:1746143850.728572:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e308380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627599360:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143850.728625:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.738116:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e308380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627599360:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.738151:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.738171:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512e00, rc 0) 00000100:00100000:2.0:1746143850.738237:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:3169:x1830963625323392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9756us (10095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.738246:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17323 00000100:00100000:0.0:1746143850.742320:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.742388:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625323520 00000100:00100000:2.0:1746143850.742398:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625323520 00002000:00100000:2.0:1746143850.742446:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2760703) req@ffff88011e309c00 x1830963625323520/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.742457:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309c00 with x1830963625323520 ext(2097152->2760703) 00010000:00010000:2.0:1746143850.742466:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:2.0:1746143850.742479:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 16 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:2.0:1746143850.742486:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e309c00 00000100:00100000:2.0:1746143850.743460:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2778 00000100:00100000:2.0:1746143850.743471:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625323520:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143850.747105:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746143850.747126:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963627599488:0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.747182:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143850.747239:0:8213:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627599488 00000100:00100000:0.0:1746143850.747246:0:8213:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627599488 00000100:00100000:0.0:1746143850.747288:0:8213:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1746143850.747294:0:8213:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a42ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3771:x1830963627599488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.747329:0:8213:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a42ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b99f1f93-ef24-4932-a1b4-452b64359da1+23:3771:x1830963627599488:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.747334:0:8213:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1746143850.747369:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b99f1f93-ef24-4932-a1b4-452b64359da1:3771:1830963627599488:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.747496:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3774:1830963627599744:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.747526:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.747540:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3774:1830963627600256:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.747554:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143850.747586:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627599616:0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.747610:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143850.747624:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3773:1830963627600128:0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.747642:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627599616 00000100:00100000:3.0:1746143850.747645:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627599616 00000100:00100000:3.0:1746143850.747665:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1746143850.747669:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627599616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.747697:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627599616:12345-0@lo:400:kworker.0 Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.747702:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1746143850.748654:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627599872:0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.748689:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143850.748709:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3771:1830963627600384:0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.748738:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627599872 00000100:00100000:0.0:1746143850.748741:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627599872 00000100:00100000:0.0:1746143850.748771:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1746143850.748772:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627600000:0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.748775:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627599872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143850.748799:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143850.748802:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3771:x1830963627599872:12345-0@lo:400:kworker.0 Request processed in 27us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.748807:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1746143850.748813:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600000 00000100:00100000:0.0:1746143850.748815:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600000 00000100:00100000:1.0:1746143850.748816:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963627600512:0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.748829:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1746143850.748832:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627600000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1746143850.748844:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746143850.748848:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143850.748849:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627600000:12345-0@lo:400:kworker.0 Request processed in 17us (50us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.748854:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1746143850.749825:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627600768:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.749853:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.749882:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143850.749929:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600768 00000100:00100000:1.0:1746143850.749933:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600768 00000100:00100000:1.0:1746143850.749968:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1746143850.749974:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963627600768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746143850.750008:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3774:x1830963627600768:12345-0@lo:400:kworker.0 Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.750013:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00080000:1.0:1746143850.750025:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143850.750599:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627600640:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.750617:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.750643:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627599616:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.750666:0:3774:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874102 gen 2 00000004:00080000:2.0:1746143850.750670:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136acad80, transno 17179874016 00000004:00080000:2.0:1746143850.750676:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457d500, transno 17179874017 00000004:00080000:2.0:1746143850.750679:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac9500, transno 17179874018 00000004:00080000:2.0:1746143850.750681:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457c380, transno 17179874019 00000004:00080000:2.0:1746143850.750683:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac9c00, transno 17179874020 00000004:00080000:2.0:1746143850.750686:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457ca80, transno 17179874021 00000004:00080000:2.0:1746143850.750688:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac8700, transno 17179874022 00000004:00080000:2.0:1746143850.750690:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012457ed80, transno 17179874023 00000004:00080000:2.0:1746143850.750692:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88007f64aa00, transno 17179874024 00000004:00080000:2.0:1746143850.750695:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129dc1f80, transno 17179874029 00000004:00080000:2.0:1746143850.750698:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129dc1c00, transno 17179874030 00000004:00080000:2.0:1746143850.750700:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac9880, transno 17179874031 00000004:00080000:2.0:1746143850.750702:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129dc0a80, transno 17179874032 00000004:00080000:2.0:1746143850.750704:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac8000, transno 17179874033 00000004:00080000:2.0:1746143850.750706:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136ac8a80, transno 17179874034 00000004:00080000:2.0:1746143850.750709:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136acb800, transno 17179874035 00000004:00080000:2.0:1746143850.750712:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4e680, transno 17179874036 00000004:00080000:2.0:1746143850.750714:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4dc00, transno 17179874037 00000004:00080000:2.0:1746143850.750716:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a7800, transno 17179874038 00000004:00080000:2.0:1746143850.750719:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009322d180, transno 17179874039 00000004:00080000:2.0:1746143850.750721:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a6680, transno 17179874040 00000004:00080000:2.0:1746143850.750723:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a6d80, transno 17179874041 00000004:00080000:2.0:1746143850.750726:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009322f800, transno 17179874042 00000004:00080000:2.0:1746143850.750728:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009322df80, transno 17179874043 00000004:00080000:2.0:1746143850.750730:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a7100, transno 17179874044 00000004:00080000:2.0:1746143850.750733:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009322ca80, transno 17179874045 00000004:00080000:2.0:1746143850.750735:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800939a5880, transno 17179874046 00000004:00080000:2.0:1746143850.750738:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30700, transno 17179874063 00000004:00080000:2.0:1746143850.750740:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31c00, transno 17179874064 00000004:00080000:2.0:1746143850.750742:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e31880, transno 17179874065 00000004:00080000:2.0:1746143850.750744:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32680, transno 17179874066 00000004:00080000:2.0:1746143850.750747:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32300, transno 17179874067 00000004:00080000:2.0:1746143850.750749:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30380, transno 17179874068 00000004:00080000:2.0:1746143850.750752:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e33800, transno 17179874069 00000004:00080000:2.0:1746143850.750754:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e32a00, transno 17179874070 00000004:00080000:2.0:1746143850.750756:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095e30000, transno 17179874071 00000004:00080000:2.0:1746143850.750758:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b47800, transno 17179874076 00000004:00080000:2.0:1746143850.750760:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45180, transno 17179874077 00000004:00080000:2.0:1746143850.750762:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b46300, transno 17179874078 00000004:00080000:2.0:1746143850.750764:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b46d80, transno 17179874079 00000004:00080000:2.0:1746143850.750767:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b44e00, transno 17179874080 00000004:00080000:2.0:1746143850.750769:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6fb80, transno 17179874081 00000004:00080000:2.0:1746143850.750771:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b45c00, transno 17179874082 00000004:00080000:2.0:1746143850.750774:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b46a00, transno 17179874083 00000004:00080000:2.0:1746143850.750776:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b47480, transno 17179874084 00000004:00080000:2.0:1746143850.750779:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c38e00, transno 17179874085 00000004:00080000:2.0:1746143850.750781:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e79c00, transno 17179874086 00000004:00080000:2.0:1746143850.750783:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c3aa00, transno 17179874087 00000004:00080000:2.0:1746143850.750785:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78700, transno 17179874088 00000004:00080000:2.0:1746143850.750788:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7b800, transno 17179874089 00000004:00080000:2.0:1746143850.750790:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800972eb100, transno 17179874090 00000004:00080000:2.0:1746143850.750793:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e78380, transno 17179874091 00000100:00100000:3.0:1746143850.750795:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627599744 00000004:00080000:2.0:1746143850.750796:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e7aa00, transno 17179874092 00000004:00080000:2.0:1746143850.750799:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d843480, transno 17179874093 00000100:00100000:3.0:1746143850.750800:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627599744 00000004:00080000:2.0:1746143850.750801:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d840380, transno 17179874094 00000004:00080000:2.0:1746143850.750803:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e79f80, transno 17179874095 00000004:00080000:2.0:1746143850.750805:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6ed80, transno 17179874096 00000004:00080000:2.0:1746143850.750808:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136635f80, transno 17179874097 00000004:00080000:2.0:1746143850.750810:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091d4d880, transno 17179874098 00000004:00080000:2.0:1746143850.750813:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d841c00, transno 17179874099 00000004:00080000:2.0:1746143850.750815:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136634a80, transno 17179874100 00000004:00080000:2.0:1746143850.750817:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129e6c700, transno 17179874101 00000004:00080000:2.0:1746143850.750818:0:3774:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136637100, transno 17179874102 00000100:00100000:2.0:1746143850.750822:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627600768:0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.750828:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600256 00000100:00100000:3.0:1746143850.750830:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600256 00000100:00100000:3.0:1746143850.750846:0:10936:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600128 00000100:00100000:3.0:1746143850.750848:0:10936:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600128 00000100:00100000:3.0:1746143850.750862:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1746143850.750868:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830963627599744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.750900:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830963627599744:12345-0@lo:400:kworker.0 Request processed in 34us (3374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.750906:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1746143850.750926:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1746143850.750934:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830963627600256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.750959:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830963627600256:12345-0@lo:400:kworker.0 Request processed in 25us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.750963:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1746143850.750972:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1746143850.750976:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3773:x1830963627600128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.750996:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3773:x1830963627600128:12345-0@lo:400:kworker.0 Request processed in 20us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.751000:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1746143850.751035:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600640 00000100:00100000:3.0:1746143850.751037:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600640 00000100:00100000:3.0:1746143850.751050:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1746143850.751054:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3773:x1830963627600640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.751070:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3773:x1830963627600640:12345-0@lo:400:kworker.0 Request processed in 16us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.751074:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00080000:3.0:1746143850.751082:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143850.751085:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746143850.751087:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1746143850.751134:0:8226:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:2.0:1746143850.751153:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3773:1830963627600128:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.751160:0:3773:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841364 gen 2 00000004:00080000:2.0:1746143850.751162:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb87800, transno 21474841286 00000004:00080000:2.0:1746143850.751167:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb87480, transno 21474841287 00000004:00080000:2.0:1746143850.751169:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb87b80, transno 21474841288 00000004:00080000:2.0:1746143850.751172:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb86680, transno 21474841289 00000004:00080000:2.0:1746143850.751174:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb84a80, transno 21474841290 00000004:00080000:2.0:1746143850.751176:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb84000, transno 21474841291 00000004:00080000:2.0:1746143850.751178:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb86d80, transno 21474841292 00000004:00080000:2.0:1746143850.751179:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb87100, transno 21474841293 00000004:00080000:2.0:1746143850.751181:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368eb100, transno 21474841298 00000004:00080000:2.0:1746143850.751183:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb86300, transno 21474841299 00000004:00080000:2.0:1746143850.751185:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb84380, transno 21474841300 00000004:00080000:2.0:1746143850.751187:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e8000, transno 21474841301 00000004:00080000:2.0:1746143850.751189:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e9c00, transno 21474841302 00000004:00080000:2.0:1746143850.751191:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e8700, transno 21474841303 00000004:00080000:2.0:1746143850.751193:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368eb480, transno 21474841304 00000004:00080000:2.0:1746143850.751196:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009eb86a00, transno 21474841305 00000004:00080000:2.0:1746143850.751198:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368e8a80, transno 21474841306 00000004:00080000:2.0:1746143850.751200:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c68a80, transno 21474841307 00000004:00080000:2.0:1746143850.751202:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368eb800, transno 21474841308 00000004:00080000:2.0:1746143850.751204:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c69500, transno 21474841309 00000004:00080000:2.0:1746143850.751206:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801368ebb80, transno 21474841310 00000004:00080000:2.0:1746143850.751207:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c69c00, transno 21474841311 00000004:00080000:2.0:1746143850.751209:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6a300, transno 21474841312 00000004:00080000:2.0:1746143850.751211:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095c6a680, transno 21474841313 00000004:00080000:2.0:1746143850.751213:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48380, transno 21474841329 00000004:00080000:2.0:1746143850.751215:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49880, transno 21474841330 00000004:00080000:2.0:1746143850.751217:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4aa00, transno 21474841331 00000004:00080000:2.0:1746143850.751219:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b48a80, transno 21474841332 00000004:00080000:2.0:1746143850.751220:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b49f80, transno 21474841333 00000004:00080000:2.0:1746143850.751222:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4b100, transno 21474841334 00000004:00080000:2.0:1746143850.751224:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b4a300, transno 21474841335 00000004:00080000:2.0:1746143850.751227:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1d9500, transno 21474841336 00000004:00080000:2.0:1746143850.751229:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b70700, transno 21474841341 00000004:00080000:2.0:1746143850.751231:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71180, transno 21474841342 00000004:00080000:2.0:1746143850.751233:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b70e00, transno 21474841343 00000004:00080000:2.0:1746143850.751235:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b73b80, transno 21474841344 00000004:00080000:2.0:1746143850.751237:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b73100, transno 21474841345 00000004:00080000:2.0:1746143850.751239:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b72a00, transno 21474841346 00000004:00080000:2.0:1746143850.751241:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71880, transno 21474841347 00000004:00080000:2.0:1746143850.751243:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71c00, transno 21474841348 00000004:00080000:2.0:1746143850.751245:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d7480, transno 21474841349 00000004:00080000:2.0:1746143850.751246:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d5500, transno 21474841350 00000004:00080000:2.0:1746143850.751261:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e59180, transno 21474841351 00000004:00080000:2.0:1746143850.751264:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58380, transno 21474841352 00000004:00080000:2.0:1746143850.751266:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5a680, transno 21474841353 00000004:00080000:2.0:1746143850.751268:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e5bb80, transno 21474841354 00000004:00080000:2.0:1746143850.751270:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c4d5c00, transno 21474841355 00000004:00080000:2.0:1746143850.751272:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090e58700, transno 21474841356 00000004:00080000:2.0:1746143850.751274:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719e680, transno 21474841357 00000004:00080000:2.0:1746143850.751276:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0b800, transno 21474841358 00000004:00080000:2.0:1746143850.751277:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719f480, transno 21474841359 00000004:00080000:2.0:1746143850.751279:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0b100, transno 21474841360 00000004:00080000:2.0:1746143850.751281:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0bb80, transno 21474841361 00000004:00080000:2.0:1746143850.751283:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719e300, transno 21474841362 00000004:00080000:2.0:1746143850.751285:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009719dc00, transno 21474841363 00000004:00080000:2.0:1746143850.751287:0:3773:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0a300, transno 21474841364 00000100:00100000:2.0:1746143850.751290:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627600640:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.751312:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3774:1830963627599744:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.751320:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3774:1830963627600256:0@lo:400:kworker.0 00000004:00080000:2.0:1746143850.751513:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 56 done 00000100:00100000:2.0:1746143850.751527:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.755271:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3771:1830963627600896:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.755330:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.755819:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3771:1830963627599872:0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.755888:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600384 00000100:00100000:0.0:1746143850.755893:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143850.755895:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600384 00000100:00100000:3.0:1746143850.755946:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600896 00000100:00100000:3.0:1746143850.755949:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600896 00000100:00100000:0.0:1746143850.755950:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627600000:0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.755958:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627600512 00000100:00100000:3.0:1746143850.755960:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627600512 00000100:00100000:3.0:1746143850.755974:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1746143850.755980:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3771:x1830963627600384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.755992:0:10936:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1746143850.755999:0:10936:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3771:x1830963627600896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.756024:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3771:x1830963627600384:12345-0@lo:400:kworker.0 Request processed in 45us (4496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.756029:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1746143850.756033:0:10936:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3771:x1830963627600896:12345-0@lo:400:kworker.0 Request processed in 35us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.756038:0:10936:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1746143850.756043:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1746143850.756046:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963627600512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746143850.756064:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3772:x1830963627600512:12345-0@lo:400:kworker.0 Request processed in 17us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.756068:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:0.0:1746143850.756078:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3772:1830963627600512:0@lo:400:kworker.0 00000100:00080000:3.0:1746143850.756084:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1746143850.756086:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746143850.756515:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3771:1830963627600384:0@lo:400:kworker.0 00000100:00100000:2.0:1746143850.756524:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3771:1830963627600896:0@lo:400:kworker.0 00000100:00100000:0.0:1746143850.762078:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625323520:12345-192.168.202.3@tcp:4:cat.0 Request processed in 18601us (19759us total) trans 17179874114 rc 0/0 00000100:00100000:0.0:1746143850.762090:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2778 00002000:00100000:0.0:1746143850.762100:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->2760703) req@ffff88011e309c00 x1830963625323520/t17179874114(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/448 e 0 to 0 dl 1746143861 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143850.762109:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309c00 with x1830963625323520 ext(2097152->2760703) 00010000:00010000:0.0:1746143850.762118:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 18 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:0.0:1746143850.762133:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 18 pid: 9585 timeout: 1009 lvb_type: 0 00002000:00010000:0.0:1746143850.762140:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e309c00 00000100:00100000:0.0:1746143850.783856:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.783957:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625323648 00000100:00100000:3.0:1746143850.783966:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625323648 00010000:00010000:3.0:1746143850.783999:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 18 pid: 9585 timeout: 1009 lvb_type: 0 00000100:00100000:3.0:1746143850.784446:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8511 00000100:00100000:3.0:1746143850.784455:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625323648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.784467:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.784484:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 18 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.784495:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 18 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.784517:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801331d3200/0x87925e4cb73b7042 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cbf expref: 18 pid: 9585 timeout: 1009 lvb_type: 0 00010000:00010000:3.0:1746143850.784548:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.784550:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.784556:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 31 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.784563:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 31 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.784590:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 31 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.784599:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627601024:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.784663:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.792806:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.792845:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.792954:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324032 00000100:00100000:2.0:1746143850.792962:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324032 00002000:00100000:2.0:1746143850.793000:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88011e308380 x1830963625324032/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.793008:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308380 with x1830963625324032 ext(2097152->4194303) 00002000:00010000:2.0:1746143850.793013:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308380 00000100:00100000:2.0:1746143850.793026:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324160 00000100:00100000:2.0:1746143850.793028:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324160 00002000:00100000:2.0:1746143850.793039:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009610c000 x1830963625324160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.793046:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610c000 with x1830963625324160 ext(2097152->4194303) 00002000:00010000:2.0:1746143850.793048:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009610c000 00000100:00100000:2.0:1746143850.793060:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7595 00000100:00100000:2.0:1746143850.793066:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625324032:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143850.793087:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7596 00000100:00100000:1.0:1746143850.793104:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625324160:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143850.794541:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627601024:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.794560:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.794589:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625323648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10135us (10740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.794597:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8511 00000100:00100000:0.0:1746143850.795526:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.795632:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324416 00000100:00100000:3.0:1746143850.795639:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324416 00000100:00100000:3.0:1746143850.795674:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14156 00000100:00100000:3.0:1746143850.795680:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+30:3174:x1830963625324416:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143850.795701:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.795715:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b70ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d2f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.795798:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.795811:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.795820:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143850.795830:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143850.796143:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b70ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 33 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.796170:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 32 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.796176:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.796178:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143850.796180:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b800, rc 0) 00000100:00100000:3.0:1746143850.796212:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:3174:x1830963625324416:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 532us (692us total) trans 8589945268 rc 0/0 00000100:00100000:3.0:1746143850.796218:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14156 00000100:00100000:2.0:1746143850.817282:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625324032:12345-192.168.202.3@tcp:3:cat.0 Request processed in 24202us (24469us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143850.817295:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7595 00002000:00100000:2.0:1746143850.817307:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->4194303) req@ffff88011e308380 x1830963625324032/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.817316:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e308380 with x1830963625324032 ext(2097152->4194303) 00002000:00010000:2.0:1746143850.817322:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e308380 00000100:00100000:0.0:1746143850.821561:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.821794:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324544 00000100:00100000:3.0:1746143850.821804:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324544 00000100:00100000:3.0:1746143850.821867:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14157 00000100:00100000:3.0:1746143850.821875:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3175:x1830963625324544:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143850.821941:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.821964:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a400/0x87925e4cb73b70ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d36 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.822031:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822043:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822054:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822068:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822073:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822078:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822148:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822158:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 284 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.822164:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.822170:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.822206:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 31 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.822217:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 31 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.822229:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627601152:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.822331:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 284 pid: 10936 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.822339:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 284 pid: 10936 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.822346:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627601280:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.822365:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.832397:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627601152:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.832626:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.832737:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324672 00000100:00100000:2.0:1746143850.832744:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324672 00010000:00010000:2.0:1746143850.832779:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 285 pid: 10936 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143850.832803:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8512 00000100:00100000:2.0:1746143850.832809:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963625324672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.832821:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.832826:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 285 pid: 10936 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143850.832834:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 285 pid: 10936 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143850.832855:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143850.832859:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143850.832866:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143850.832871:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143850.832875:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.832943:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+285:2008:x1830963625324672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.832949:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8512 00010000:00010000:3.0:1746143850.833194:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d429a00/0x87925e4cb73b70c7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d0c expref: 284 pid: 10936 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.833217:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627601280:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.833236:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143850.834692:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.834951:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625324160:12345-192.168.202.3@tcp:3:cat.0 Request processed in 41812us (42063us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143850.834963:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7596 00002000:00100000:1.0:1746143850.834978:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009610c000 x1830963625324160/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.834987:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009610c000 with x1830963625324160 ext(2097152->4194303) 00002000:00010000:1.0:1746143850.834992:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009610c000 00000100:00100000:0.0:1746143850.835451:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324800 00000100:00100000:0.0:1746143850.835459:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324800 00010000:00010000:0.0:1746143850.835488:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 32 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143850.835539:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8513 00000100:00100000:0.0:1746143850.835548:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2010:x1830963625324800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143850.835563:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143850.835570:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 32 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143850.835581:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 32 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143850.835601:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b800/0x87925e4cb73b70f1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d2f expref: 32 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143850.835632:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143850.835638:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143850.835646:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143850.835654:0:16784:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143850.836463:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143850.836502:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2010:x1830963625324800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 954us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143850.836510:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8513 00000100:00100000:2.0:1746143850.836631:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143850.836964:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.836974:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143850.837037:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143850.837044:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143850.837066:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837079:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837091:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837096:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837101:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837107:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837113:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0a800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.837117:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837123:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837134:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143850.837137:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.837141:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837147:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837160:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837167:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837172:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837175:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800969c1600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.837178:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837182:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837189:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8000) 00010000:00010000:3.0:1746143850.837191:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143850.837194:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837198:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c1600/0x87925e4cb73b710d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.837238:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a400/0x87925e4cb73b70ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.837262:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.837269:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.837272:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143850.837274:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0600, rc 0) 00000100:00100000:3.0:1746143850.837322:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3175:x1830963625324544:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 15445us (15770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.837328:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14157 00000100:00100000:3.0:1746143850.838202:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625324928 00000100:00100000:3.0:1746143850.838211:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625324928 00000100:00100000:3.0:1746143850.838832:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17324 00000100:00100000:3.0:1746143850.838840:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3174:x1830963625324928:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143850.838855:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.838871:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d3d expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.838897:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.838904:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.838929:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.838935:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.838936:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.838939:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [913408->999423] (req 913408->999423) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.838968:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.838980:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143850.838992:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627601408:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.839468:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 7 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.839476:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 7 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143850.839484:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627601536:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.839510:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 31 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.839517:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 31 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.839524:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627601664:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.839538:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.842034:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.842103:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.842199:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.842430:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325056 00000100:00100000:2.0:1746143850.842438:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325056 00000100:00100000:2.0:1746143850.842483:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325184 00000100:00100000:2.0:1746143850.842485:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325184 00000100:00100000:1.0:1746143850.842507:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325312 00000100:00100000:1.0:1746143850.842510:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325312 00000100:00100000:3.0:1746143850.842588:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627601408:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.842729:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17325 00000100:00100000:2.0:1746143850.842737:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625325056:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143850.842754:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.842767:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d44 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.842788:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.842790:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.842798:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.842813:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.842823:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634e00, rc 0) 00000100:00100000:2.0:1746143850.842862:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625325056:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 126us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.842868:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17325 00000100:00100000:2.0:1746143850.842885:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17326 00000100:00100000:2.0:1746143850.842890:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625325184:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143850.842895:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.842901:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d4b expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.842938:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.842939:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.842943:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.842956:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 10 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.842963:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634000, rc 0) 00000100:00100000:2.0:1746143850.842978:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625325184:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 88us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.842982:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17326 00000100:00100000:1.0:1746143850.843227:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17327 00000100:00100000:1.0:1746143850.843233:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625325312:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143850.843240:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143850.843278:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d52 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.843291:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.843293:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143850.843298:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.843310:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 10 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143850.843317:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3e00, rc 0) 00000100:00100000:1.0:1746143850.843334:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625325312:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 102us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.843339:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17327 00000100:00100000:1.0:1746143850.843539:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627601536:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143850.843548:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627601664:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143850.843574:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [913408->999423] (req 913408->999423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143850.843584:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800969c0800, rc 0) 00000100:00100000:1.0:1746143850.843603:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3174:x1830963625324928:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4765us (6974us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.843609:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17324 00000100:00100000:0.0:1746143850.847566:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.847615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.847722:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325440 00000100:00100000:2.0:1746143850.847732:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325440 00010000:00010000:2.0:1746143850.847767:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143850.847801:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8514 00000100:00100000:2.0:1746143850.847809:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625325440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.847823:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.847844:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143850.847855:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143850.847876:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c800/0x87925e4cb73b6d9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b3e expref: 18 pid: 1945 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143850.847900:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.847960:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625325440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.847967:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8514 00000100:00100000:2.0:1746143850.848034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.848046:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325696 00000100:00100000:2.0:1746143850.848049:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325696 00010000:00010000:2.0:1746143850.848060:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 32 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143850.848076:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8515 00000100:00100000:2.0:1746143850.848081:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625325696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.848087:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.848094:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 32 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143850.848102:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 32 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143850.848113:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55ca00/0x87925e4cb73b6d40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b14 expref: 32 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143850.848120:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.848133:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625325696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.848138:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8515 00000100:00100000:3.0:1746143850.848623:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325952 00000100:00100000:3.0:1746143850.848628:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325952 00000100:00100000:3.0:1746143850.848658:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14158 00000100:00100000:3.0:1746143850.848663:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3175:x1830963625325952:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143850.848681:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.848695:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d59 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.848790:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.848804:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.848812:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.848839:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.848849:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 12 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.848861:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627601792:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143850.848941:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.850518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.851411:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625325568 00000100:00100000:2.0:1746143850.851419:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625325568 00010000:00010000:2.0:1746143850.851450:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143850.851483:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8516 00000100:00100000:2.0:1746143850.851490:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625325568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143850.851503:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143850.851521:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143850.851531:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143850.851549:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b6f8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c41 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143850.851564:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.851566:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.851573:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.851581:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.851611:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.851623:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627601920:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.852421:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627601792:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143850.852445:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143850.853776:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.853804:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625326080 00000100:00100000:3.0:1746143850.853811:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625326080 00010000:00010000:3.0:1746143850.853837:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 13 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.853864:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8517 00000100:00100000:3.0:1746143850.853870:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625326080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.853882:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.853887:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 13 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.853896:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 13 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.853929:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800969c0600/0x87925e4cb73b7114 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d36 expref: 13 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.853951:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.853956:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.853966:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.853972:0:7229:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.853989:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.854020:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625326080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.854026:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8517 00010000:00010000:3.0:1746143850.854047:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.854057:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143850.854075:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143850.854200:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b7137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d59 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.854212:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d59 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.854218:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.854221:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143850.854223:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0b400, rc 0) 00000100:00100000:3.0:1746143850.854240:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3175:x1830963625325952:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 5577us (6625us total) trans 8589945269 rc 0/0 00000100:00100000:3.0:1746143850.854246:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14158 00000100:00100000:2.0:1746143850.854482:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.854507:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627601920:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143850.854529:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143850.854551:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625325568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3062us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.854558:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8516 00000100:00100000:2.0:1746143850.855844:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.856602:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625326336 00000100:00100000:1.0:1746143850.856611:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625326336 00002000:00100000:1.0:1746143850.856653:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (913408->917503) req@ffff88009eb87800 x1830963625326336/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.856662:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87800 with x1830963625326336 ext(913408->917503) 00002000:00010000:1.0:1746143850.856667:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87800 00000100:00100000:1.0:1746143850.856696:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7597 00000100:00100000:1.0:1746143850.856704:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625326336:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143850.856849:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625326336:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 145us (1011us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143850.856856:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7597 00002000:00100000:1.0:1746143850.856861:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (913408->917503) req@ffff88009eb87800 x1830963625326336/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.856867:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb87800 with x1830963625326336 ext(913408->917503) 00002000:00010000:1.0:1746143850.856870:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb87800 00000100:00100000:0.0:1746143850.857217:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.857237:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.857291:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625326720 00000100:00100000:3.0:1746143850.857295:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625326720 00000100:00100000:3.0:1746143850.857335:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14159 00000100:00100000:3.0:1746143850.857341:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3175:x1830963625326720:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143850.857359:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.857362:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143850.857384:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b713e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d59 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.857390:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625326464 00000100:00100000:2.0:1746143850.857394:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625326464 00010000:00010000:3.0:1746143850.857398:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.857403:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143850.857415:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b714c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d67 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.857420:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17328 00000100:00100000:2.0:1746143850.857424:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625326464:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.857431:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.857440:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634a00/0x87925e4cb73b7153 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d60 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.857481:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602048:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.857522:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857535:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857543:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143850.857543:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00010000:00010000:3.0:1746143850.857554:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857560:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857565:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857570:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b25a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143850.857574:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857580:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857586:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143850.857589:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143850.857592:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857596:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b715a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143850.857616:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b714c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d67 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.857623:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b714c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d67 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.857630:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24c00, rc 0) 00000100:00100000:3.0:1746143850.857648:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fc9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3175:x1830963625326720:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 308us (411us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.857654:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14159 00000100:00100000:0.0:1746143850.859027:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143850.859405:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625326976 00000100:00100000:1.0:1746143850.859412:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625326976 00002000:00100000:1.0:1746143850.859442:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (995328->999423) req@ffff88009322df80 x1830963625326976/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.859451:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322df80 with x1830963625326976 ext(995328->999423) 00002000:00010000:1.0:1746143850.859459:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322df80 00000100:00100000:1.0:1746143850.859487:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7598 00000100:00100000:1.0:1746143850.859493:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625326976:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143850.859614:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625326976:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 121us (590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143850.859620:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7598 00002000:00100000:1.0:1746143850.859625:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (995328->999423) req@ffff88009322df80 x1830963625326976/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.859631:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322df80 with x1830963625326976 ext(995328->999423) 00002000:00010000:1.0:1746143850.859634:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322df80 00000100:00100000:0.0:1746143850.862242:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:2.0:1746143850.862392:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime: 1746143849 -> 1746143851 00002000:00010000:2.0:1746143850.862396:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143849 -> 1746143851 00002000:00010000:2.0:1746143850.862398:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime: 1746143849 -> 1746143851 00000100:00100000:2.0:1746143850.862419:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602048:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.862452:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634a00/0x87925e4cb73b7153 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d60 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.862465:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634a00/0x87925e4cb73b7153 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d60 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.862480:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634a00, rc 0) 00000100:00100000:2.0:1746143850.862517:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625326464:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5092us (5301us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.862526:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17328 00000100:00100000:1.0:1746143850.862610:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625327232 00000100:00100000:1.0:1746143850.862616:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625327232 00000100:00100000:1.0:1746143850.862656:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5531 00000100:00100000:1.0:1746143850.862662:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3175:x1830963625327232:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143850.862820:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3175:x1830963625327232:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 158us (588us total) trans 8589945270 rc 0/0 00000100:00100000:1.0:1746143850.862825:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5531 00000100:00100000:0.0:1746143850.865087:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.865721:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625327488 00000100:00100000:2.0:1746143850.865735:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625327488 00000100:00100000:2.0:1746143850.865788:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5532 00000100:00100000:2.0:1746143850.865796:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+31:3174:x1830963625327488:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143850.866431:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+32:3174:x1830963625327488:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 635us (1350us total) trans 8589945271 rc 0/0 00000100:00100000:2.0:1746143850.866438:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5532 00000100:00100000:0.0:1746143850.875446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.876907:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625327744 00000100:00100000:0.0:1746143850.876931:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625327744 00002000:00100000:0.0:1746143850.876990:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009322f100 x1830963625327744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143850.877000:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f100 with x1830963625327744 ext(4194304->4853759) 00002000:00010000:0.0:1746143850.877007:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322f100 00000100:00100000:0.0:1746143850.877041:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7599 00000100:00100000:0.0:1746143850.877049:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625327744:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143850.883604:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2010:x1830963625327744:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6544us (8162us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143850.883616:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7599 00002000:00100000:2.0:1746143850.883628:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009322f100 x1830963625327744/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143850.883637:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f100 with x1830963625327744 ext(4194304->4853759) 00002000:00010000:2.0:1746143850.883643:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322f100 00000100:00100000:0.0:1746143850.889273:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.889372:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625327872 00000100:00100000:2.0:1746143850.889383:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625327872 00000100:00100000:2.0:1746143850.889437:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17329 00000100:00100000:2.0:1746143850.889445:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625327872:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.889464:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.889484:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b7161 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d6e expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.889540:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602176:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143850.891201:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.894974:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602176:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.895013:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b7161 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d6e expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.895028:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551000/0x87925e4cb73b7161 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d6e expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.895045:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551000, rc 0) 00000100:00100000:2.0:1746143850.895097:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625327872:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5651us (5835us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.895106:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17329 00000100:00100000:1.0:1746143850.898751:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.899020:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625328000 00000100:00100000:2.0:1746143850.899029:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625328000 00000100:00100000:2.0:1746143850.899617:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17330 00000100:00100000:2.0:1746143850.899626:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625328000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143850.899645:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.899663:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b7168 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d75 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143850.899719:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602304:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143850.901834:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.903139:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746143850.903161:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627602432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746143850.903229:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143850.903328:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627602432 00000100:00100000:1.0:1746143850.903338:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627602432 00000100:00100000:1.0:1746143850.903403:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1746143850.903413:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3771:x1830963627602432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746143850.903442:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1171414208 pending 3047424 free 3910172672 avail 3678650368 00000100:00100000:1.0:1746143850.903511:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3771:x1830963627602432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.903519:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1746143850.903852:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627602432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746143850.904337:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627602560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746143850.904368:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143850.904716:0:9588:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627602560 00000100:00100000:2.0:1746143850.904720:0:9588:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627602560 00000100:00100000:2.0:1746143850.904744:0:9588:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1746143850.904749:0:9588:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3773:x1830963627602560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746143850.904761:0:9588:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1157701696 pending 2695168 free 3906142208 avail 3674619904 00000100:00100000:2.0:1746143850.905516:0:9588:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b492450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3773:x1830963627602560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 763us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.905525:0:9588:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1746143850.905984:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627602560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746143850.910148:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602304:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143850.910190:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b7168 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d75 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.910208:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551800/0x87925e4cb73b7168 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d75 expref: 32 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.910554:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:2.0:1746143850.910644:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625328000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 11012us (11896us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143850.910654:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17330 00000100:00100000:0.0:1746143850.915982:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.916194:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625328256 00000100:00100000:2.0:1746143850.916204:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625328256 00000100:00100000:2.0:1746143850.916266:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5533 00000100:00100000:2.0:1746143850.916274:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+284:3169:x1830963625328256:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143850.916951:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:3169:x1830963625328256:12345-192.168.202.3@tcp:35:cat.0 Request processed in 677us (978us total) trans 8589945272 rc 0/0 00000100:00100000:2.0:1746143850.916959:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5533 00000100:00100000:1.0:1746143850.919663:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746143850.919684:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627602688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746143850.919747:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143850.920529:0:12158:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627602688 00000100:00100000:3.0:1746143850.920539:0:12158:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627602688 00000100:00100000:3.0:1746143850.920582:0:12158:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1746143850.920589:0:12158:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627602688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746143850.920625:0:12158:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445208064 avail 1315745792 00000100:00100000:3.0:1746143850.921794:0:12158:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3773:x1830963627602688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1200us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.921803:0:12158:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1746143850.921905:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3773:1830963627602688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746143850.922212:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.922323:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625328384 00000100:00100000:2.0:1746143850.922329:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625328384 00000100:00100000:2.0:1746143850.922364:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17331 00000100:00100000:2.0:1746143850.922370:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+31:3171:x1830963625328384:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143850.922384:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.922402:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d7c expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.922433:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.922442:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 8 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.922449:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.922451:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.922454:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2936832->3145727] (req 2936832->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.922483:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 8 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.922494:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 8 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143850.922512:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.922956:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.922964:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143850.922973:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602944:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.923005:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143850.927954:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.928045:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.928137:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.928147:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627602944:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.928178:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2936832->3145727] (req 2936832->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.928196:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551a00, rc 0) 00000100:00100000:2.0:1746143850.928239:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+32:3171:x1830963625328384:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5869us (6030us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.928257:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17331 00000100:00100000:3.0:1746143850.928433:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625328640 00000100:00100000:3.0:1746143850.928441:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625328640 00010000:00010000:3.0:1746143850.928469:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.928500:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625328512 00000100:00100000:3.0:1746143850.928502:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625328512 00010000:00010000:3.0:1746143850.928512:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 9 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143850.928535:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8518 00000100:00100000:3.0:1746143850.928541:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2009:x1830963625328640:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.928554:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.928574:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.928584:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.928604:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512e00/0x87925e4cb73b70e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d28 expref: 32 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.928618:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.928634:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+31:2009:x1830963625328640:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.928639:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8518 00000100:00100000:3.0:1746143850.928652:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8519 00000100:00100000:3.0:1746143850.928655:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625328512:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.928661:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.928667:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 9 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143850.928674:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 9 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143850.928685:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634000/0x87925e4cb73b7129 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d4b expref: 9 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143850.928694:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.928696:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.928702:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.928709:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.928738:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.928750:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627603072:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.928801:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.934348:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627603072:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.934374:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.934427:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625328512:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5769us (6380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.934438:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8519 00000100:00100000:0.0:1746143850.935014:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.935089:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625328896 00000100:00100000:3.0:1746143850.935096:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625328896 00002000:00100000:3.0:1746143850.935132:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2936832->2940927) req@ffff88009322d880 x1830963625328896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.935147:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322d880 with x1830963625328896 ext(2936832->2940927) 00002000:00010000:3.0:1746143850.935151:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322d880 00000100:00100000:3.0:1746143850.935167:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7600 00000100:00100000:3.0:1746143850.935172:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625328896:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143850.935301:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625328896:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 128us (287us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143850.935308:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7600 00002000:00100000:3.0:1746143850.935313:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2936832->2940927) req@ffff88009322d880 x1830963625328896/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.935319:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322d880 with x1830963625328896 ext(2936832->2940927) 00002000:00010000:3.0:1746143850.935321:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322d880 00000100:00100000:0.0:1746143850.939241:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.939342:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625329024 00000100:00100000:2.0:1746143850.939352:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625329024 00000100:00100000:2.0:1746143850.939399:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17332 00000100:00100000:2.0:1746143850.939510:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:3171:x1830963625329024:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143850.939530:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143850.939550:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d83 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.939583:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.939591:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.939597:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.939603:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.939604:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143850.939608:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->2908159] (req 2097152->2908159) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.939639:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.939652:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143850.939664:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627603200:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.940307:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 9 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143850.940317:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 9 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143850.940327:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627603328:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.940359:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 13 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.940366:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 13 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143850.940374:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627603456:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.940391:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.943366:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627603200:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.943378:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627603328:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143850.943771:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627603456:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143850.943804:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [2097152->2908159] (req 2097152->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143850.943823:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551800, rc 0) 00000100:00100000:2.0:1746143850.943878:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:3171:x1830963625329024:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4470us (4757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143850.943887:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17332 00000100:00100000:0.0:1746143850.946518:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.946559:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.946640:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625329152 00000100:00100000:3.0:1746143850.946648:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625329152 00010000:00010000:3.0:1746143850.946684:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143850.946718:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625329280 00000100:00100000:3.0:1746143850.946720:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625329280 00010000:00010000:3.0:1746143850.946731:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143850.946749:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8520 00000100:00100000:3.0:1746143850.946760:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625329152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.946775:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.946798:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143850.946808:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143850.946831:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3e00/0x87925e4cb73b7130 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d52 expref: 10 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143850.946888:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8521 00000100:00100000:1.0:1746143850.946895:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625329280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143850.946902:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143850.946941:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:1.0:1746143850.946949:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:1.0:1746143850.947071:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b70b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d05 expref: 34 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:1.0:1746143850.947089:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143850.947129:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625329280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 234us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143850.947134:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8521 00010000:00010000:3.0:1746143850.948230:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.948282:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625329152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1521us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.948289:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8520 00000100:00100000:0.0:1746143850.949392:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.949491:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625329408 00000100:00100000:3.0:1746143850.949500:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625329408 00010000:00010000:3.0:1746143850.949524:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 14 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143850.949557:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8522 00000100:00100000:3.0:1746143850.949564:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625329408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143850.949576:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143850.949591:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 14 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.949601:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 14 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.949624:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801331d3000/0x87925e4cb73b7065 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cd4 expref: 14 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143850.949638:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.949639:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143850.949648:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.949656:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143850.949688:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.949701:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627603584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143850.949781:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143850.953702:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627603584:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143850.953725:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143850.953789:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625329408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4223us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143850.953801:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8522 00000100:00100000:0.0:1746143850.959740:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.959871:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625329664 00000100:00100000:3.0:1746143850.959882:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625329664 00002000:00100000:3.0:1746143850.959959:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2904064->2908159) req@ffff880093f6bb80 x1830963625329664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.959977:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6bb80 with x1830963625329664 ext(2904064->2908159) 00002000:00010000:3.0:1746143850.959983:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6bb80 00000100:00100000:3.0:1746143850.960007:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7601 00000100:00100000:3.0:1746143850.960015:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625329664:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143850.961372:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625329664:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 1352us (1639us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143850.961380:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7601 00002000:00100000:3.0:1746143850.961389:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2904064->2908159) req@ffff880093f6bb80 x1830963625329664/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:246/0 lens 488/4536 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.961396:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6bb80 with x1830963625329664 ext(2904064->2908159) 00002000:00010000:3.0:1746143850.961400:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f6bb80 00000100:00100000:0.0:1746143850.964823:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.965949:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625330048 00000100:00100000:2.0:1746143850.965958:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625330048 00000100:00100000:0.0:1746143850.965970:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143850.966016:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5534 00000100:00100000:2.0:1746143850.966022:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b496050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+285:3171:x1830963625330048:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143850.966652:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625329792 00000100:00100000:3.0:1746143850.966656:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625329792 00000100:00100000:3.0:1746143850.966689:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17333 00000100:00100000:3.0:1746143850.966695:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625329792:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143850.966704:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143850.966725:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24000/0x87925e4cb73b717d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d8a expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143850.966777:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627603712:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143850.966841:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143850.968068:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b496050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+286:3171:x1830963625330048:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 2043us (3253us total) trans 8589945273 rc 0/0 00000100:00100000:2.0:1746143850.968076:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5534 00000100:00100000:1.0:1746143850.968424:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.968517:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625330176 00000100:00100000:0.0:1746143850.968523:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625330176 00000100:00100000:0.0:1746143850.968545:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17334 00000100:00100000:0.0:1746143850.968550:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625330176:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143850.968561:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143850.968585:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b7184 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d91 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143850.968613:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627603840:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143850.969235:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a900 going to sleep for 11 seconds 00002000:00010000:3.0:1746143850.969552:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143850 -> 1746143851 00002000:00010000:3.0:1746143850.969555:0:1945:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime: 1746143850 -> 1746143851 00000100:00100000:3.0:1746143850.969568:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627603712:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143850.969590:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24000/0x87925e4cb73b717d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d8a expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.969601:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24000/0x87925e4cb73b717d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d8a expref: 18 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143850.969623:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24000, rc 0) 00000100:00100000:3.0:1746143850.969644:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625329792:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2949us (3677us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143850.969650:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17333 00002000:00010000:0.0:1746143850.976278:0:13430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143850 -> 1746143851 00002000:00010000:0.0:1746143850.976284:0:13430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143850 -> 1746143851 00002000:00010000:0.0:1746143850.976286:0:13430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime: 1746143850 -> 1746143851 00000100:00100000:0.0:1746143850.976306:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627603840:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143850.976333:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b7184 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d91 expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.976348:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7d600/0x87925e4cb73b7184 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d91 expref: 14 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143850.976361:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7d600, rc 0) 00000100:00100000:0.0:1746143850.976414:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625330176:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7862us (7990us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143850.976422:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17334 00000100:00100000:0.0:1746143850.988509:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143850.988571:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143850.988776:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625330560 00000100:00100000:3.0:1746143850.988784:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625330560 00002000:00100000:3.0:1746143850.988820:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093f6a680 x1830963625330560/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143850.988830:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6a680 with x1830963625330560 ext(1048576->2097151) 00002000:00010000:3.0:1746143850.988835:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f6a680 00000100:00100000:1.0:1746143850.989881:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625330432 00000100:00100000:1.0:1746143850.989888:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625330432 00000100:00100000:3.0:1746143850.989902:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7602 00000100:00100000:3.0:1746143850.989924:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625330560:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:1.0:1746143850.989925:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880093f68000 x1830963625330432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 504/0 e 0 to 0 dl 1746143861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.989933:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68000 with x1830963625330432 ext(0->1048575) 00002000:00010000:1.0:1746143850.989938:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f68000 00000100:00100000:1.0:1746143850.989952:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7603 00000100:00100000:1.0:1746143850.989957:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625330432:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143850.995441:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143850.998347:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625330432:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8381us (9767us total) trans 0 rc 962560/962560 00000100:00100000:1.0:1746143850.998358:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7603 00002000:00100000:1.0:1746143850.998368:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880093f68000 x1830963625330432/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 504/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 962560/962560 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143850.998376:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f68000 with x1830963625330432 ext(0->1048575) 00002000:00010000:1.0:1746143850.998382:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f68000 00000100:00100000:3.0:1746143851.003173:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625330560:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13257us (14665us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.003183:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7602 00002000:00100000:3.0:1746143851.003192:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093f6a680 x1830963625330560/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:246/0 lens 488/440 e 0 to 0 dl 1746143861 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.003206:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f6a680 with x1830963625330560 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.003210:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f6a680 00000100:00100000:0.0:1746143851.015672:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.016322:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.016402:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625330816 00000100:00100000:2.0:1746143851.016410:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625330816 00000100:00100000:2.0:1746143851.016446:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625330944 00000100:00100000:2.0:1746143851.016448:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625330944 00000100:00100000:2.0:1746143851.016469:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17335 00000100:00100000:2.0:1746143851.016477:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625330816:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.016492:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.016508:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73b718b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d98 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.016512:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17336 00000100:00100000:3.0:1746143851.016520:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625330944:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.016528:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.016537:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b7192 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412d9f expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.016555:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627603968:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.016562:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627604096:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.018708:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.018741:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.020562:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627604096:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.020562:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627603968:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.020587:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b7192 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d9f expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.020587:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73b718b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d98 expref: 18 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.020600:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b7192 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d9f expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.020600:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c600/0x87925e4cb73b718b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d98 expref: 18 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.020614:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00010000:00010000:2.0:1746143851.020615:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c600, rc 0) 00000100:00100000:2.0:1746143851.020651:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625330816:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4175us (4986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.020659:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17335 00000100:00100000:3.0:1746143851.020769:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625330944:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4248us (4446us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.020775:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17336 00000100:00100000:0.0:1746143851.031634:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.032121:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625331072 00000100:00100000:3.0:1746143851.032132:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625331072 00000100:00100000:2.0:1746143851.035390:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17337 00000100:00100000:2.0:1746143851.035413:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3181:x1830963625331072:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.035436:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.035460:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412da6 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.035492:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.035499:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.035501:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.035505:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 18 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.035538:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 30 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.035550:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 30 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.035561:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627604224:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.035671:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.038877:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.038952:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625331200 00000100:00100000:0.0:1746143851.038960:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625331200 00000100:00100000:2.0:1746143851.039050:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627604224:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.039084:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 18 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.039101:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c200, rc 0) 00000100:00100000:2.0:1746143851.039154:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3181:x1830963625331072:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3752us (7532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.039164:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17337 00000100:00080000:2.0:1746143851.039199:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:0.0:1746143851.039306:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2936832->3145727) req@ffff880095cb5c00 x1830963625331200/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143851.039314:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5c00 with x1830963625331200 ext(2936832->3145727) 00010000:00010000:0.0:1746143851.039321:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 31 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.039334:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 31 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:0.0:1746143851.039341:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb5c00 00000100:00100000:0.0:1746143851.039359:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2779 00000100:00100000:0.0:1746143851.039366:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+31:2008:x1830963625331200:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143851.050027:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2008:x1830963625331200:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10648us (11146us total) trans 17179874115 rc 0/0 00000100:00100000:2.0:1746143851.050041:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2779 00002000:00100000:2.0:1746143851.050053:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2936832->3145727) req@ffff880095cb5c00 x1830963625331200/t17179874115(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.050063:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb5c00 with x1830963625331200 ext(2936832->3145727) 00010000:00010000:2.0:1746143851.050074:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.050090:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.050096:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cb5c00 00000100:00100000:0.0:1746143851.053379:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.053593:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625331328 00000100:00100000:3.0:1746143851.053601:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625331328 00010000:00010000:3.0:1746143851.053631:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.053739:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8523 00000100:00100000:3.0:1746143851.053747:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625331328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.053760:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.053779:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.053790:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.053811:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d551a00/0x87925e4cb73b716f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2936832->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d7c expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.053838:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.053840:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.053847:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 17 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.053854:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 17 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.053881:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 17 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.053891:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627604352:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.053981:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.062731:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.063019:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625331584 00000100:00100000:2.0:1746143851.063029:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625331584 00002000:00100000:2.0:1746143851.063077:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136636680 x1830963625331584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.063086:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136636680 with x1830963625331584 ext(2097152->3145727) 00002000:00010000:2.0:1746143851.063091:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136636680 00000100:00100000:2.0:1746143851.063127:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7604 00000100:00100000:2.0:1746143851.063134:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625331584:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143851.063975:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627604352:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.063996:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.065369:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+32:2011:x1830963625331328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11616us (11989us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.065382:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8523 00000100:00100000:2.0:1746143851.075374:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625331584:12345-192.168.202.3@tcp:3:cat.0 Request processed in 12226us (12640us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.075388:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7604 00002000:00100000:2.0:1746143851.075402:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136636680 x1830963625331584/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.075411:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136636680 with x1830963625331584 ext(2097152->3145727) 00002000:00010000:2.0:1746143851.075418:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136636680 00000100:00100000:0.0:1746143851.084724:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.084888:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625331712 00000100:00100000:3.0:1746143851.084897:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625331712 00000100:00100000:3.0:1746143851.085486:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17338 00000100:00100000:3.0:1746143851.085496:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3181:x1830963625331712:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.085517:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.085535:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dad expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.085568:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.085577:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.085578:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.085581:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 14 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.085615:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 32 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.085627:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 32 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.085644:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627604480:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.085734:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.091426:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627604480:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.091461:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 14 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.091479:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24800, rc 0) 00000100:00100000:3.0:1746143851.091528:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3181:x1830963625331712:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6033us (6812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.091537:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17338 00000100:00100000:0.0:1746143851.094298:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.094483:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625331840 00000100:00100000:2.0:1746143851.094493:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625331840 00002000:00100000:2.0:1746143851.094561:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2908159) req@ffff880095cb4a80 x1830963625331840/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.094569:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963625331840 ext(2097152->2908159) 00010000:00010000:2.0:1746143851.094578:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.094591:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 33 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.094597:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb4a80 00000100:00100000:2.0:1746143851.094630:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2780 00000100:00100000:2.0:1746143851.094639:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625331840:12345-192.168.202.3@tcp:4:multiop.0 00000100:00080000:0.0:1746143851.094820:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143851.098067:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.098734:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.100935:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625332096 00000100:00100000:3.0:1746143851.100945:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625332096 00000100:00100000:3.0:1746143851.101005:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625332352 00000100:00100000:3.0:1746143851.101008:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625332352 00000100:00100000:3.0:1746143851.101028:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14160 00000100:00100000:3.0:1746143851.101035:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+32:3187:x1830963625332096:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.101061:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.101077:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412db4 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.101155:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101167:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101178:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143851.101187:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143851.101268:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 35 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.101283:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 34 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.101290:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.101292:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143851.101294:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25a00, rc 0) 00000100:00100000:3.0:1746143851.101332:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+34:3187:x1830963625332096:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 298us (3272us total) trans 8589945274 rc 0/0 00000100:00100000:3.0:1746143851.101338:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14160 00000100:00100000:3.0:1746143851.101352:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14161 00000100:00100000:3.0:1746143851.101356:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+286:3186:x1830963625332352:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.101364:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.101368:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73b71bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dbb expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.101393:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101399:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101404:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101414:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101419:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101423:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101477:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73b71d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101482:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73b71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101487:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73b71d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746143851.101492:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143851.101516:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101521:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101525:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101529:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101534:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.101537:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101542:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101549:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143851.101551:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143851.101554:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101558:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101565:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101569:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101573:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101576:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b25c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.101577:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101581:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101585:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8b00) 00010000:00010000:3.0:1746143851.101587:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143851.101588:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101592:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25c00/0x87925e4cb73b71ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746143851.101612:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25800/0x87925e4cb73b71bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dbb expref: 289 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.101620:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73b71d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dbb expref: 288 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.101624:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.101626:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143851.101628:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00000100:00100000:3.0:1746143851.101645:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7448e42d-373a-41e0-9678-9a18291c6700+288:3186:x1830963625332352:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 288us (2911us total) trans 8589945275 rc 0/0 00000100:00100000:3.0:1746143851.101650:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14161 00000100:00080000:1.0:1746143851.101733:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143851.107997:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.108170:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625332480 00000100:00100000:3.0:1746143851.108178:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625332480 00000100:00100000:3.0:1746143851.108235:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1028 00000100:00100000:3.0:1746143851.108242:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:2009:x1830963625332480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.108265:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.108286:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24200/0x87925e4cb73b71d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dbb expref: 288 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.108308:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.108313:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.108362:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+287:2009:x1830963625332480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 121us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.108368:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1028 00000100:00100000:1.0:1746143851.112014:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625331840:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 17368us (17718us total) trans 21474841373 rc 0/0 00000100:00100000:1.0:1746143851.112026:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2780 00002000:00100000:1.0:1746143851.112038:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2908159) req@ffff880095cb4a80 x1830963625331840/t21474841373(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.112053:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cb4a80 with x1830963625331840 ext(2097152->2908159) 00010000:00010000:1.0:1746143851.112064:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 35 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.112078:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 35 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143851.112084:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cb4a80 00000100:00100000:0.0:1746143851.116049:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.116178:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625332608 00000100:00100000:2.0:1746143851.116186:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625332608 00010000:00010000:2.0:1746143851.116217:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 35 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.116265:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8524 00000100:00100000:2.0:1746143851.116272:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625332608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.116284:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.116300:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 35 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.116310:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 35 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.116329:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551800/0x87925e4cb73b7176 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2908159) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d83 expref: 35 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.116355:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.116357:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.116363:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.116370:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.116397:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.116408:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627604608:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.118723:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.131130:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627604608:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.131148:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.131191:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625332608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 14919us (15149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.131200:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8524 00000100:00100000:0.0:1746143851.142652:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.142704:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.142734:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625332992 00000100:00100000:1.0:1746143851.142742:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625332992 00002000:00100000:1.0:1746143851.142780:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009e490380 x1830963625332992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.142788:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490380 with x1830963625332992 ext(2097152->4194303) 00002000:00010000:1.0:1746143851.142793:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490380 00000100:00100000:2.0:1746143851.142826:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625333120 00000100:00100000:2.0:1746143851.142830:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625333120 00000100:00100000:1.0:1746143851.142830:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7605 00000100:00100000:1.0:1746143851.142837:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625332992:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:2.0:1746143851.142851:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009e491880 x1830963625333120/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.142858:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491880 with x1830963625333120 ext(3145728->4194303) 00002000:00010000:2.0:1746143851.142861:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e491880 00000100:00100000:2.0:1746143851.142884:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7606 00000100:00100000:2.0:1746143851.142890:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625333120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143851.152846:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.152931:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625333248 00000100:00100000:3.0:1746143851.152940:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625333248 00000100:00100000:3.0:1746143851.152986:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17339 00000100:00100000:3.0:1746143851.152992:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3187:x1830963625333248:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.153006:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.153021:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dc2 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.153045:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.153051:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.153052:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.153054:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.153079:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.153089:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 21 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.153098:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627604736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.153174:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.170099:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625332992:12345-192.168.202.3@tcp:3:cat.0 Request processed in 27250us (27443us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746143851.170112:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7605 00002000:00100000:2.0:1746143851.170125:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff88009e490380 x1830963625332992/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.170134:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e490380 with x1830963625332992 ext(2097152->4194303) 00002000:00010000:2.0:1746143851.170140:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009e490380 00000100:00100000:0.0:1746143851.170299:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.170680:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625333504 00000100:00100000:2.0:1746143851.170688:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625333504 00000100:00100000:3.0:1746143851.173234:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14162 00000100:00100000:3.0:1746143851.173266:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+287:3190:x1830963625333504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.173302:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.173330:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dc9 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.173427:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173443:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173456:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173473:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173479:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173485:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173609:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b71fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173621:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b71fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173627:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b71fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143851.173638:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143851.173727:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173735:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173744:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173751:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173756:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b24c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.173760:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173766:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173777:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143851.173780:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143851.173784:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173789:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24c00/0x87925e4cb73b71ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173828:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173833:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173838:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173842:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d0b400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.173844:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173853:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173860:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8400) 00010000:00010000:3.0:1746143851.173862:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143851.173865:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173870:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0b400/0x87925e4cb73b71f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.173942:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b24600/0x87925e4cb73b71e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc9 expref: 290 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.173956:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b71fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc9 expref: 289 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.173963:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.173964:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746143851.173967:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d0a800, rc 0) 00000100:00100000:3.0:1746143851.174045:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+289:3190:x1830963625333504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 797us (3744us total) trans 8589945276 rc 0/0 00000100:00100000:3.0:1746143851.174052:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14162 00000100:00100000:2.0:1746143851.175406:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625333120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 32511us (32697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.175416:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7606 00002000:00100000:2.0:1746143851.175428:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff88009e491880 x1830963625333120/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.175437:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e491880 with x1830963625333120 ext(3145728->4194303) 00010000:00010000:2.0:1746143851.175446:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.175457:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.175464:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e491880 00000100:00100000:0.0:1746143851.182610:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.182660:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627604736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.182694:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.182714:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00000100:00100000:2.0:1746143851.182788:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625333632 00000100:00100000:2.0:1746143851.182795:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625333632 00000100:00100000:2.0:1746143851.182852:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17340 00000100:00100000:2.0:1746143851.182860:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3181:x1830963625333632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.182876:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.182895:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dd0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.182941:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.182946:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.182953:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.182957:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.182993:0:13430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [4157440->4194303] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 21 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.183005:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 21 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.183015:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ca00, rc 0) 00000100:00100000:1.0:1746143851.184934:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.184974:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625333760 00000100:00100000:1.0:1746143851.184981:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625333760 00000100:00100000:1.0:1746143851.185028:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1029 00000100:00100000:1.0:1746143851.185035:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+289:2011:x1830963625333760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.185048:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.185070:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d0a800/0x87925e4cb73b71fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc9 expref: 289 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.185093:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.185097:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.185137:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+288:2011:x1830963625333760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 103us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.185143:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1029 00000100:00100000:3.0:1746143851.185596:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3187:x1830963625333248:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 32600us (32754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.185604:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17339 00000100:00100000:2.0:1746143851.185704:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3181:x1830963625333632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2844us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.185710:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17340 00000100:00100000:0.0:1746143851.189654:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.189690:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.189713:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.189774:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625333888 00000100:00100000:2.0:1746143851.189785:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625333888 00000100:00100000:0.0:1746143851.189801:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.189838:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625334016 00000100:00100000:2.0:1746143851.189841:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625334016 00000100:00100000:0.0:1746143851.189843:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625334144 00000100:00100000:0.0:1746143851.189847:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625334144 00000100:00100000:2.0:1746143851.189858:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17341 00000100:00100000:2.0:1746143851.189864:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625333888:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:0.0:1746143851.189871:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17342 00000100:00100000:0.0:1746143851.189877:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625334016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.189884:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143851.189884:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.189901:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b7217 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dd7 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.189901:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73b7210 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dde expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.189942:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.189954:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73b7210 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dde expref: 35 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143851.189970:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3800/0x87925e4cb73b7210 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dde expref: 35 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143851.189973:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627604992:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143851.189984:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3800, rc 0) 00000100:00100000:0.0:1746143851.190032:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625334016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 154us (340us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143851.190038:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17343 00000100:00100000:1.0:1746143851.190047:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625334144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.190055:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.190065:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412de5 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.190076:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.190078:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.190086:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 35 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.190100:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 35 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.190109:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:2.0:1746143851.191149:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.191252:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625334144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1197us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.191425:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17342 00000100:00100000:0.0:1746143851.191482:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625334272 00000100:00100000:0.0:1746143851.191489:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625334272 00010000:00010000:0.0:1746143851.191519:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.191549:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8525 00000100:00100000:0.0:1746143851.191555:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2010:x1830963625334272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.191567:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.191586:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.191590:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17343 00010000:00010000:0.0:1746143851.191598:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.191617:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c200/0x87925e4cb73b7199 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412da6 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.191631:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.191633:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.191638:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.191646:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.191696:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.191715:0:7229:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.191725:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627605120:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143851.191751:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.200083:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627604992:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.200124:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b7217 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd7 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.200140:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408c400/0x87925e4cb73b7217 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd7 expref: 33 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.200161:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408c400, rc 0) 00000100:00100000:2.0:1746143851.200571:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:2010:x1830963625333888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 10704us (10926us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.200579:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17341 00000100:00100000:2.0:1746143851.201543:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627605120:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.201563:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.201590:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625334272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 10036us (11789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.201599:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8525 00000100:00100000:0.0:1746143851.202317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.202414:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625334528 00000100:00100000:2.0:1746143851.202422:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625334528 00002000:00100000:2.0:1746143851.202460:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4157440->4161535) req@ffff88009e492680 x1830963625334528/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.202469:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e492680 with x1830963625334528 ext(4157440->4161535) 00010000:00010000:2.0:1746143851.202477:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.202489:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.202495:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e492680 00000100:00100000:2.0:1746143851.202511:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2781 00000100:00100000:2.0:1746143851.202517:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625334528:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143851.202649:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625334528:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 131us (334us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143851.202655:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2781 00002000:00100000:2.0:1746143851.202660:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (4157440->4161535) req@ffff88009e492680 x1830963625334528/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.202667:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e492680 with x1830963625334528 ext(4157440->4161535) 00010000:00010000:2.0:1746143851.202671:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.202678:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.202683:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009e492680 00000100:00100000:0.0:1746143851.205993:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.206064:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625334656 00000100:00100000:2.0:1746143851.206074:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625334656 00000100:00100000:2.0:1746143851.206126:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17344 00000100:00100000:2.0:1746143851.206134:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+32:3190:x1830963625334656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.206152:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.206170:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dec expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.206198:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.206205:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.206207:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.206210:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.206257:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.206268:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 18 pid: 1947 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.206281:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627605248:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.206442:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.206459:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625334912 00000100:00100000:1.0:1746143851.206464:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625334912 00000100:00100000:0.0:1746143851.206472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.206484:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17345 00000100:00100000:1.0:1746143851.206490:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3187:x1830963625334912:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143851.206491:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335040 00000100:00100000:0.0:1746143851.206494:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335040 00010000:00010000:1.0:1746143851.206497:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.206506:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412df3 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746143851.206520:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4157440->4194303) req@ffff880091bdc000 x1830963625335040/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746143851.206521:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.206528:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 34 pid: 1947 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746143851.206530:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc000 with x1830963625335040 ext(4157440->4194303) 00010000:00010000:1.0:1746143851.206532:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.206533:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.206536:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->3534847] (req 3145728->3534847) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.206536:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.206546:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 19 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:0.0:1746143851.206552:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdc000 00010000:00010000:1.0:1746143851.206553:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 34 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.206561:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 34 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:0.0:1746143851.206564:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2782 00000100:00100000:1.0:1746143851.206568:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627605376:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.206569:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2011:x1830963625335040:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143851.208152:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00010000:00010000:1.0:1746143851.208220:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.208231:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.208241:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627605504:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.208297:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.211338:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.211403:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335168 00000100:00100000:3.0:1746143851.211412:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335168 00000100:00100000:0.0:1746143851.211422:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143851.211462:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (913408->999423) req@ffff880091bdfb80 x1830963625335168/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.211471:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdfb80 with x1830963625335168 ext(913408->999423) 00010000:00010000:3.0:1746143851.211480:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 21 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.211492:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 21 pid: 1947 timeout: 1010 lvb_type: 0 00002000:00010000:3.0:1746143851.211680:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdfb80 00000100:00100000:3.0:1746143851.211712:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2783 00000100:00100000:2.0:1746143851.211738:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13430:1830963627605248:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.211763:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.211780:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012408ce00, rc 0) 00000100:00100000:1.0:1746143851.211826:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627605376:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.211850:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625335168:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143851.211872:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+33:3190:x1830963625334656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5738us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.211879:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17344 00000100:00100000:1.0:1746143851.212038:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627605504:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.212059:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->3534847] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.212070:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97800, rc 0) 00000100:00100000:1.0:1746143851.212106:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3187:x1830963625334912:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5616us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.212112:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17345 00000100:00100000:3.0:1746143851.212516:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335296 00000100:00100000:3.0:1746143851.212520:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335296 00010000:00010000:3.0:1746143851.212539:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 35 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.212818:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8526 00000100:00100000:3.0:1746143851.212824:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625335296:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.212833:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.212848:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 35 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.212857:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 35 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.212876:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b721e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412de5 expref: 35 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.212889:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.212908:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625335296:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.212930:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8526 00000100:00100000:1.0:1746143851.214008:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625335040:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 7434us (7530us total) trans 17179874116 rc 0/0 00000100:00100000:1.0:1746143851.214021:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2782 00002000:00100000:1.0:1746143851.214029:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39f:0x0] (4157440->4194303) req@ffff880091bdc000 x1830963625335040/t17179874116(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.214038:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc000 with x1830963625335040 ext(4157440->4194303) 00010000:00010000:1.0:1746143851.214046:0:29556:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 23 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.214057:0:29556:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 23 pid: 1945 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143851.214064:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdc000 00000100:00100000:0.0:1746143851.216605:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.216683:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335424 00000100:00100000:1.0:1746143851.216691:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335424 00010000:00010000:1.0:1746143851.216722:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.216750:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8527 00000100:00100000:1.0:1746143851.216757:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2010:x1830963625335424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.216770:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.216789:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.216799:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.216824:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24800/0x87925e4cb73b71a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dad expref: 15 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.216841:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.216843:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.216848:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 14 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.216856:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 14 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.216884:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 14 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.216894:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627605632:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143851.216966:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.218298:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.218343:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335552 00000100:00100000:3.0:1746143851.218348:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335552 00010000:00010000:3.0:1746143851.218372:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 25 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.218405:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8528 00000100:00100000:3.0:1746143851.218411:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625335552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.218420:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.218432:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 25 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.218439:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 25 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.218453:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24200/0x87925e4cb73b71df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4157440->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dc2 expref: 25 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.218464:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.218466:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.218470:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.218476:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.218499:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 24 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.218508:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627605760:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.221668:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800922229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.222349:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627605632:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143851.222370:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.222419:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2010:x1830963625335424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5661us (5820us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.222429:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8527 00000100:00100000:2.0:1746143851.222832:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625335168:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 10982us (11501us total) trans 17179874117 rc 0/0 00000100:00100000:2.0:1746143851.222841:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2783 00002000:00100000:2.0:1746143851.222852:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (913408->999423) req@ffff880091bdfb80 x1830963625335168/t17179874117(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.222860:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdfb80 with x1830963625335168 ext(913408->999423) 00010000:00010000:2.0:1746143851.222869:0:29558:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 23 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.222883:0:29558:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 23 pid: 1947 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.222889:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bdfb80 00000100:00100000:0.0:1746143851.226691:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.226967:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335808 00000100:00100000:2.0:1746143851.226976:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335808 00002000:00100000:2.0:1746143851.227021:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3530752->3534847) req@ffff880091bdc380 x1830963625335808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.227030:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc380 with x1830963625335808 ext(3530752->3534847) 00002000:00010000:2.0:1746143851.227035:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc380 00000100:00100000:2.0:1746143851.227064:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7607 00000100:00100000:2.0:1746143851.227070:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625335808:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143851.227215:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2011:x1830963625335808:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 144us (532us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143851.227220:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7607 00002000:00100000:2.0:1746143851.227225:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3530752->3534847) req@ffff880091bdc380 x1830963625335808/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.227232:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc380 with x1830963625335808 ext(3530752->3534847) 00002000:00010000:2.0:1746143851.227235:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc380 00000100:00100000:3.0:1746143851.229353:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627605760:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.229377:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.229420:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625335552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 11006us (11123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.229430:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8528 00000100:00100000:0.0:1746143851.231534:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.231573:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625335936 00000100:00100000:3.0:1746143851.231581:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625335936 00000100:00100000:0.0:1746143851.231581:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143851.231613:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 22 pid: 1947 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.231648:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8529 00000100:00100000:3.0:1746143851.231655:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625335936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.231668:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.231688:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 22 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.231699:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 22 pid: 1947 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.231722:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800969c0800/0x87925e4cb73b711b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->999423) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d3d expref: 22 pid: 1947 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.231772:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625336064 00000100:00100000:1.0:1746143851.231776:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625336064 00000100:00100000:1.0:1746143851.231805:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17346 00000100:00100000:1.0:1746143851.231810:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:3186:x1830963625336064:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143851.231828:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.231839:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412dfa expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.231858:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.231866:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.231872:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.231877:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.231878:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.231881:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.231908:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 35 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.231943:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 35 pid: 1945 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.231978:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.231980:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.231987:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.232054:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.232076:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627605888:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.232206:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 8 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.232219:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 8 pid: 12327 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.232227:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606144:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.232267:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 32 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.232277:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627606016:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143851.232789:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.232798:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 13 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.232806:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606272:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.232863:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.233135:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.233722:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.233753:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.233862:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625336448 00000100:00100000:2.0:1746143851.233869:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625336448 00002000:00100000:2.0:1746143851.233903:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880091bdce00 x1830963625336448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.233936:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdce00 with x1830963625336448 ext(3145728->4194303) 00002000:00010000:2.0:1746143851.233940:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdce00 00000100:00100000:2.0:1746143851.233964:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625336576 00000100:00100000:2.0:1746143851.233966:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625336576 00002000:00100000:2.0:1746143851.233978:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3534848->4194303) req@ffff880091bdc700 x1830963625336576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.233985:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc700 with x1830963625336576 ext(3534848->4194303) 00002000:00010000:2.0:1746143851.233987:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc700 00000100:00100000:3.0:1746143851.233992:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7608 00000100:00100000:3.0:1746143851.233999:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625336448:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143851.234091:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627605888:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.234155:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7609 00000100:00100000:2.0:1746143851.234162:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625336576:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143851.238001:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.238120:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.238224:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606144:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.238300:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625336704 00000100:00100000:2.0:1746143851.238309:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625336704 00010000:00010000:2.0:1746143851.238341:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 36 pid: 1945 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.238346:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7229:1830963627606016:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.238364:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625336832 00010000:00010000:3.0:1746143851.238365:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.238365:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625336832 00010000:00010000:2.0:1746143851.238374:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 9 pid: 12327 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.238388:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8530 00000100:00100000:2.0:1746143851.238394:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625336704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143851.238403:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625335936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6748us (6877us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143851.238406:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746143851.238411:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8529 00010000:00010000:2.0:1746143851.238427:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 36 pid: 1945 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.238431:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8531 00000100:00100000:3.0:1746143851.238436:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625336832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.238441:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 36 pid: 1945 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.238444:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.238668:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d7fa00/0x87925e4cb73b6f15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bfb expref: 36 pid: 1945 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.238669:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 9 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.238679:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 9 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.238690:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143851.238695:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74400/0x87925e4cb73b6f9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c4f expref: 9 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.238710:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.238710:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625336704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 316us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.238716:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8530 00000100:00100000:3.0:1746143851.238726:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625336832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 290us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.238731:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8531 00000100:00100000:0.0:1746143851.241680:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.241796:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625337088 00000100:00100000:1.0:1746143851.241805:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625337088 00000100:00100000:2.0:1746143851.241829:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625336576:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7665us (8072us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143851.241839:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7609 00002000:00100000:2.0:1746143851.241846:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3bf:0x0] (3534848->4194303) req@ffff880091bdc700 x1830963625336576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 659456/659456 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.241846:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880091bde680 x1830963625337088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.241854:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdc700 with x1830963625336576 ext(3534848->4194303) 00002000:00100000:1.0:1746143851.241854:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde680 with x1830963625337088 ext(0->1048575) 00002000:00010000:2.0:1746143851.241859:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bdc700 00002000:00010000:1.0:1746143851.241859:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bde680 00000100:00100000:2.0:1746143851.241879:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7610 00000100:00100000:2.0:1746143851.241886:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625337088:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143851.242317:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606272:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.242356:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 34 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.242378:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97600, rc 0) 00000100:00100000:1.0:1746143851.242418:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:3186:x1830963625336064:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 10607us (10835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.242424:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17346 00000100:00100000:3.0:1746143851.243614:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625336448:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 9609us (9887us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.243622:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7608 00002000:00100000:3.0:1746143851.243631:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880091bdce00 x1830963625336448/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.243644:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bdce00 with x1830963625336448 ext(3145728->4194303) 00002000:00010000:3.0:1746143851.243648:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bdce00 00000100:00100000:2.0:1746143851.250348:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625337088:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 8449us (8664us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.250361:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7610 00002000:00100000:2.0:1746143851.250375:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880091bde680 x1830963625337088/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.250387:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bde680 with x1830963625337088 ext(0->1048575) 00002000:00010000:2.0:1746143851.250394:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bde680 00000100:00100000:0.0:1746143851.250480:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.250515:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625337216 00000100:00100000:2.0:1746143851.250524:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625337216 00010000:00010000:2.0:1746143851.250658:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.250694:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8532 00000100:00100000:2.0:1746143851.250699:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625337216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.250710:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.250727:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.250736:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.250758:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77600/0x87925e4cb73b6eeb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412bed expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.250774:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.250776:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.250783:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.250789:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.250826:0:7229:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 33 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.250839:0:7229:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627606400:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.250908:0:7229:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.253026:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.253055:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.253534:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.253581:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625337344 00000100:00100000:1.0:1746143851.253590:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625337344 00000100:00100000:3.0:1746143851.253609:0:7229:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7229:1830963627606400:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143851.253628:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625337472 00010000:00010000:3.0:1746143851.253629:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.253630:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625337472 00000100:00100000:1.0:1746143851.253645:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17347 00000100:00100000:1.0:1746143851.253651:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625337344:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143851.253668:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625337216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2968us (3189us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143851.253669:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143851.253677:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8532 00010000:00010000:1.0:1746143851.253685:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e01 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.253707:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.253709:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.253716:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 22 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.253730:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 22 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.253741:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96400, rc 0) 00000100:00100000:1.0:1746143851.253759:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625337344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 109us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.253764:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17347 00000100:00100000:1.0:1746143851.253775:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17348 00000100:00100000:1.0:1746143851.253779:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625337472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.253786:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.253794:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b7241 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e08 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.253826:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625337728 00000100:00100000:1.0:1746143851.253829:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606528:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.253830:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625337728 00002000:00100000:2.0:1746143851.253858:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1761280->1765375) req@ffff880087df7480 x1830963625337728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.253868:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7480 with x1830963625337728 ext(1761280->1765375) 00002000:00010000:2.0:1746143851.253872:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087df7480 00000100:00100000:2.0:1746143851.253886:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7611 00000100:00100000:2.0:1746143851.253893:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625337728:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:2.0:1746143851.254019:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625337728:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 127us (485us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143851.254026:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7611 00002000:00100000:2.0:1746143851.254030:0:29558:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x3be:0x0] (1761280->1765375) req@ffff880087df7480 x1830963625337728/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.254037:0:29558:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7480 with x1830963625337728 ext(1761280->1765375) 00002000:00010000:2.0:1746143851.254040:0:29558:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087df7480 00000100:00100000:1.0:1746143851.254201:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.255515:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.255756:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625337984 00000100:00100000:3.0:1746143851.255763:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625337984 00002000:00100000:3.0:1746143851.255802:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880087df4700 x1830963625337984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 504/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.255810:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4700 with x1830963625337984 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.255814:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087df4700 00000100:00100000:3.0:1746143851.255886:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7612 00000100:00100000:3.0:1746143851.255893:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625337984:12345-192.168.202.3@tcp:3:multiop.0 00002000:00010000:1.0:1746143851.257972:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime: 1746143850 -> 1746143851 00002000:00010000:1.0:1746143851.257980:0:12327:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143850 -> 1746143851 00002000:00010000:1.0:1746143851.257982:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime: 1746143850 -> 1746143851 00000100:00100000:1.0:1746143851.257998:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606528:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143851.258035:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b7241 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e08 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.258049:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b7241 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e08 expref: 14 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.258078:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96e00, rc 0) 00000100:00100000:1.0:1746143851.258107:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625337472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4325us (5050us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143851.258114:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17348 00000100:00100000:3.0:1746143851.263479:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625337984:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 7575us (7955us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746143851.263492:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7612 00002000:00100000:3.0:1746143851.263812:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880087df4700 x1830963625337984/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 504/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.263825:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df4700 with x1830963625337984 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.263830:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087df4700 00000100:00100000:0.0:1746143851.264445:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.264591:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625338240 00000100:00100000:3.0:1746143851.264600:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625338240 00002000:00100000:3.0:1746143851.264635:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880087df7b80 x1830963625338240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.264641:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7b80 with x1830963625338240 ext(4194304->4853759) 00002000:00010000:3.0:1746143851.264644:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df7b80 00000100:00100000:3.0:1746143851.264670:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7613 00000100:00100000:3.0:1746143851.264677:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625338240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143851.272477:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.272665:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.272683:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625338368 00000100:00100000:1.0:1746143851.272696:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625338368 00000100:00100000:0.0:1746143851.272754:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.272784:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625338496 00000100:00100000:0.0:1746143851.272787:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625338496 00000100:00100000:0.0:1746143851.272808:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625338624 00000100:00100000:0.0:1746143851.272810:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625338624 00000100:00100000:0.0:1746143851.272826:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17349 00000100:00100000:0.0:1746143851.272834:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625338368:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:1.0:1746143851.272848:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17350 00000100:00100000:1.0:1746143851.272853:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625338496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.272864:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.272882:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b7248 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e16 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.272973:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606656:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143851.273053:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00010000:00010000:0.0:1746143851.273199:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143851.273210:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e0f expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.273227:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.273230:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.273239:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 35 pid: 3134 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143851.273266:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17351 00010000:00010000:0.0:1746143851.273269:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 35 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143851.273278:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3200, rc 0) 00000100:00100000:3.0:1746143851.273283:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:3186:x1830963625338624:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.273300:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.273316:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e1d expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.273343:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.273351:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 7 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.273358:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 23 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.273364:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.273365:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.273368:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [1048576->1404927] (req 1048576->1404927) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.273399:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 23 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.273410:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 23 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.273420:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627606784:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.273478:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 7 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.273486:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 7 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.273493:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627606912:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.273513:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 36 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.273520:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 36 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.273524:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625338368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 689us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.273527:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627607040:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.273531:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17349 00000100:00100000:3.0:1746143851.273541:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.273640:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625338240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8962us (9196us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143851.273651:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7613 00002000:00100000:3.0:1746143851.273658:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880087df7b80 x1830963625338240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.273665:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7b80 with x1830963625338240 ext(4194304->4853759) 00002000:00010000:3.0:1746143851.273669:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df7b80 00000100:00100000:0.0:1746143851.277331:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.277366:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.277391:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625338752 00000100:00100000:2.0:1746143851.277394:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625338880 00000100:00100000:2.0:1746143851.277398:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625338880 00000100:00100000:0.0:1746143851.277399:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625338752 00010000:00010000:2.0:1746143851.277436:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 22 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.277436:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 8 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:0.0:1746143851.277462:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8533 00000100:00100000:2.0:1746143851.277468:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8534 00000100:00100000:0.0:1746143851.277469:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625338752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746143851.277472:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625338880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.277483:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.277483:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.277503:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 22 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.277503:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 8 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.277513:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 22 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.277745:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136634700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12327:1830963627606656:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143851.277779:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b7248 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e16 expref: 35 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.277789:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96600/0x87925e4cb73b7248 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e16 expref: 35 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.277802:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96600, rc 0) 00000100:00100000:1.0:1746143851.277859:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+34:2008:x1830963625338496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5005us (5195us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143851.277866:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17350 00000100:00100000:3.0:1746143851.278721:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627606784:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.278736:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627606912:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.278746:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627607040:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.278893:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 8 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.278932:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e512200/0x87925e4cb73b70dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d21 expref: 22 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.278954:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.279080:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625338880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1605us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.279087:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8534 00010000:00010000:0.0:1746143851.279168:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7122 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d44 expref: 8 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.279183:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.279255:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2010:x1830963625338752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1786us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.279260:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8533 00010000:00010000:3.0:1746143851.279415:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->1404927] (req 1048576->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.279419:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143851.279429:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523200, rc 0) 00000100:00100000:3.0:1746143851.279485:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:3186:x1830963625338624:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 6208us (6729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.279492:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17351 00000100:00100000:0.0:1746143851.279945:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625339008 00000100:00100000:0.0:1746143851.279952:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625339008 00010000:00010000:0.0:1746143851.279974:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 35 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.280005:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8535 00000100:00100000:0.0:1746143851.280012:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625339008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.280025:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.280043:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 35 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.280052:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 35 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.280064:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091380200/0x87925e4cb73b70b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412d13 expref: 35 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.280074:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.280076:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.280082:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.280089:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.280117:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.280129:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627607168:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.280892:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.280956:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.281222:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625339136 00000100:00100000:3.0:1746143851.281231:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625339136 00000100:00100000:3.0:1746143851.281287:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17352 00000100:00100000:3.0:1746143851.281294:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625339136:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.281307:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.281320:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73b725d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e24 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.281360:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627607296:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.281434:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.281453:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.281470:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625339264 00000100:00100000:2.0:1746143851.281474:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625339264 00000100:00100000:2.0:1746143851.281500:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17353 00000100:00100000:2.0:1746143851.281505:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625339264:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.281516:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.281530:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b7264 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e2b expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.281560:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627607424:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.281598:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.283800:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.283966:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627607168:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.283986:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.284163:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627607296:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.284190:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73b725d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e24 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.284204:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137600/0x87925e4cb73b725d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e24 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.284218:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137600, rc 0) 00000100:00100000:3.0:1746143851.284240:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625339136:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2947us (3285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.284262:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17352 00000100:00100000:3.0:1746143851.284295:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625339520 00000100:00100000:3.0:1746143851.284300:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625339520 00000100:00100000:2.0:1746143851.284514:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625339008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4019us (4611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.284524:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8535 00002000:00010000:2.0:1746143851.284578:0:12327:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143850 -> 1746143851 00002000:00010000:2.0:1746143851.284581:0:12327:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime: 1746143850 -> 1746143851 00000100:00100000:2.0:1746143851.284591:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627607424:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.284608:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b7264 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e2b expref: 22 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.284616:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ae00/0x87925e4cb73b7264 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e2b expref: 22 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.284623:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8ae00, rc 0) 00000100:00100000:2.0:1746143851.284655:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625339264:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3149us (3203us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.284660:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17353 00002000:00100000:3.0:1746143851.284794:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8801368e8e00 x1830963625339520/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.284804:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8e00 with x1830963625339520 ext(2097152->3145727) 00002000:00010000:3.0:1746143851.284808:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8e00 00000100:00100000:3.0:1746143851.284824:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7614 00000100:00100000:3.0:1746143851.284830:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625339520:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143851.285488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.285613:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625339776 00000100:00100000:1.0:1746143851.285618:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625339776 00002000:00100000:1.0:1746143851.285635:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1400832->1404927) req@ffff8801368ead80 x1830963625339776/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.285642:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ead80 with x1830963625339776 ext(1400832->1404927) 00002000:00010000:1.0:1746143851.285645:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ead80 00000100:00100000:1.0:1746143851.285655:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7615 00000100:00100000:1.0:1746143851.285659:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625339776:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.285723:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625339776:12345-192.168.202.3@tcp:3:cat.0 Request processed in 63us (236us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143851.285728:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7615 00002000:00100000:1.0:1746143851.285732:0:29556:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x39e:0x0] (1400832->1404927) req@ffff8801368ead80 x1830963625339776/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.285738:0:29556:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ead80 with x1830963625339776 ext(1400832->1404927) 00002000:00010000:1.0:1746143851.285744:0:29556:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ead80 00000100:00100000:0.0:1746143851.289907:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.290798:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.290973:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625339904 00000100:00100000:3.0:1746143851.290983:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625339904 00000100:00100000:3.0:1746143851.291025:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625340032 00000100:00100000:3.0:1746143851.291027:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625340032 00000100:00100000:3.0:1746143851.291044:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17354 00000100:00100000:3.0:1746143851.291050:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625339904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.291068:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.291085:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b726b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e32 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.291133:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627607552:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.291204:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.291221:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17355 00000100:00100000:3.0:1746143851.291226:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625340032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.291233:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.291253:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73b7272 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e39 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.291278:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627607680:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.291312:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.295398:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.295462:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625340288 00000100:00100000:2.0:1746143851.295471:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625340288 00000100:00100000:2.0:1746143851.295527:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5535 00000100:00100000:2.0:1746143851.295535:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+288:3186:x1830963625340288:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143851.295615:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627607552:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.295648:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b726b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e32 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.295661:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137a00/0x87925e4cb73b726b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e32 expref: 14 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.295684:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137a00, rc 0) 00000100:00100000:3.0:1746143851.296652:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2011:x1830963625339904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5597us (6753us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.296661:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17354 00000100:00100000:3.0:1746143851.296714:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627607680:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.296734:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73b7272 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e39 expref: 22 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.296745:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137e00/0x87925e4cb73b7272 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e39 expref: 22 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.296753:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137e00, rc 0) 00000100:00100000:3.0:1746143851.296772:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625340032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5545us (5977us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.296777:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17355 00000100:00100000:2.0:1746143851.296986:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:3186:x1830963625340288:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 1450us (1609us total) trans 8589945277 rc 0/0 00000100:00100000:2.0:1746143851.296997:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5535 00000100:00100000:3.0:1746143851.299097:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625339520:12345-192.168.202.3@tcp:3:cat.0 Request processed in 14258us (15294us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.299106:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7614 00002000:00100000:3.0:1746143851.299117:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff8801368e8e00 x1830963625339520/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.299126:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8e00 with x1830963625339520 ext(2097152->3145727) 00002000:00010000:3.0:1746143851.299131:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8e00 00000100:00100000:0.0:1746143851.305457:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.305548:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625340416 00000100:00100000:3.0:1746143851.305558:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625340416 00000100:00100000:3.0:1746143851.305601:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17356 00000100:00100000:3.0:1746143851.305607:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:3190:x1830963625340416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.305626:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.305642:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e40 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.305678:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.305685:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.305687:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.305690:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.305719:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 12 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.305728:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 12 pid: 12327 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.305739:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627607808:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.306941:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.309655:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9585:1830963627607808:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.309656:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143851.309687:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 35 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.309707:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136600, rc 0) 00000100:00100000:2.0:1746143851.309721:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625340544 00000100:00100000:2.0:1746143851.309730:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625340544 00000100:00100000:3.0:1746143851.309755:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+35:3190:x1830963625340416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4147us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.309762:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17356 00002000:00100000:2.0:1746143851.309775:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3534847) req@ffff8801368e8700 x1830963625340544/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.309785:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8700 with x1830963625340544 ext(3145728->3534847) 00010000:00010000:2.0:1746143851.309792:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 13 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.309805:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 13 pid: 12327 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.309811:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368e8700 00000100:00100000:2.0:1746143851.309827:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2784 00000100:00100000:2.0:1746143851.309834:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2009:x1830963625340544:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143851.318377:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625340544:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8532us (8718us total) trans 21474841374 rc 0/0 00000100:00100000:2.0:1746143851.318387:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2784 00002000:00100000:2.0:1746143851.318398:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->3534847) req@ffff8801368e8700 x1830963625340544/t21474841374(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.318405:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8700 with x1830963625340544 ext(3145728->3534847) 00010000:00010000:2.0:1746143851.318414:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.318431:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.318435:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801368e8700 00000100:00100000:0.0:1746143851.321841:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.321968:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625340672 00000100:00100000:2.0:1746143851.321978:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625340672 00010000:00010000:2.0:1746143851.322017:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.322042:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8536 00000100:00100000:2.0:1746143851.322049:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625340672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.322062:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.322082:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.322094:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.322116:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97800/0x87925e4cb73b722c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3534847) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412df3 expref: 15 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.322146:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.322148:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.322156:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.322168:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.322202:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.322213:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627607936:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.322423:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.324627:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627607936:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.324648:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.324884:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2009:x1830963625340672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2833us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.324895:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8536 00000100:00100000:0.0:1746143851.333198:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.333391:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.333502:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625341056 00000100:00100000:2.0:1746143851.333512:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625341056 00000100:00100000:1.0:1746143851.333521:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625341184 00000100:00100000:1.0:1746143851.333525:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625341184 00002000:00100000:2.0:1746143851.333560:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8801368e8a80 x1830963625341056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.333560:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8801368eb800 x1830963625341184/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.333569:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb800 with x1830963625341184 ext(2097152->4194303) 00002000:00100000:2.0:1746143851.333572:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8a80 with x1830963625341056 ext(3145728->4194303) 00002000:00010000:1.0:1746143851.333575:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb800 00002000:00010000:2.0:1746143851.333576:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8a80 00000100:00100000:2.0:1746143851.333610:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7616 00000100:00100000:2.0:1746143851.333618:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625341056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.333746:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7617 00000100:00100000:1.0:1746143851.333753:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625341184:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143851.343887:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625341056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10259us (10691us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.343903:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7616 00002000:00100000:2.0:1746143851.343943:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8801368e8a80 x1830963625341056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.343953:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8a80 with x1830963625341056 ext(3145728->4194303) 00002000:00010000:2.0:1746143851.343959:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8a80 00000100:00100000:1.0:1746143851.347066:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625341184:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13300us (13661us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746143851.347083:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7617 00002000:00100000:1.0:1746143851.347095:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8801368eb800 x1830963625341184/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.347104:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb800 with x1830963625341184 ext(2097152->4194303) 00002000:00010000:1.0:1746143851.347109:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb800 00000100:00100000:0.0:1746143851.356377:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.356493:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625341440 00000100:00100000:1.0:1746143851.356504:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625341440 00002000:00100000:1.0:1746143851.356558:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8801368ebb80 x1830963625341440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.356568:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963625341440 ext(4194304->4853759) 00002000:00010000:1.0:1746143851.356574:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ebb80 00000100:00100000:1.0:1746143851.356611:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7618 00000100:00100000:1.0:1746143851.356619:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625341440:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.364524:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625341440:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7893us (8147us total) trans 0 rc 659456/659456 00000100:00100000:1.0:1746143851.364537:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7618 00002000:00100000:1.0:1746143851.364550:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8801368ebb80 x1830963625341440/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.364558:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368ebb80 with x1830963625341440 ext(4194304->4853759) 00002000:00010000:1.0:1746143851.364565:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368ebb80 00000100:00100000:0.0:1746143851.375300:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.375450:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625341696 00000100:00100000:2.0:1746143851.375462:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625341696 00000100:00100000:2.0:1746143851.377706:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5536 00000100:00100000:2.0:1746143851.377722:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+289:3190:x1830963625341696:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1746143851.378013:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+290:3190:x1830963625341696:12345-192.168.202.3@tcp:35:cat.0 Request processed in 297us (3106us total) trans 8589945278 rc 0/0 00000100:00100000:2.0:1746143851.378020:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5536 00000100:00100000:0.0:1746143851.389745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.389842:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625341824 00000100:00100000:2.0:1746143851.389852:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625341824 00000100:00100000:2.0:1746143851.389948:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14163 00000100:00100000:2.0:1746143851.389957:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625341824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.389985:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.390005:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b7280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e47 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.390068:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390082:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390092:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390106:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390111:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390116:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390190:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390201:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.390207:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.390237:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.390261:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 33 pid: 7244 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.390273:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627608064:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.390434:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222780 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.391730:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.391791:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342080 00000100:00100000:3.0:1746143851.391798:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342080 00000100:00100000:2.0:1746143851.391813:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627608064:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.391830:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143851.391847:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5537 00000100:00100000:3.0:1746143851.391854:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:8585:x1830963625342080:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746143851.392225:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+35:8585:x1830963625342080:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 370us (502us total) trans 8589945279 rc 0/0 00000100:00100000:3.0:1746143851.392232:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5537 00000100:00100000:0.0:1746143851.395032:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.395109:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342208 00000100:00100000:2.0:1746143851.395118:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342208 00010000:00010000:2.0:1746143851.395154:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 35 pid: 7244 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.395190:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8537 00000100:00100000:2.0:1746143851.395198:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625342208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.395212:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.395218:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 35 pid: 7244 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.395230:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 35 pid: 7244 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.395263:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092b25a00/0x87925e4cb73b71ae lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412db4 expref: 35 pid: 7244 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.395282:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.395285:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.395292:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.395297:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.395330:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.395383:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963625342208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 184us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.395390:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8537 00010000:00010000:3.0:1746143851.395466:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395473:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143851.395525:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143851.395530:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143851.395548:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395557:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395568:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395574:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395579:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395591:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395596:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.395601:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395607:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395616:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143851.395618:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143851.395621:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395626:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849e00/0x87925e4cb73b7287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395636:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395641:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395645:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395650:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.395652:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395660:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395666:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800937ac300) 00010000:00010000:3.0:1746143851.395668:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143851.395670:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395679:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77600/0x87925e4cb73b728e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.395716:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b7280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.395729:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 13 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.395734:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.395736:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143851.395738:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77e00, rc 0) 00000100:00100000:3.0:1746143851.395764:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:3196:x1830963625341824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5809us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.395770:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14163 00000100:00100000:0.0:1746143851.398424:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.398467:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.398494:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.398572:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.398580:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342336 00000100:00100000:2.0:1746143851.398591:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342336 00000100:00100000:1.0:1746143851.398596:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342464 00000100:00100000:1.0:1746143851.398600:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342464 00000100:00100000:1.0:1746143851.398633:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342592 00000100:00100000:1.0:1746143851.398635:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342592 00000100:00100000:2.0:1746143851.398639:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342720 00000100:00100000:2.0:1746143851.398642:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342720 00000100:00100000:1.0:1746143851.398652:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17357 00000100:00100000:1.0:1746143851.398659:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2011:x1830963625342464:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143851.398671:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17358 00010000:00010000:1.0:1746143851.398675:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143851.398676:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625342336:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.398684:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.398692:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b729c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e55 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.398695:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e4e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.398714:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.398716:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.398724:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.398737:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 10 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143851.398747:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627608192:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.398748:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76200, rc 0) 00000100:00100000:2.0:1746143851.398787:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625342336:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 110us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.398793:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17358 00000100:00100000:1.0:1746143851.398805:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.398824:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17359 00000100:00100000:1.0:1746143851.398830:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625342592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143851.398836:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.398844:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b72aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e5c expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.398867:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627608320:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143851.398886:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.399018:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17360 00000100:00100000:2.0:1746143851.399024:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625342720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.399031:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.399038:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e63 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.399048:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.399049:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.399054:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.399063:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.399070:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e76600, rc 0) 00000100:00100000:2.0:1746143851.399088:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625342720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 64us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.399093:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17360 00000100:00100000:0.0:1746143851.400045:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.400357:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625342848 00000100:00100000:2.0:1746143851.400364:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625342848 00000100:00100000:2.0:1746143851.400404:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17361 00000100:00100000:2.0:1746143851.400409:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625342848:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.400419:0:13430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.400430:0:13430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e6a expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.400444:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.400446:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.400452:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.400463:0:13430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.400473:0:13430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77800, rc 0) 00000100:00100000:3.0:1746143851.400506:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136635500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627608320:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.400512:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625342848:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.400517:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17361 00010000:00010000:3.0:1746143851.400532:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b72aa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e5c expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.400542:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97400/0x87925e4cb73b72aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e5c expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.400551:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97400, rc 0) 00000100:00100000:3.0:1746143851.400575:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625342592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1745us (2079us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.400581:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17359 00000100:00100000:1.0:1746143851.400625:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627608192:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143851.400640:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b729c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e55 expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.400648:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b96c00/0x87925e4cb73b729c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e55 expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.400772:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b96c00, rc 0) 00000100:00100000:1.0:1746143851.400792:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2011:x1830963625342464:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2133us (2324us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143851.400798:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17357 00000100:00100000:0.0:1746143851.402960:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.403023:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625343104 00000100:00100000:3.0:1746143851.403032:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625343104 00000100:00100000:3.0:1746143851.403090:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14164 00000100:00100000:3.0:1746143851.403205:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:3196:x1830963625343104:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.403225:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.403254:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b72bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e71 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.403361:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.403376:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.403383:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.403415:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.403426:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 14 pid: 14991 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.403437:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627608448:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.403529:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012154d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.405361:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.405378:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627608448:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.405423:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143851.405439:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625343232 00000100:00100000:2.0:1746143851.405445:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625343232 00010000:00010000:2.0:1746143851.405473:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 15 pid: 14991 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.405500:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8538 00000100:00100000:2.0:1746143851.405507:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625343232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.405521:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.405526:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 15 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.405535:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 15 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.405553:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e77e00/0x87925e4cb73b7295 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e47 expref: 15 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.405567:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.405572:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.405581:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.405587:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.405612:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.405652:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625343232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 145us (298us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143851.405659:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:2.0:1746143851.405659:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8538 00010000:00010000:3.0:1746143851.405665:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143851.405683:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143851.405811:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137400/0x87925e4cb73b72bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.405823:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.405829:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.405831:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143851.405833:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136800, rc 0) 00000100:00100000:3.0:1746143851.405853:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3196:x1830963625343104:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2757us (2901us total) trans 8589945280 rc 0/0 00000100:00100000:3.0:1746143851.405858:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14164 00000100:00100000:0.0:1746143851.407752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.407843:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625343360 00000100:00100000:3.0:1746143851.407851:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625343360 00000100:00100000:3.0:1746143851.408603:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14165 00000100:00100000:3.0:1746143851.408612:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3196:x1830963625343360:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.408640:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.408659:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137c00/0x87925e4cb73b72d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e78 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.409346:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.409363:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.409371:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.409406:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.409416:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 15 pid: 14991 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.409428:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627608576:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.409529:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.411891:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.412013:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625343488 00000100:00100000:2.0:1746143851.412021:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625343488 00000100:00100000:3.0:1746143851.412030:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627608576:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.412053:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.412055:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 16 pid: 14991 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.412080:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8539 00000100:00100000:2.0:1746143851.412088:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2010:x1830963625343488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.412102:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.412107:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 16 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.412118:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 16 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.412140:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136800/0x87925e4cb73b72c6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e71 expref: 16 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.412163:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.412167:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.412180:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.412187:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.412213:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.412262:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2010:x1830963625343488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 174us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.412269:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8539 00010000:00010000:3.0:1746143851.412380:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.412387:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143851.412438:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143851.412443:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143851.412462:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.412493:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137c00/0x87925e4cb73b72d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e78 expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.412510:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e78 expref: 14 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.412516:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.412518:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143851.412521:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00000100:00100000:3.0:1746143851.412547:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3196:x1830963625343360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3936us (4803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.412553:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14165 00000100:00100000:0.0:1746143851.416041:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.416135:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.416221:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625343616 00000100:00100000:1.0:1746143851.416231:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625343616 00000100:00100000:3.0:1746143851.416237:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625343744 00000100:00100000:3.0:1746143851.416253:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625343744 00000100:00100000:1.0:1746143851.416298:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17362 00000100:00100000:3.0:1746143851.416304:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17363 00000100:00100000:1.0:1746143851.416306:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625343616:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143851.416311:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625343744:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.416323:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.416323:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.416341:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73b72e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e86 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.416341:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b72e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e7f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.416394:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627608704:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143851.416394:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627608832:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.417197:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009600f240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.417279:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.419811:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627608832:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.419857:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b72e9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e7f expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.419873:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940f6600/0x87925e4cb73b72e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e7f expref: 10 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.419898:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800940f6600, rc 0) 00000100:00100000:3.0:1746143851.419962:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627608704:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.419981:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73b72e2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e86 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.419990:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092136000/0x87925e4cb73b72e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e86 expref: 10 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.420003:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136000, rc 0) 00000100:00100000:3.0:1746143851.420260:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625343744:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3948us (4123us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.420269:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17363 00000100:00100000:2.0:1746143851.420276:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625343616:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3970us (4244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.420282:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17362 00000100:00100000:0.0:1746143851.425572:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.425793:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344000 00000100:00100000:3.0:1746143851.425803:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344000 00000100:00100000:3.0:1746143851.425851:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14166 00000100:00100000:3.0:1746143851.425861:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:3196:x1830963625344000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.425882:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.425902:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b72f0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e8d expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.426025:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b72f7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.426040:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b72f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.426050:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b72f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143851.426061:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143851.426156:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136c00/0x87925e4cb73b72f0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e8d expref: 17 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.426170:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b72f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e8d expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.426183:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.426185:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143851.426189:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092136400, rc 0) 00000100:00100000:3.0:1746143851.426252:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:3196:x1830963625344000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 385us (682us total) trans 8589945281 rc 0/0 00000100:00100000:3.0:1746143851.426258:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14166 00000100:00100000:0.0:1746143851.431777:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.431806:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.431825:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.431840:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.431850:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.431873:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.431941:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344128 00000100:00100000:2.0:1746143851.431951:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344128 00000100:00100000:2.0:1746143851.431995:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344384 00000100:00100000:2.0:1746143851.431997:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344384 00000100:00100000:2.0:1746143851.432007:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344640 00000100:00100000:2.0:1746143851.432009:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344640 00000100:00100000:2.0:1746143851.432016:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344256 00000100:00100000:2.0:1746143851.432018:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344256 00000100:00100000:2.0:1746143851.432025:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344512 00000100:00100000:2.0:1746143851.432026:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344512 00000100:00100000:2.0:1746143851.432035:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344768 00000100:00100000:2.0:1746143851.432037:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344768 00000100:00100000:2.0:1746143851.432049:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17364 00000100:00100000:2.0:1746143851.432061:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625344128:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:0.0:1746143851.432081:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17365 00000100:00100000:0.0:1746143851.432087:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625344384:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143851.432108:0:1947:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.432108:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432124:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.432124:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 34 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.432131:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.432132:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143851.432133:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746143851.432137:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432138:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.432142:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.432143:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.432144:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432166:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 20 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143851.432166:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 34 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432176:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 20 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.432176:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 34 pid: 12327 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.432189:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627609088:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.432189:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627608960:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.432254:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17366 00000100:00100000:1.0:1746143851.432261:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625344640:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143851.432277:0:12328:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.432286:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.432292:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.432298:0:12328:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 33 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.432306:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.432307:0:12328:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.432308:0:12328:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.432323:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 33 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.432330:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 33 pid: 3134 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.432338:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627609216:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.432429:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143851.432429:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143851.432436:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 11 pid: 3135 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.432444:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627609344:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.432466:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 33 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432473:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 33 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.432481:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627609472:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.432496:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.432512:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17367 00000100:00100000:2.0:1746143851.432517:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625344256:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143851.432533:0:13436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432542:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432553:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.432560:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 34 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.432565:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.432567:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.432569:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432582:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 34 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.432589:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 34 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.432596:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627609600:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.432626:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 11 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.432633:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 11 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.432640:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627609728:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.432661:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 13 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432668:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 13 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.432676:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627609856:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.432692:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.432709:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17368 00000100:00100000:2.0:1746143851.432714:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625344512:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1746143851.432730:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432739:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432744:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.432745:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.432747:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432760:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 33 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432767:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 33 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.432778:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627609984:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.432796:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222600 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.432813:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17369 00000100:00100000:2.0:1746143851.432818:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625344768:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143851.432880:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.432887:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.432894:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627610112:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.432930:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432942:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.432949:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.432961:0:12328:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.432969:0:12328:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.432976:0:12328:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627610240:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.433074:0:12328:0:(client.c:2553:ptlrpc_set_wait()) set ffff88007b1b9300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143851.433143:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.433145:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.433147:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.433163:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 11 pid: 13430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.433170:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 11 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.433178:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627610368:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.433461:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 34 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.433470:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.433477:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627610496:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.433496:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.440984:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627609088:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.440998:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627609344:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.441029:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.441093:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625344896 00000100:00100000:1.0:1746143851.441101:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625344896 00000100:00100000:0.0:1746143851.441108:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.441125:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345024 00000100:00100000:0.0:1746143851.441128:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345024 00010000:00010000:0.0:1746143851.441147:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 21 pid: 12327 timeout: 1010 lvb_type: 1 00002000:00100000:1.0:1746143851.441149:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3be:0x0] (1761280->2097151) req@ffff880090e5a680 x1830963625344896/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.441157:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a680 with x1830963625344896 ext(1761280->2097151) 00010000:00010000:1.0:1746143851.441169:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.441185:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.441185:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8540 00002000:00010000:1.0:1746143851.441191:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e5a680 00000100:00100000:0.0:1746143851.441192:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625345024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143851.441205:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2785 00010000:00010000:0.0:1746143851.441205:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746143851.441209:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625344896:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143851.441213:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627608960:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.441227:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 21 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.441235:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.441237:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 21 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.441273:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96400/0x87925e4cb73b723a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e01 expref: 21 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.441292:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.441392:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625345024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 200us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.441399:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8540 00000100:00100000:1.0:1746143851.441402:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.441540:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345152 00000100:00100000:0.0:1746143851.441543:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345152 00010000:00010000:0.0:1746143851.441553:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 12 pid: 3135 timeout: 1010 lvb_type: 1 00000100:00100000:0.0:1746143851.441568:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8541 00000100:00100000:2.0:1746143851.441573:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627609472:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.441573:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625345152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.441578:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.441584:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 12 pid: 3135 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.441591:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 12 pid: 3135 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.441598:0:1947:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.441602:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76200/0x87925e4cb73b72a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e4e expref: 12 pid: 3135 timeout: 1010 lvb_type: 1 00010000:00010000:0.0:1746143851.441610:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.441627:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625345152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.441702:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627609984:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.441702:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627609216:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.441714:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.441725:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627610112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.441740:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.441751:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345408 00000100:00100000:1.0:1746143851.441752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.441753:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345408 00010000:00010000:3.0:1746143851.441766:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 37 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.441773:0:12328:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12328:1830963627610240:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.441779:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8542 00000100:00100000:3.0:1746143851.441783:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963625345408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.441791:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.441791:0:12328:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.441800:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 37 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.441808:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 37 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.441821:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.441835:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+37:2011:x1830963625345408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 51us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.441840:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8542 00000100:00100000:1.0:1746143851.441869:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627610368:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.441870:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551600/0x87925e4cb73b6e43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b99 expref: 36 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.441877:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627610496:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.441889:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627609600:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.441892:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.441897:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627609856:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.441973:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8541 00000100:00100000:2.0:1746143851.442055:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345536 00000100:00100000:2.0:1746143851.442058:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345536 00002000:00100000:2.0:1746143851.442077:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1404927) req@ffff880136637100 x1830963625345536/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.442084:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136637100 with x1830963625345536 ext(1048576->1404927) 00010000:00010000:2.0:1746143851.442089:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.442097:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.442104:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136637100 00000100:00100000:2.0:1746143851.442116:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2786 00000100:00100000:2.0:1746143851.442121:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625345536:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:3.0:1746143851.448228:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627609728:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.448228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143851.448275:0:13436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.448284:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.448310:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345920 00000100:00100000:2.0:1746143851.448317:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345920 00010000:00010000:2.0:1746143851.448353:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 12 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.448377:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346048 00000100:00100000:2.0:1746143851.448379:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346048 00010000:00010000:2.0:1746143851.448388:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 13 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.448411:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8543 00000100:00100000:2.0:1746143851.448418:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625345920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.448431:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.448452:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 13 pid: 13430 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.448461:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 13 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.448480:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8544 00010000:00010000:2.0:1746143851.448483:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77800/0x87925e4cb73b72b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e6a expref: 13 pid: 13430 timeout: 1010 lvb_type: 1 00000100:00100000:1.0:1746143851.448489:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2011:x1830963625346048:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.448498:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.448503:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143851.448508:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 12 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:1.0:1746143851.448516:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 12 pid: 9585 timeout: 1010 lvb_type: 1 00010000:00010000:1.0:1746143851.448528:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b6f93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412c48 expref: 12 pid: 9585 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.448543:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625345920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 126us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.448550:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8543 00010000:00010000:1.0:1746143851.448550:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.448571:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2011:x1830963625346048:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 83us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.448576:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8544 00000100:00100000:1.0:1746143851.448607:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.448620:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345280 00000100:00100000:1.0:1746143851.448623:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345280 00010000:00010000:1.0:1746143851.448636:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 36 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.448679:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.449940:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.449973:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345792 00000100:00100000:1.0:1746143851.449979:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345792 00010000:00010000:1.0:1746143851.450004:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.450073:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8545 00000100:00100000:3.0:1746143851.450083:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625345280:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.450095:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.450112:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 36 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.450121:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 36 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.450137:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408ce00/0x87925e4cb73b7225 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dec expref: 36 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.450150:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.450152:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.450157:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.450165:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.450191:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.450215:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625345280:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 134us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.450221:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8545 00000100:00100000:3.0:1746143851.450235:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8546 00000100:00100000:3.0:1746143851.450239:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625345792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.450255:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.450265:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.450273:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.450284:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76600/0x87925e4cb73b72b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e63 expref: 11 pid: 3135 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.450293:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.450307:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625345792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 68us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.450313:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8546 00000100:00100000:1.0:1746143851.452207:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625345664 00000100:00100000:1.0:1746143851.452219:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625345664 00010000:00010000:1.0:1746143851.452264:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.452296:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8547 00000100:00100000:1.0:1746143851.452303:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625345664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.452316:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.452334:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.452344:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.452364:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011e2db400/0x87925e4cb73b6dd3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412b61 expref: 14 pid: 1945 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.452378:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.452380:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.452384:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.452391:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.452417:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.452454:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+13:2008:x1830963625345664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 151us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.452459:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8547 00000100:00100000:0.0:1746143851.452771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.452797:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.452807:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346176 00000100:00100000:0.0:1746143851.452810:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346176 00010000:00010000:0.0:1746143851.452827:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.452839:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346432 00000100:00100000:0.0:1746143851.452841:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346432 00010000:00010000:0.0:1746143851.452848:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 36 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.452857:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8548 00000100:00100000:0.0:1746143851.452862:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625346176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.452870:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.452883:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.452891:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.452903:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012408ca00/0x87925e4cb73b7209 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dd0 expref: 20 pid: 13430 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.452933:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.452948:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625346176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.452951:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8549 00000100:00100000:0.0:1746143851.452954:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8548 00000100:00100000:1.0:1746143851.452955:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625346432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.452963:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.452970:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 38 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.452978:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 38 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.452989:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092136600/0x87925e4cb73b7279 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e40 expref: 38 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.452997:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.452998:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.453001:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.453007:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.453019:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.453033:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625346432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.453039:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8549 00010000:00010000:0.0:1746143851.453067:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453075:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453090:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453096:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453103:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453109:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800942a3e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143851.453113:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453120:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453134:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453140:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a3e00/0x87925e4cb73b7328 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.453178:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625344768:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 20359us (21304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.453184:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17369 00010000:00010000:0.0:1746143851.453214:0:1947:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453220:0:1947:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453231:0:1947:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453236:0:1947:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453251:0:1947:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453257:0:1947:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143851.453259:0:1947:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453265:0:1947:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453272:0:1947:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.453277:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76400/0x87925e4cb73b7305 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.453305:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2008:x1830963625344128:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 21250us (21538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.453310:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17364 00010000:00010000:2.0:1746143851.453792:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453800:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453812:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453818:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453824:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453829:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801338b4400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143851.453831:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453835:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453848:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.453854:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801338b4400/0x87925e4cb73b731a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.453884:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625344256:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 21367us (22042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.453889:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17367 00000100:00100000:0.0:1746143851.456760:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.456843:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346304 00000100:00100000:3.0:1746143851.456853:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346304 00010000:00010000:3.0:1746143851.456891:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 37 pid: 3134 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.457235:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8550 00000100:00100000:3.0:1746143851.457256:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625346304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.457346:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.457371:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 37 pid: 3134 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.457385:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 37 pid: 3134 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.457408:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3200/0x87925e4cb73b724f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e0f expref: 37 pid: 3134 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.457423:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.457425:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.457430:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.457438:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.457479:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143851.457504:0:12328:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457517:0:12328:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457539:0:12328:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457549:0:12328:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457555:0:12328:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457563:0:12328:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092b27e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143851.457566:0:12328:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457573:0:12328:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457588:0:12328:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.457594:0:12328:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b27e00/0x87925e4cb73b7313 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12328 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.458388:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625346304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1140us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.458396:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8550 00000100:00100000:1.0:1746143851.458555:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7448e42d-373a-41e0-9678-9a18291c6700+35:2011:x1830963625344896:12345-192.168.202.3@tcp:4:cat.0 Request processed in 17343us (17526us total) trans 21474841375 rc 0/0 00000100:00100000:1.0:1746143851.458569:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2785 00002000:00100000:1.0:1746143851.458580:0:9591:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3be:0x0] (1761280->2097151) req@ffff880090e5a680 x1830963625344896/t21474841375(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143851.458596:0:9591:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5a680 with x1830963625344896 ext(1761280->2097151) 00010000:00010000:1.0:1746143851.458604:0:9591:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.458616:0:9591:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00002000:00010000:1.0:1746143851.458621:0:9591:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e5a680 00000100:00100000:0.0:1746143851.458827:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2008:x1830963625344640:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 26561us (26994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.458837:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17366 00000100:00100000:0.0:1746143851.459004:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2011:x1830963625345536:12345-192.168.202.3@tcp:4:cat.0 Request processed in 16882us (17250us total) trans 17179874118 rc 0/0 00000100:00100000:0.0:1746143851.459011:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2786 00002000:00100000:0.0:1746143851.459019:0:9590:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1404927) req@ffff880136637100 x1830963625345536/t17179874118(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143851.459028:0:9590:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136637100 with x1830963625345536 ext(1048576->1404927) 00010000:00010000:0.0:1746143851.459034:0:9590:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.459048:0:9590:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00002000:00010000:0.0:1746143851.459054:0:9590:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136637100 00000100:00100000:2.0:1746143851.462744:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.464325:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.464440:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346560 00000100:00100000:2.0:1746143851.464450:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346560 00010000:00010000:2.0:1746143851.464483:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.464504:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346688 00000100:00100000:2.0:1746143851.464506:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346688 00010000:00010000:2.0:1746143851.464517:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.464530:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8551 00000100:00100000:2.0:1746143851.464535:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625346560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.464546:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143851.464555:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8552 00010000:00010000:2.0:1746143851.464560:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.464566:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+34:2009:x1830963625346688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.464574:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.464580:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.464591:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7233 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412dfa expref: 35 pid: 12327 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.464600:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.464605:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.464606:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.464609:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.464614:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.464616:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.464632:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e523200/0x87925e4cb73b7256 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1404927) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e1d expref: 34 pid: 9585 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.464635:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143851.464643:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.464645:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.464648:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464649:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464655:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.464656:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464666:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464672:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.464676:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143851.464682:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464687:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7c600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143851.464690:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464696:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464703:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.464707:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7c600/0x87925e4cb73b730c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.464712:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+33:2009:x1830963625346688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.464718:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8552 00000100:00100000:2.0:1746143851.464752:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2008:x1830963625344384:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 32666us (32945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.464758:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17365 00000100:00100000:2.0:1746143851.464779:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625346560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 244us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.464784:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8551 00010000:00010000:3.0:1746143851.464875:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464883:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464906:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464937:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464944:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464950:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5bb4a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143851.464953:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464959:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464973:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.464978:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb4a00/0x87925e4cb73b7321 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.465023:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2008:x1830963625344512:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 32308us (33170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.465031:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17368 00000100:00100000:2.0:1746143851.469083:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.469120:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625346944 00000100:00100000:0.0:1746143851.469132:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625346944 00000100:00100000:0.0:1746143851.469187:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14167 00000100:00100000:0.0:1746143851.469195:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+16:3196:x1830963625346944:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:0.0:1746143851.469257:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.469283:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092137200/0x87925e4cb73b72db lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e78 expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469299:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143851.469303:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143851.469330:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143851.469343:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469350:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 289 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469355:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469360:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 289 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469365:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469371:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469376:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 9/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143851.469405:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469416:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 33 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.469429:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627610624:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.469533:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469540:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 33 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.469546:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627610752:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.469572:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 289 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469578:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 289 pid: 7245 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.469584:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627610880:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.469605:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 33 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469611:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 33 pid: 7244 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.469617:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627611008:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.469639:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 289 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469645:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 289 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.469651:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627611136:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.469674:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 33 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.469681:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 33 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.469688:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009391ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627611264:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.469705:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.472863:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627610624:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.473041:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.473052:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627610752:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.473228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.473322:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347328 00000100:00100000:0.0:1746143851.473329:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347328 00000100:00100000:0.0:1746143851.473383:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5538 00000100:00100000:0.0:1746143851.473391:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+34:8586:x1830963625347328:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746143851.473603:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+35:8586:x1830963625347328:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 213us (375us total) trans 8589945282 rc 0/0 00000100:00100000:0.0:1746143851.473610:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5538 00000100:00100000:3.0:1746143851.473992:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347072 00000100:00100000:3.0:1746143851.473999:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347072 00010000:00010000:3.0:1746143851.474026:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.474064:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8553 00000100:00100000:3.0:1746143851.474072:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625347072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.474082:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.474088:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.474097:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.474115:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b6b25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129cb expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.474133:0:16784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.474137:0:16784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.474145:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.474179:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963625347072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 107us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.474185:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8553 00000100:00100000:0.0:1746143851.475090:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.475131:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627610880:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.475141:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.475143:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627611008:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.475151:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627611136:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.475158:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.475161:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009391ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627611264:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.475189:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143851.475193:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:0.0:1746143851.475208:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347456 00000100:00100000:1.0:1746143851.475211:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347584 00000100:00100000:0.0:1746143851.475213:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347456 00000100:00100000:1.0:1746143851.475215:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347584 00010000:00010000:1.0:1746143851.475229:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 34 pid: 7244 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.475233:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347840 00000100:00100000:2.0:1746143851.475236:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347840 00010000:00010000:0.0:1746143851.475236:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 290 pid: 7245 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.475254:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8554 00010000:00010000:2.0:1746143851.475257:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.475270:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347712 00000100:00100000:2.0:1746143851.475271:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8555 00000100:00100000:0.0:1746143851.475272:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347712 00000100:00100000:1.0:1746143851.475275:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8556 00000100:00100000:2.0:1746143851.475276:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+291:2009:x1830963625347456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143851.475279:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+35:2008:x1830963625347840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.475283:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 291 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475284:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.475285:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.475289:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 291 pid: 7245 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475289:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.475295:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8557 00010000:00010000:1.0:1746143851.475297:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.475301:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+291:2008:x1830963625347712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.475309:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.475313:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 291 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.475669:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 291 pid: 7245 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.475680:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 291 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475701:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9800/0x87925e4cb73b6b9c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a2d expref: 35 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.475705:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1e3ce00/0x87925e4cb73b6b17 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129bd expref: 291 pid: 7245 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475715:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143851.475716:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e504e00/0x87925e4cb73b6bc6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412a3b expref: 290 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475719:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.475725:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.475725:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143851.475727:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.475732:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143851.475734:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143851.475738:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143851.475746:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.475752:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+289:2009:x1830963625347456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 476us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.475752:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+34:2008:x1830963625347840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 473us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.475758:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8556 00000100:00100000:2.0:1746143851.475760:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8555 00000100:00100000:0.0:1746143851.475770:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+288:2008:x1830963625347712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 469us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.475777:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8557 00000100:00100000:1.0:1746143851.475779:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+33:2008:x1830963625347584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.475785:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.475789:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 33 pid: 7244 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475795:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 33 pid: 7244 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475805:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e33c00/0x87925e4cb73b6b10 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484129b6 expref: 33 pid: 7244 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.475813:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.475816:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.475820:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.475833:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963625347584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 573us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.475838:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8554 00000100:00100000:0.0:1746143851.477174:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.478775:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625347968 00000100:00100000:1.0:1746143851.478785:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625347968 00010000:00010000:1.0:1746143851.478816:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 32 pid: 7243 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.479366:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8558 00000100:00100000:1.0:1746143851.479374:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+32:2008:x1830963625347968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143851.479385:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.479391:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 32 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.479401:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 32 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.479418:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091381200/0x87925e4cb73b7050 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412cc6 expref: 32 pid: 7243 timeout: 1010 lvb_type: 0 00010000:00010000:1.0:1746143851.479432:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.479436:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.479444:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.479450:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.479473:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143851.479489:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.479494:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000040:00080000:1.0:1746143851.480491:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3339, 88 off281696 00000004:00080000:1.0:1746143851.480500:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910704587255ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.480549:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3323, 88 off279936 00000004:00080000:1.0:1746143851.480554:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910704641456ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.480565:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3324, 88 off280024 00000004:00080000:1.0:1746143851.480567:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910704655432ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.480579:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3340, 88 off281784 00000004:00080000:1.0:1746143851.480582:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910704669851ns, next at 850790015893ns, rc = 0 00000100:00100000:1.0:1746143851.483340:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+31:2008:x1830963625347968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3957us (6162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.483353:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8558 00000040:00080000:1.0:1746143851.483409:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3341, 88 off281872 00000004:00080000:1.0:1746143851.483418:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910707505572ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.484205:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3325, 88 off280112 00000004:00080000:1.0:1746143851.484209:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910708296885ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.484990:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3326, 88 off280200 00000004:00080000:1.0:1746143851.484995:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910709082679ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.485003:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3327, 88 off280288 00000004:00080000:1.0:1746143851.485006:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910709094302ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.485019:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3342, 88 off281960 00000004:00080000:1.0:1746143851.485023:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910709110662ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.485353:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3328, 88 off280376 00000004:00080000:1.0:1746143851.485357:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910709445268ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.485378:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3343, 88 off282048 00000004:00080000:1.0:1746143851.485381:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910709468543ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.485389:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3329, 88 off280464 00000004:00080000:1.0:1746143851.485391:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910709478904ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.485399:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3344, 88 off282136 00000004:00080000:1.0:1746143851.485402:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910709489693ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.485409:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3345, 88 off282224 00000004:00080000:1.0:1746143851.485411:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910709498938ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.485418:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3346, 88 off282312 00000004:00080000:1.0:1746143851.485420:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910709508089ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.485427:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3347, 88 off282400 00000004:00080000:1.0:1746143851.485430:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910709517459ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.485437:0:6587:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3330, 88 off280552 00000004:00080000:1.0:1746143851.485439:0:6587:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910709526867ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143851.492326:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945283 is committed 00000004:00080000:2.0:1746143851.492336:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2542 committed 00000004:00080000:2.0:1746143851.492343:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2562 committed 00000004:00080000:2.0:1746143851.492348:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2561 committed 00000004:00080000:2.0:1746143851.492349:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2560 committed 00000004:00080000:2.0:1746143851.492352:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2559 committed 00000004:00080000:2.0:1746143851.492353:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2541 committed 00000004:00080000:2.0:1746143851.492355:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2558 committed 00000004:00080000:2.0:1746143851.492357:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2540 committed 00000004:00080000:2.0:1746143851.492358:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2557 committed 00000004:00080000:2.0:1746143851.492359:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2539 committed 00000004:00080000:2.0:1746143851.492361:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2538 committed 00000004:00080000:2.0:1746143851.492362:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2537 committed 00000004:00080000:2.0:1746143851.492363:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2556 committed 00000004:00080000:2.0:1746143851.492365:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2555 committed 00000004:00080000:2.0:1746143851.492366:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2536 committed 00000004:00080000:2.0:1746143851.492368:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2535 committed 00000004:00080000:2.0:1746143851.492369:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2554 committed 00000001:00080000:2.0:1746143851.492373:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945282 is committed 00000001:00080000:2.0:1746143851.492382:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945278 is committed 00000100:00100000:2.0:1746143851.492567:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627611648:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.492617:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.492639:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627612160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.492652:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.492664:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143851.492668:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627611776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.492680:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.492689:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627612288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.492701:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.492718:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627611648 00000100:00100000:2.0:1746143851.492724:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627611648 00000100:00100000:2.0:1746143851.492748:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612160 00000100:00100000:2.0:1746143851.492750:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612160 00000100:00100000:2.0:1746143851.492759:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627611776 00000100:00100000:2.0:1746143851.492761:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627611776 00000100:00100000:2.0:1746143851.492770:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612288 00000100:00100000:2.0:1746143851.492771:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612288 00000100:00100000:2.0:1746143851.492781:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17370 00000100:00100000:2.0:1746143851.492787:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963627611648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.492803:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17371 00000100:00100000:1.0:1746143851.492810:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963627612160:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1746143851.492889:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009eb84a80 reply state ffff88009c518c00 transno 8589945283 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143851.492900:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3773:x1830963627611648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (282us total) trans 17179874119 rc 0/0 00010000:00010000:1.0:1746143851.492905:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143851.492906:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17370 00010000:00010000:1.0:1746143851.492930:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.492933:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143851.492936:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143851.492937:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17372 00000100:00100000:2.0:1746143851.492942:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3773:x1830963627611776:12345-0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746143851.492993:0:6587:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746143851.492996:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3773:x1830963627611776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (314us total) trans 17179874121 rc 0/0 00000100:00100000:2.0:1746143851.493001:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17372 00000100:00100000:1.0:1746143851.493004:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3196:x1830963625346944:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 23808us (23926us total) trans 8589945283 rc 0/0 00000100:00100000:2.0:1746143851.493009:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17373 00000100:00100000:1.0:1746143851.493010:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14167 00000100:00100000:2.0:1746143851.493012:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3773:x1830963627612288:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746143851.493026:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.493032:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.493038:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.493043:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a7de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143851.493047:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00002000:00010000:2.0:1746143851.493052:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00010000:00010000:1.0:1746143851.493052:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00002000:00010000:2.0:1746143851.493055:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.493057:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143851.493059:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.493061:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00010000:00010000:1.0:1746143851.493061:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.493063:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746143851.493065:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.493070:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a7de00/0x87925e4cb73b732f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143851.493077:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3773:x1830963627612288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (375us total) trans 17179874122 rc 0/0 00000100:00100000:2.0:1746143851.493082:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17373 00002000:00010000:1.0:1746143851.493098:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143851.493100:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143851.493102:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143851.493105:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143851.493107:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000004:00080000:2.0:1746143851.493112:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87b80/2, rc 0, transno 17179874121 00000100:00100000:2.0:1746143851.493119:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627611776:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143851.493126:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb84000/2, rc 0, transno 17179874122 00000100:00100000:1.0:1746143851.493127:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3773:x1830963627612160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 318us (474us total) trans 17179874120 rc 0/0 00000100:00100000:2.0:1746143851.493129:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627612288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.493133:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17371 00000004:00080000:2.0:1746143851.493135:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86680/2, rc 0, transno 17179874119 00000100:00100000:2.0:1746143851.493137:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627611648:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143851.493143:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86d80/2, rc 0, transno 17179874120 00000100:00100000:2.0:1746143851.493145:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627612160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493183:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627611392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493199:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.493211:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627611904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493224:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.493233:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627612416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493259:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.493282:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143851.493286:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627611520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493300:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.493309:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627612032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493322:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.493330:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627611392 00000100:00100000:0.0:1746143851.493333:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627611392 00000100:00100000:2.0:1746143851.493336:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627611904 00000100:00100000:2.0:1746143851.493338:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627611904 00000100:00100000:0.0:1746143851.493349:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612416 00000100:00100000:0.0:1746143851.493351:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612416 00000100:00100000:2.0:1746143851.493352:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627611520 00000100:00100000:2.0:1746143851.493354:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627611520 00000100:00100000:0.0:1746143851.493361:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612032 00000100:00100000:0.0:1746143851.493363:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612032 00000100:00100000:2.0:1746143851.493365:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17374 00000100:00100000:2.0:1746143851.493370:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627611392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.493374:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17375 00000100:00100000:0.0:1746143851.493378:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627611904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493424:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3771:x1830963627611392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (223us total) trans 17179874123 rc 0/0 00000100:00100000:2.0:1746143851.493429:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17374 00000100:00100000:2.0:1746143851.493438:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17376 00000100:00100000:0.0:1746143851.493439:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963627611904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (212us total) trans 17179874124 rc 0/0 00000100:00100000:2.0:1746143851.493443:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963627612416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.493444:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17375 00000100:00100000:0.0:1746143851.493454:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17377 00000100:00100000:0.0:1746143851.493458:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627611520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.493492:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3771:x1830963627612416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (232us total) trans 17179874125 rc 0/0 00000100:00100000:2.0:1746143851.493497:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17376 00000100:00100000:2.0:1746143851.493506:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17378 00000100:00100000:0.0:1746143851.493508:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963627611520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (206us total) trans 17179874126 rc 0/0 00000100:00100000:2.0:1746143851.493511:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963627612032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.493517:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17377 00000100:00100000:3.0:1746143851.494967:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627612672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.495581:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.495582:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627612800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.495600:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627613184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.495605:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.495615:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.495619:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627613312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.495633:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.495638:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612672 00000100:00100000:3.0:1746143851.495643:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612672 00000100:00100000:0.0:1746143851.495653:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612800 00000100:00100000:0.0:1746143851.495656:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612800 00000100:00100000:3.0:1746143851.495663:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627613184 00000100:00100000:3.0:1746143851.495665:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627613184 00000100:00100000:0.0:1746143851.495668:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627613312 00000100:00100000:0.0:1746143851.495670:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627613312 00000100:00100000:3.0:1746143851.495673:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17379 00000100:00100000:3.0:1746143851.495677:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963627612672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.495679:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17380 00000100:00100000:0.0:1746143851.495684:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3774:x1830963627612800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.496155:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3771:x1830963627612032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2642us (2830us total) trans 17179874127 rc 0/0 00000100:00100000:2.0:1746143851.496162:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17378 00000100:00100000:2.0:1746143851.496175:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17381 00000100:00100000:2.0:1746143851.496180:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3773:x1830963627613184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.496559:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17382 00000100:00100000:1.0:1746143851.496566:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3774:x1830963627613312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.496678:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3774:x1830963627613312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (1044us total) trans 21474841376 rc 0/0 00000100:00100000:1.0:1746143851.496684:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17382 00000004:00080000:1.0:1746143851.496713:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b09f80/2, rc 0, transno 21474841376 00000100:00100000:1.0:1746143851.496717:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627613312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.496779:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627612544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.496801:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.496809:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627612928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.496814:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627613056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.496828:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.496836:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612544 00000100:00100000:3.0:1746143851.496839:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612544 00000100:00100000:0.0:1746143851.496850:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627613056 00000100:00100000:0.0:1746143851.496853:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627613056 00000100:00100000:3.0:1746143851.496854:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17383 00000100:00100000:3.0:1746143851.496858:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627612544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.496869:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17384 00000100:00100000:0.0:1746143851.496873:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627613056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.496884:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.496896:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627613440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.496927:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746143851.496944:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb85180/2, rc 0, transno 17179874126 00000100:00100000:3.0:1746143851.496948:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627611520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143851.496956:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb86300/2, rc 0, transno 17179874127 00000100:00100000:3.0:1746143851.496959:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627612032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.496961:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000004:00080000:3.0:1746143851.496965:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87480/2, rc 0, transno 17179874123 00000100:00100000:3.0:1746143851.496968:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627611392:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143851.496974:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009eb87100/2, rc 0, transno 17179874124 00000100:00100000:0.0:1746143851.496974:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348096 00000100:00100000:3.0:1746143851.496976:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009eb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627611904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.496977:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348096 00000004:00080000:3.0:1746143851.496983:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801368eb100/2, rc 0, transno 17179874125 00000100:00100000:3.0:1746143851.496985:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627612416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.496997:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14168 00000100:00100000:3.0:1746143851.496998:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627612928 00000100:00100000:3.0:1746143851.497000:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627612928 00000100:00100000:0.0:1746143851.497002:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3196:x1830963625348096:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143851.497010:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627613440 00000100:00100000:3.0:1746143851.497011:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627613440 00010000:00010000:0.0:1746143851.497016:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143851.497019:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17385 00000100:00100000:3.0:1746143851.497023:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963627612928:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143851.497029:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e94 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.497068:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.497079:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143851.497083:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143851.497086:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143851.497088:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143851.497090:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143851.497091:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00010000:00010000:0.0:1746143851.497094:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143851.497096:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143851.497099:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97600, rc 0) 00000100:00100000:3.0:1746143851.497116:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627612928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (232us total) trans 21474841377 rc 0/0 00000100:00100000:3.0:1746143851.497121:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17385 00000100:00100000:0.0:1746143851.497123:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3196:x1830963625348096:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 120us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.497128:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14168 00000100:00100000:3.0:1746143851.497132:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17386 00000100:00100000:3.0:1746143851.497135:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3771:x1830963627613440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.497181:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3771:x1830963627613440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (269us total) trans 21474841378 rc 0/0 00000100:00100000:3.0:1746143851.497186:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17386 00000004:00080000:3.0:1746143851.497205:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b08a80/2, rc 0, transno 21474841377 00000100:00100000:3.0:1746143851.497208:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627612928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143851.497213:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0bb80/2, rc 0, transno 21474841378 00000100:00100000:3.0:1746143851.497216:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627613440:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143851.497354:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:2.0:1746143851.497356:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.497358:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143851.497359:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.497361:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:2.0:1746143851.497382:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627613184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1203us (1766us total) trans 21474841379 rc 0/0 00000100:00100000:2.0:1746143851.497388:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17381 00000004:00080000:2.0:1746143851.497413:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0aa00/2, rc 0, transno 21474841379 00000100:00100000:2.0:1746143851.497416:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627613184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.497496:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627612672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1818us (1914us total) trans 21474841380 rc 0/0 00000100:00100000:3.0:1746143851.497501:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17379 00000100:00100000:2.0:1746143851.497827:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3772:x1830963627612544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 968us (1025us total) trans 21474841381 rc 0/0 00000100:00100000:2.0:1746143851.497833:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17383 00000100:00100000:1.0:1746143851.497844:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627613056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 970us (1014us total) trans 21474841382 rc 0/0 00000004:00080000:2.0:1746143851.497851:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b09180/2, rc 0, transno 21474841380 00000100:00100000:2.0:1746143851.497854:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627612672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.497863:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17384 00000100:00100000:0.0:1746143851.499060:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3774:x1830963627612800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3373us (3452us total) trans 21474841383 rc 0/0 00000100:00100000:0.0:1746143851.499067:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17380 00000004:00080000:0.0:1746143851.499095:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0ad80/2, rc 0, transno 21474841381 00000100:00100000:0.0:1746143851.499099:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627612544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143851.499106:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0a680/2, rc 0, transno 21474841382 00000100:00100000:0.0:1746143851.499108:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627613056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.499177:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0a300/2, rc 0, transno 21474841383 00000100:00100000:2.0:1746143851.499181:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627612800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.499598:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.499656:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348224 00000100:00100000:0.0:1746143851.499662:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348224 00000100:00100000:0.0:1746143851.499687:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14169 00000100:00100000:0.0:1746143851.499693:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3196:x1830963625348224:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143851.499702:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143851.499716:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b733d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412e9b expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.499775:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b7344 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143851.499785:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b7344 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143851.499793:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b7344 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143851.499814:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:0.0:1746143851.499817:0:14991:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746143851.499830:0:14991:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b7344 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143851.499849:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96400/0x87925e4cb73b733d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e9b expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.499877:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b7344 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e9b expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.499883:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143851.499885:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746143851.499887:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97400, rc 0) 00000100:00100000:0.0:1746143851.499932:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3196:x1830963625348224:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 238us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.499937:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14169 00000100:00100000:2.0:1746143851.503896:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.503999:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348352 00000100:00100000:0.0:1746143851.504012:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348352 00000100:00100000:0.0:1746143851.504252:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17387 00000100:00100000:0.0:1746143851.504263:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2011:x1830963625348352:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1746143851.504281:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143851.504301:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ea2 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746143851.504326:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6b, blocks: 0x800 00000100:00100000:2.0:1746143851.504328:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143851.504347:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.504349:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.504359:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143851.504362:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143851.504374:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 8 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143851.504411:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.504413:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348480 00000100:00100000:1.0:1746143851.504417:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348480 00000100:00100000:2.0:1746143851.504425:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.504446:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.504457:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348736 00000100:00100000:1.0:1746143851.504459:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348736 00000100:00100000:2.0:1746143851.504467:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348992 00000100:00100000:1.0:1746143851.504474:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348608 00000100:00100000:2.0:1746143851.504475:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348992 00000100:00100000:1.0:1746143851.504476:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348608 00000100:00100000:1.0:1746143851.504487:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625348864 00000100:00100000:1.0:1746143851.504489:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625348864 00000100:00100000:1.0:1746143851.504503:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17388 00000100:00100000:1.0:1746143851.504509:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625348480:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143851.504511:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17389 00000100:00100000:2.0:1746143851.504517:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17390 00010000:00010000:1.0:1746143851.504518:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143851.504521:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625348736:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143851.504523:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625348608:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143851.504530:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ea9 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.504535:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.504535:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746143851.504543:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a6a, atime: 0x68140a68, ctime: 0x68140a6a, blocks: 0x808 00010000:00010000:3.0:1746143851.504549:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412eb7 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.504549:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412eb0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.504552:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.504553:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143851.504557:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746143851.504565:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6b, blocks: 0x808 00002000:00010000:3.0:1746143851.504566:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6b, blocks: 0x808 00010000:00010000:1.0:1746143851.504566:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 10 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.504574:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b26c00, rc 0) 00010000:00010000:3.0:1746143851.504579:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.504579:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.504581:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.504582:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.504588:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.504588:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.504601:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.504601:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 11 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.504614:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5bb5200, rc 0) 00010000:00010000:2.0:1746143851.504614:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137c00, rc 0) 00000100:00100000:1.0:1746143851.504622:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625348480:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.504628:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17388 00000100:00100000:2.0:1746143851.504643:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625348608:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 120us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.504649:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17390 00010000:00010000:0.0:1746143851.504649:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97800, rc 0) 00000100:00100000:2.0:1746143851.504664:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17391 00000100:00100000:2.0:1746143851.504669:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625348864:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:3.0:1746143851.504676:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625348736:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 156us (313us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143851.504676:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143851.504676:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625348352:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 416us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.504682:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17389 00010000:00010000:2.0:1746143851.504683:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ebe expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.504686:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17387 00002000:00010000:2.0:1746143851.504692:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6b, blocks: 0x1510 00000100:00100000:3.0:1746143851.504695:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17392 00000100:00100000:3.0:1746143851.504700:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625348992:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.504700:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.504701:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.504705:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.504706:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.504713:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 10 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.504714:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ec5 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.504719:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137200, rc 0) 00002000:00010000:3.0:1746143851.504724:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6b, blocks: 0x1008 00010000:00010000:3.0:1746143851.504731:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.504732:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.504736:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143851.504736:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625348864:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 67us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.504741:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17391 00010000:00010000:3.0:1746143851.504745:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 11 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.504752:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848600, rc 0) 00000100:00100000:3.0:1746143851.504767:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625348992:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 67us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.504772:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17392 00000100:00100000:0.0:1746143851.509610:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.509656:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.509687:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.509705:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.509720:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.511625:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349248 00000100:00100000:1.0:1746143851.511638:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349248 00000100:00100000:1.0:1746143851.511682:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349504 00000100:00100000:1.0:1746143851.511684:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349504 00000100:00100000:0.0:1746143851.511766:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.512014:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349760 00000100:00100000:1.0:1746143851.512018:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349760 00000100:00100000:1.0:1746143851.512036:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349120 00000100:00100000:1.0:1746143851.512038:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349120 00000100:00100000:1.0:1746143851.512049:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349376 00000100:00100000:1.0:1746143851.512051:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349376 00000100:00100000:3.0:1746143851.512136:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349632 00000100:00100000:3.0:1746143851.512140:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349632 00000100:00100000:2.0:1746143851.512175:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17393 00000100:00100000:2.0:1746143851.512191:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625349248:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.512298:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625349248:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 113us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.512304:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17393 00000100:00100000:2.0:1746143851.512320:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17394 00000100:00100000:2.0:1746143851.512325:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625349504:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.512358:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625349504:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 33us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.512362:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17394 00000100:00100000:2.0:1746143851.512369:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17395 00000100:00100000:2.0:1746143851.512373:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625349760:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.512397:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625349760:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 23us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.512401:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17395 00000100:00100000:2.0:1746143851.512409:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17396 00000100:00100000:2.0:1746143851.512413:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625349120:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.512439:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625349120:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.512444:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17396 00000100:00100000:2.0:1746143851.512538:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17397 00000100:00100000:2.0:1746143851.512543:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625349376:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.512569:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625349376:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 26us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.512573:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17397 00000100:00100000:2.0:1746143851.512582:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17398 00000100:00100000:2.0:1746143851.512586:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625349632:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.512607:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625349632:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 20us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.512611:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17398 00000100:00100000:0.0:1746143851.519302:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.519342:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.519371:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.519382:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625349888 00000100:00100000:0.0:1746143851.519387:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.519392:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625349888 00000100:00100000:0.0:1746143851.519405:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.519415:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350016 00000100:00100000:1.0:1746143851.519422:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350016 00000100:00100000:0.0:1746143851.519483:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.519812:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350272 00000100:00100000:2.0:1746143851.519816:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350272 00000100:00100000:1.0:1746143851.519833:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350144 00000100:00100000:2.0:1746143851.519834:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350400 00000100:00100000:2.0:1746143851.519836:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350400 00000100:00100000:1.0:1746143851.519837:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350144 00000100:00100000:2.0:1746143851.519844:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350528 00000100:00100000:2.0:1746143851.519846:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350528 00000100:00100000:2.0:1746143851.519866:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17399 00000100:00100000:2.0:1746143851.519872:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625349888:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143851.519875:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17400 00000100:00100000:1.0:1746143851.519883:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625350272:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143851.520002:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625350272:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 119us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.520009:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17400 00000100:00100000:1.0:1746143851.520027:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17401 00000100:00100000:1.0:1746143851.520032:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2010:x1830963625350400:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143851.520128:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17402 00000100:00100000:0.0:1746143851.520136:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625350528:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143851.520207:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17403 00000100:00100000:3.0:1746143851.520214:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625350144:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143851.522417:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625349888:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 2538us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.522426:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17399 00000100:00100000:0.0:1746143851.522826:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2010:x1830963625350528:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 2689us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.522833:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17402 00000100:00100000:0.0:1746143851.522872:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17404 00000100:00100000:0.0:1746143851.522877:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625350016:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143851.522943:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625350016:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 65us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.522948:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17404 00000100:00100000:1.0:1746143851.523291:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625350400:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 3257us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.523298:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17401 00000100:00100000:3.0:1746143851.524190:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2010:x1830963625350144:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 3974us (4799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.524198:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17403 00000100:00100000:0.0:1746143851.529343:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.529438:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350656 00000100:00100000:3.0:1746143851.529446:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350656 00000100:00100000:2.0:1746143851.530678:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17405 00000100:00100000:2.0:1746143851.530689:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625350656:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143851.530837:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143851.530840:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.530842:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143851.530844:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.530845:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143851.530896:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625350656:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 210us (1558us total) trans 21474841384 rc 0/0 00000100:00100000:2.0:1746143851.530903:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17405 00000100:00100000:1.0:1746143851.536612:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.536695:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625350784 00000100:00100000:3.0:1746143851.536704:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625350784 00000100:00100000:3.0:1746143851.536740:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17406 00000100:00100000:3.0:1746143851.536747:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625350784:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:3.0:1746143851.536927:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143851.536930:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143851.536932:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143851.536933:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143851.536935:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:3.0:1746143851.536974:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625350784:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 227us (368us total) trans 17179874128 rc 0/0 00000100:00100000:3.0:1746143851.536980:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17406 00000100:00100000:0.0:1746143851.544291:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.544381:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625351040 00000100:00100000:2.0:1746143851.544389:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625351040 00000100:00100000:2.0:1746143851.545362:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7619 00000100:00100000:2.0:1746143851.545370:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625351040:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143851.545402:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.545413:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.545415:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.545420:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.545430:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.551780:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.551814:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.551890:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625351296 00000100:00100000:3.0:1746143851.551897:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625351296 00000100:00100000:3.0:1746143851.551956:0:29558:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625351552 00000100:00100000:3.0:1746143851.551959:0:29558:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625351552 00000100:00100000:3.0:1746143851.551981:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7620 00000100:00100000:3.0:1746143851.551987:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625351296:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143851.552015:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.552027:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.552029:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.552033:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.552044:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.552626:0:29558:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7621 00000100:00100000:3.0:1746143851.552631:0:29558:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625351552:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143851.552647:0:29558:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.552654:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.552655:0:29558:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.552657:0:29558:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.552663:0:29558:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.553614:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.553641:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.553662:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625351808 00000100:00100000:2.0:1746143851.553666:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625351808 00000100:00100000:2.0:1746143851.553693:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625352064 00000100:00100000:2.0:1746143851.553695:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625352064 00000100:00100000:2.0:1746143851.553707:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7622 00000100:00100000:2.0:1746143851.553711:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625351808:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143851.553727:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.553735:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.553737:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.553740:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.553746:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.554292:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7623 00000100:00100000:2.0:1746143851.554298:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625352064:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143851.554312:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.554319:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.554320:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.554322:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.554329:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.558841:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.558874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.558897:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.558937:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625352320 00000100:00100000:0.0:1746143851.558945:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625352320 00000100:00100000:0.0:1746143851.558984:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625352576 00000100:00100000:0.0:1746143851.558986:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625352576 00000100:00100000:0.0:1746143851.558997:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625352832 00000100:00100000:0.0:1746143851.558999:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625352832 00000100:00100000:0.0:1746143851.559013:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7624 00000100:00100000:0.0:1746143851.559020:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625352320:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143851.559048:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.559059:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.559060:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.559064:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.559075:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.559638:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7625 00000100:00100000:0.0:1746143851.559644:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2008:x1830963625352576:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143851.559663:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.559670:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.559671:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.559674:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.559683:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.560237:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7626 00000100:00100000:0.0:1746143851.560253:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2008:x1830963625352832:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143851.560267:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.560275:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.560276:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.560279:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.560285:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566937:0:29558:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566951:0:29558:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566959:0:29558:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566965:0:29558:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e523200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143851.566968:0:29558:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566975:0:29558:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566990:0:29558:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.566995:0:29558:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b7383 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29558 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.567057:0:29558:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2009:x1830963625351552:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 14421us (15237us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143851.567066:0:29558:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7621 00010000:00010000:2.0:1746143851.567253:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.567261:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.567266:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.567272:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e77c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143851.567275:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.567281:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.567291:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.567297:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77c00/0x87925e4cb73b7375 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.567339:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2008:x1830963625351040:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 21970us (23054us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746143851.567345:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7619 00010000:00010000:3.0:1746143851.567436:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.567442:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.567447:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.567453:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d849400 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143851.567455:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.567460:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.567468:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.567472:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d849400/0x87925e4cb73b737c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.567502:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625351296:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 15516us (15730us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.567508:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7620 00010000:00010000:3.0:1746143851.580836:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.580850:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.580858:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.580865:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143851.580869:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.580877:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.580893:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.580899:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76800/0x87925e4cb73b738a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.580992:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625351808:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 27275us (27376us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.581003:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7622 00010000:00010000:2.0:1746143851.590025:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.590039:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.590046:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.590052:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143851.590055:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.590062:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.590077:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.590082:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e76c00/0x87925e4cb73b7391 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.590138:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625352064:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 35836us (36493us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.590146:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7623 00010000:00010000:1.0:1746143851.594988:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.595001:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.595008:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.595013:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd84e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143851.595016:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.595024:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.595040:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.595046:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd84e00/0x87925e4cb73b7398 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.595107:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625352320:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 36083us (36269us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143851.595117:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7624 00010000:00010000:2.0:1746143851.597549:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.597560:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.597567:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.597573:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093716200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143851.597576:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.597581:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.597594:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.597603:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093716200/0x87925e4cb73b739f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.597671:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625352576:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 38024us (38793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.597679:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7625 00010000:00010000:2.0:1746143851.600144:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.600156:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.600163:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.600169:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093717600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143851.600172:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.600179:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.600191:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.600197:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093717600/0x87925e4cb73b73a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.600272:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625352832:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 40026us (41370us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.600280:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7626 00000100:00100000:1.0:1746143851.613444:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.613504:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353088 00000100:00100000:2.0:1746143851.613512:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353088 00000100:00100000:2.0:1746143851.613562:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14170 00000100:00100000:2.0:1746143851.613569:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3196:x1830963625353088:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1746143851.613609:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.613632:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97400/0x87925e4cb73b7344 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e9b expref: 9 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.613660:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.613666:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143851.613711:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.613721:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.613729:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00010000:2.0:1746143851.613817:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136634e00 reply state ffff8800a22cf000 transno 8589945284 ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.613826:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.613830:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.613833:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746143851.613835:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143851.613906:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3196:x1830963625353088:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 337us (468us total) trans 8589945284 rc 0/0 00000100:00100000:2.0:1746143851.613928:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14170 00000100:00100000:0.0:1746143851.615839:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.615940:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353216 00000100:00100000:2.0:1746143851.615947:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353216 00000100:00100000:2.0:1746143851.616554:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17407 00000100:00100000:2.0:1746143851.616562:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3196:x1830963625353216:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.616576:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.616588:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ecc expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.616610:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.616616:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.616618:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.616621:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.616646:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.616656:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.616665:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627613568:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.616787:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.618259:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627613568:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.618283:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.618301:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77600, rc 0) 00000100:00100000:2.0:1746143851.618330:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625353216:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1769us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.618337:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17407 00000100:00100000:0.0:1746143851.618785:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.618877:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353344 00000100:00100000:2.0:1746143851.618882:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353344 00010000:00010000:2.0:1746143851.618903:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.618938:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8559 00000100:00100000:2.0:1746143851.618943:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625353344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.618955:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.618973:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.618982:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.618999:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97800/0x87925e4cb73b734b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea2 expref: 12 pid: 9586 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.619013:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.619015:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.619020:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.619026:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.619047:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.619057:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627613696:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.619468:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.620893:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.620997:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627613696:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.621015:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.621039:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625353344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2096us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.621048:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8559 00000100:00100000:3.0:1746143851.621194:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353472 00000100:00100000:3.0:1746143851.621199:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353472 00000100:00100000:3.0:1746143851.621225:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17408 00000100:00100000:3.0:1746143851.621230:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3196:x1830963625353472:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.621253:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.621266:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ed3 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.621436:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.621443:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.621444:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.621448:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.621470:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.621478:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.621487:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627613824:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.621781:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.623074:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627613824:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.623091:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.623103:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e523200, rc 0) 00000100:00100000:3.0:1746143851.623143:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625353472:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1911us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.623149:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17408 00000100:00100000:0.0:1746143851.623495:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.623556:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353600 00000100:00100000:2.0:1746143851.623565:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353600 00010000:00010000:2.0:1746143851.623584:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.623602:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8560 00000100:00100000:2.0:1746143851.623607:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625353600:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.623619:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.623633:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.623641:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.623657:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b26c00/0x87925e4cb73b7352 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ea9 expref: 12 pid: 12327 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.623680:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.623681:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.623687:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.623694:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.623716:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.623728:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627613952:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.623765:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.625668:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.625754:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627613952:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.625769:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.625796:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625353600:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2188us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.625805:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8560 00000100:00100000:3.0:1746143851.625873:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353728 00000100:00100000:3.0:1746143851.625879:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353728 00000100:00100000:3.0:1746143851.625902:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17409 00000100:00100000:3.0:1746143851.625908:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3196:x1830963625353728:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.625946:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.625958:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412eda expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.625982:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.625988:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.625989:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.625992:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.626013:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.626022:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.626031:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627614080:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.626767:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.628126:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627614080:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.628148:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.628161:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:3.0:1746143851.628192:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625353728:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2284us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.628200:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17409 00000100:00100000:0.0:1746143851.629838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.630309:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353856 00000100:00100000:2.0:1746143851.630315:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353856 00010000:00010000:2.0:1746143851.630537:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.631169:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8561 00000100:00100000:2.0:1746143851.631178:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625353856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.631189:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.631206:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.631217:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.631236:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092137c00/0x87925e4cb73b7360 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb0 expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.631266:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.631268:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.631273:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.631280:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.631307:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.631317:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627614208:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.631645:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.633783:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.633990:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625353984 00000100:00100000:3.0:1746143851.633997:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625353984 00000100:00100000:3.0:1746143851.634039:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17410 00000100:00100000:3.0:1746143851.634046:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3196:x1830963625353984:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.634061:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.634074:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ee1 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.634095:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.634101:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.634103:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.634106:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.634129:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.634138:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.634148:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627614336:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.634214:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.634312:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627614208:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.634328:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.634350:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625353856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3173us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.634363:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8561 00000100:00100000:0.0:1746143851.637865:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.637966:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627614336:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.637990:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.638010:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74a00, rc 0) 00000100:00100000:3.0:1746143851.638054:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625353984:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4008us (4274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.638062:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17410 00000100:00100000:2.0:1746143851.638160:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354112 00000100:00100000:2.0:1746143851.638166:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354112 00010000:00010000:2.0:1746143851.638188:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.638214:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8562 00000100:00100000:2.0:1746143851.638221:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625354112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.638232:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.638258:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.638574:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.638594:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5bb5200/0x87925e4cb73b7359 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eb7 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:2.0:1746143851.638795:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.638797:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.638804:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.638811:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.638838:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.638848:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627614464:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.638907:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.640845:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.640949:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627614464:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.640967:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.640996:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625354112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2775us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.641005:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8562 00000100:00100000:3.0:1746143851.641052:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354240 00000100:00100000:3.0:1746143851.641057:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354240 00000100:00100000:3.0:1746143851.641403:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17411 00000100:00100000:3.0:1746143851.641410:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3196:x1830963625354240:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143851.641423:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.641436:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ee8 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.641457:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.641464:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.641465:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.641468:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.641488:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.641498:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.641512:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627614592:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.641563:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.643976:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627614592:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.644001:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.644015:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74400, rc 0) 00000100:00100000:3.0:1746143851.644048:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625354240:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2638us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.644056:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17411 00000100:00100000:0.0:1746143851.644258:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.644533:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354368 00000100:00100000:3.0:1746143851.644538:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354368 00010000:00010000:3.0:1746143851.644559:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.645026:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8563 00000100:00100000:3.0:1746143851.645033:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625354368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.645044:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.645062:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.645073:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.645135:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137200/0x87925e4cb73b7367 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ebe expref: 12 pid: 13436 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.645148:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.645149:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.645155:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.645162:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.645184:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.645193:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627614720:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.645253:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.648324:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627614720:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.648341:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.648520:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.648583:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354496 00000100:00100000:2.0:1746143851.648588:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354496 00000100:00100000:2.0:1746143851.648630:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17412 00000100:00100000:2.0:1746143851.648637:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:3196:x1830963625354496:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.648652:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.648667:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412eef expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.648692:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.648698:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.648700:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.648703:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.648728:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.648737:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:2.0:1746143851.648747:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627614848:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.649083:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2009:x1830963625354368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4049us (4823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.649091:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8563 00000100:00100000:2.0:1746143851.649987:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.653573:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087df5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627614848:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.653601:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 12 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.653615:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e77e00, rc 0) 00000100:00100000:2.0:1746143851.653653:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:3196:x1830963625354496:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5016us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.653661:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17412 00000100:00100000:0.0:1746143851.654494:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.654644:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354624 00000100:00100000:3.0:1746143851.654650:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354624 00010000:00010000:3.0:1746143851.654674:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00000100:00100000:3.0:1746143851.654700:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8564 00000100:00100000:3.0:1746143851.654706:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625354624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.654717:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.654733:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.654742:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.654761:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b736e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ec5 expref: 12 pid: 1947 timeout: 1010 lvb_type: 1 00010000:00010000:3.0:1746143851.654786:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.654788:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.654794:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.654802:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.654828:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.654837:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627614976:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.654893:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.657533:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:12362:1830963627614976:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.657552:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.658057:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625354624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3348us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.658067:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8564 00000100:00100000:0.0:1746143851.658615:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.658642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.658664:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.658686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.658702:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354880 00000100:00100000:0.0:1746143851.658707:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354880 00000100:00100000:0.0:1746143851.658728:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355136 00000100:00100000:0.0:1746143851.658730:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355136 00000100:00100000:0.0:1746143851.658739:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355392 00000100:00100000:0.0:1746143851.658740:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355392 00000100:00100000:0.0:1746143851.658747:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625354752 00000100:00100000:0.0:1746143851.658748:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625354752 00000100:00100000:0.0:1746143851.658758:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17413 00000100:00100000:0.0:1746143851.658763:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625354880:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143851.658862:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143851.658864:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143850 -> 1746143851 00002000:00010000:0.0:1746143851.658866:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143848 -> 1746143851 00002000:00010000:0.0:1746143851.658868:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143850 -> 1746143852 00002000:00010000:0.0:1746143851.658869:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143851.658889:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625354880:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 126us (276us total) trans 21474841385 rc 0/0 00000100:00100000:0.0:1746143851.658894:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17413 00000100:00100000:0.0:1746143851.658903:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17414 00000100:00100000:0.0:1746143851.658907:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625355136:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143851.658966:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143851.658968:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.658970:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.658971:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143851.658973:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143851.658986:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625355136:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 79us (345us total) trans 17179874129 rc 0/0 00000100:00100000:0.0:1746143851.658991:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17414 00000100:00100000:0.0:1746143851.659000:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17415 00000100:00100000:0.0:1746143851.659003:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625355392:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143851.659031:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143851.659033:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659035:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659036:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143851.659038:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143851.659048:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625355392:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 45us (384us total) trans 21474841386 rc 0/0 00000100:00100000:0.0:1746143851.659053:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17415 00000100:00100000:0.0:1746143851.659059:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17416 00000100:00100000:0.0:1746143851.659062:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625354752:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143851.659087:0:1945:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143851.659089:0:1945:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659091:0:1945:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659092:0:1945:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143851.659093:0:1945:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143851.659104:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625354752:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 41us (417us total) trans 17179874130 rc 0/0 00000100:00100000:0.0:1746143851.659107:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17416 00000100:00100000:0.0:1746143851.659132:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.659142:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355008 00000100:00100000:0.0:1746143851.659145:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355008 00000100:00100000:0.0:1746143851.659155:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17417 00000100:00100000:0.0:1746143851.659158:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625355008:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143851.659188:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143851.659190:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659192:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659194:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143851.659196:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143851.659211:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625355008:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 51us (77us total) trans 21474841387 rc 0/0 00000100:00100000:0.0:1746143851.659215:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17417 00000100:00100000:0.0:1746143851.659267:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.659280:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355264 00000100:00100000:0.0:1746143851.659283:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355264 00000100:00100000:0.0:1746143851.659297:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17418 00000100:00100000:0.0:1746143851.659301:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625355264:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143851.659338:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:0.0:1746143851.659340:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659342:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.659343:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143851.659345:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:0.0:1746143851.659359:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625355264:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 57us (92us total) trans 17179874131 rc 0/0 00000100:00100000:0.0:1746143851.659364:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17418 00000100:00100000:0.0:1746143851.662816:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.664856:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355648 00000100:00100000:1.0:1746143851.664868:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355648 00000100:00100000:1.0:1746143851.665375:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5539 00000100:00100000:1.0:1746143851.665384:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b495c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3196:x1830963625355648:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:1.0:1746143851.665443:0:7246:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b72f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e8d expref: 10 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.665484:0:7246:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746143851.665494:0:7246:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.665499:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746143851.665524:0:7246:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.665535:0:7246:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 10 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.665545:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830963627615104:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.666285:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.668969:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136637800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830963627615104:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.668991:0:7246:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000100:00100000:0.0:1746143851.669460:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.670348:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355776 00000100:00100000:3.0:1746143851.670354:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355776 00010000:00010000:3.0:1746143851.670380:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.670938:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8565 00000100:00100000:3.0:1746143851.670945:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625355776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.670957:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.670963:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.670973:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.670993:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7336 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e94 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.671021:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.671026:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.671034:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.671042:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.671060:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.671133:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2008:x1830963625355776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 187us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.671139:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8565 00010000:00010000:1.0:1746143851.671324:0:7246:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746143851.671331:0:7246:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000040:00080000:1.0:1746143851.672559:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3348, 88 off282488 00000004:00080000:1.0:1746143851.672566:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910896653217ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673047:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3331, 88 off280640 00000004:00080000:1.0:1746143851.673052:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897139615ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673065:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3332, 88 off280728 00000004:00080000:1.0:1746143851.673067:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897155123ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673076:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3349, 88 off282576 00000004:00080000:1.0:1746143851.673079:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897166473ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673216:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3350, 88 off282664 00000004:00080000:1.0:1746143851.673221:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897309035ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673235:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3333, 88 off280816 00000004:00080000:1.0:1746143851.673238:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897326266ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673257:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3334, 88 off280904 00000004:00080000:1.0:1746143851.673260:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897347805ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673268:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3335, 88 off280992 00000004:00080000:1.0:1746143851.673270:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897358041ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673278:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3351, 88 off282752 00000004:00080000:1.0:1746143851.673280:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897367797ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673286:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3336, 88 off281080 00000004:00080000:1.0:1746143851.673289:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897376853ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673295:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3352, 88 off282840 00000004:00080000:1.0:1746143851.673297:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897385022ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673304:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3337, 88 off281168 00000004:00080000:1.0:1746143851.673306:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897394026ns, next at 850789974850ns, rc = 0 00000040:00080000:1.0:1746143851.673312:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3353, 88 off282928 00000004:00080000:1.0:1746143851.673314:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897401913ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673320:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3354, 88 off283016 00000004:00080000:1.0:1746143851.673323:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897411001ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673329:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3355, 88 off283104 00000004:00080000:1.0:1746143851.673332:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897420020ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673339:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3356, 88 off283192 00000004:00080000:1.0:1746143851.673341:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910897429243ns, next at 850790015893ns, rc = 0 00000040:00080000:1.0:1746143851.673348:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3338, 88 off281256 00000004:00080000:1.0:1746143851.673351:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910897439325ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143851.675461:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945285 is committed 00000004:00080000:2.0:1746143851.675471:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2550 committed 00010000:00010000:1.0:1746143851.676039:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.676049:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.676059:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.676064:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e76600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:1.0:1746143851.676068:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.676074:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.676088:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.676090:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746143851.676093:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143851.676098:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e76600/0x87925e4cb73b73ad lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000004:00080000:2.0:1746143851.676188:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2571 committed 00000004:00080000:2.0:1746143851.676194:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2570 committed 00000004:00080000:2.0:1746143851.676196:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2569 committed 00000004:00080000:2.0:1746143851.676198:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2568 committed 00000004:00080000:2.0:1746143851.676200:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2549 committed 00000004:00080000:2.0:1746143851.676201:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2567 committed 00000004:00080000:2.0:1746143851.676203:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2548 committed 00000004:00080000:2.0:1746143851.676205:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2566 committed 00000004:00080000:2.0:1746143851.676206:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2547 committed 00000004:00080000:2.0:1746143851.676208:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2546 committed 00000004:00080000:2.0:1746143851.676209:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2545 committed 00000004:00080000:2.0:1746143851.676210:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2565 committed 00000004:00080000:2.0:1746143851.676212:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2564 committed 00000004:00080000:2.0:1746143851.676213:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2544 committed 00000004:00080000:2.0:1746143851.676215:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2543 committed 00000004:00080000:2.0:1746143851.676216:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2563 committed 00000100:00100000:0.0:1746143851.676342:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627615232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.676388:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.676409:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627615744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.676421:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.676435:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746143851.676439:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627615616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.676452:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.676463:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627616128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.676475:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.676495:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627615232 00000100:00100000:0.0:1746143851.676501:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627615232 00000100:00100000:0.0:1746143851.676523:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627615744 00000100:00100000:0.0:1746143851.676525:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627615744 00000100:00100000:0.0:1746143851.676533:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627615616 00000100:00100000:0.0:1746143851.676535:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627615616 00000100:00100000:0.0:1746143851.676542:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616128 00000100:00100000:0.0:1746143851.676544:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616128 00000100:00100000:0.0:1746143851.676553:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17419 00000100:00100000:0.0:1746143851.676558:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627615232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143851.676654:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143851.676657:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.676659:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.676661:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143851.676663:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143851.676687:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627615232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (299us total) trans 17179874132 rc 0/0 00000100:00100000:0.0:1746143851.676693:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17419 00000100:00100000:0.0:1746143851.676705:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17420 00000100:00100000:0.0:1746143851.676709:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627615744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.676755:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627615744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (332us total) trans 17179874133 rc 0/0 00000100:00100000:0.0:1746143851.676760:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17420 00000100:00100000:0.0:1746143851.676768:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17421 00000100:00100000:0.0:1746143851.676772:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627615616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.676814:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627615616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (361us total) trans 17179874134 rc 0/0 00000100:00100000:0.0:1746143851.676819:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17421 00000100:00100000:0.0:1746143851.676827:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17422 00000100:00100000:0.0:1746143851.676831:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3772:x1830963627616128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143851.676870:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:0.0:1746143851.676872:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143851.676874:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143851.676875:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143851.676877:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:0.0:1746143851.676893:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627616128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (416us total) trans 17179874135 rc 0/0 00000100:00100000:0.0:1746143851.676898:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17422 00000004:00080000:0.0:1746143851.676956:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7ad80/2, rc 0, transno 17179874134 00000100:00100000:0.0:1746143851.676962:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627615616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143851.676969:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79c00/2, rc 0, transno 17179874135 00000100:00100000:0.0:1746143851.676972:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627616128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143851.676977:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800972eb100/2, rc 0, transno 17179874132 00000100:00100000:0.0:1746143851.676979:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800972eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627615232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143851.676984:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7bb80/2, rc 0, transno 17179874133 00000100:00100000:0.0:1746143851.676987:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627615744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.677010:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627616256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.677028:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.677046:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616256 00000100:00100000:0.0:1746143851.677049:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616256 00000100:00100000:0.0:1746143851.677062:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17423 00000100:00100000:0.0:1746143851.677066:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3772:x1830963627616256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.677121:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3772:x1830963627616256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (92us total) trans 17179874136 rc 0/0 00000100:00100000:0.0:1746143851.677126:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17423 00000004:00080000:0.0:1746143851.677146:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e79f80/2, rc 0, transno 17179874136 00000100:00100000:0.0:1746143851.677149:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627616256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.677326:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627616640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677349:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677373:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627617152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677386:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677396:0:3771:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746143851.677399:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627616768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677412:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677421:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627617280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677431:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677446:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627615360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.677459:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677469:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627615872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.677480:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677488:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677499:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677508:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677518:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677527:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746143851.677531:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627615488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.677542:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677552:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.677565:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677573:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677586:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677593:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627617024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677603:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143851.677617:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616640 00000100:00100000:2.0:1746143851.677620:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616640 00000100:00100000:2.0:1746143851.677632:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627617152 00000100:00100000:2.0:1746143851.677633:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627617152 00000100:00100000:2.0:1746143851.677638:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616768 00000100:00100000:2.0:1746143851.677639:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616768 00000100:00100000:2.0:1746143851.677644:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627617280 00000100:00100000:2.0:1746143851.677645:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627617280 00000100:00100000:2.0:1746143851.677649:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627615360 00000100:00100000:2.0:1746143851.677650:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627615360 00000100:00100000:2.0:1746143851.677654:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627615872 00000100:00100000:2.0:1746143851.677655:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627615872 00000100:00100000:2.0:1746143851.677659:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616384 00000100:00100000:2.0:1746143851.677660:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616384 00000100:00100000:2.0:1746143851.677664:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616896 00000100:00100000:2.0:1746143851.677665:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616896 00000100:00100000:2.0:1746143851.677668:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627615488 00000100:00100000:2.0:1746143851.677669:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627615488 00000100:00100000:2.0:1746143851.677673:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616000 00000100:00100000:2.0:1746143851.677674:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616000 00000100:00100000:2.0:1746143851.677677:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627616512 00000100:00100000:2.0:1746143851.677678:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627616512 00000100:00100000:2.0:1746143851.677682:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627617024 00000100:00100000:2.0:1746143851.677683:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627617024 00000100:00100000:2.0:1746143851.677688:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17424 00000100:00100000:2.0:1746143851.677692:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627616640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143851.677740:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143851.677742:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.677744:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.677745:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143851.677746:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746143851.677763:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627616640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (414us total) trans 21474841388 rc 0/0 00000100:00100000:2.0:1746143851.677767:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17424 00000100:00100000:2.0:1746143851.677776:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17425 00000100:00100000:2.0:1746143851.677779:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627617152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677816:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627617152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (429us total) trans 21474841389 rc 0/0 00000100:00100000:2.0:1746143851.677820:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17425 00000100:00100000:2.0:1746143851.677827:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17426 00000100:00100000:2.0:1746143851.677830:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627616768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143851.677858:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143851.677860:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.677861:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143851.677863:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.677865:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143851.677876:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627616768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (464us total) trans 21474841390 rc 0/0 00000100:00100000:2.0:1746143851.677880:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17426 00000100:00100000:2.0:1746143851.677886:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17427 00000100:00100000:2.0:1746143851.677889:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3771:x1830963627617280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.677942:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627617280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (509us total) trans 21474841391 rc 0/0 00000100:00100000:2.0:1746143851.677946:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17427 00000100:00100000:2.0:1746143851.677953:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17428 00000100:00100000:2.0:1746143851.677956:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627615360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143851.677986:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143851.677988:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.677990:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.677992:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143851.677993:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143851.678007:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627615360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (548us total) trans 17179874137 rc 0/0 00000100:00100000:2.0:1746143851.678010:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17428 00000100:00100000:2.0:1746143851.678016:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17429 00000100:00100000:2.0:1746143851.678020:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627615872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.678052:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627615872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 32us (571us total) trans 17179874138 rc 0/0 00000100:00100000:2.0:1746143851.678057:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17429 00000100:00100000:2.0:1746143851.678062:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17430 00000100:00100000:2.0:1746143851.678066:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627616384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143851.678097:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143851.678099:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.678101:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.678102:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143851.678103:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143851.678119:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627616384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (618us total) trans 21474841392 rc 0/0 00000100:00100000:2.0:1746143851.678123:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17430 00000100:00100000:2.0:1746143851.678132:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17431 00000100:00100000:2.0:1746143851.678135:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627616896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.678179:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627616896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (659us total) trans 21474841393 rc 0/0 00000100:00100000:2.0:1746143851.678184:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17431 00000100:00100000:2.0:1746143851.678193:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432 00000100:00100000:2.0:1746143851.678197:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627615488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143851.678232:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:2.0:1746143851.678234:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.678235:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.678237:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143851.678248:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:2.0:1746143851.678267:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627615488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (724us total) trans 17179874139 rc 0/0 00000100:00100000:2.0:1746143851.678272:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432 00000100:00100000:2.0:1746143851.678280:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17433 00000100:00100000:2.0:1746143851.678284:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3773:x1830963627616000:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143851.678318:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746143851.678320:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.678322:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143851.678324:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.678325:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:2.0:1746143851.678341:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3773:x1830963627616000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (774us total) trans 17179874140 rc 0/0 00000100:00100000:2.0:1746143851.678345:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17433 00000100:00100000:2.0:1746143851.678414:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17434 00000100:00100000:2.0:1746143851.678418:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627616512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143851.678448:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143851.678450:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.678451:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:2.0:1746143851.678453:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143851.678454:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143851.678468:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627616512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (881us total) trans 21474841394 rc 0/0 00000100:00100000:2.0:1746143851.678471:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17434 00000100:00100000:2.0:1746143851.678478:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435 00000100:00100000:2.0:1746143851.678481:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627617024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746143851.678506:0:9585:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:2.0:1746143851.678508:0:9585:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.678510:0:9585:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143851.678511:0:9585:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143851.678513:0:9585:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00000100:00100000:2.0:1746143851.678524:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627617024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (920us total) trans 21474841395 rc 0/0 00000100:00100000:2.0:1746143851.678527:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435 00000004:00080000:2.0:1746143851.678547:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490e00/2, rc 0, transno 21474841390 00000100:00100000:2.0:1746143851.678550:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627616768:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678556:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493100/2, rc 0, transno 21474841391 00000100:00100000:2.0:1746143851.678558:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627617280:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678563:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e490700/2, rc 0, transno 21474841388 00000100:00100000:2.0:1746143851.678565:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627616640:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678569:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e491c00/2, rc 0, transno 21474841389 00000100:00100000:2.0:1746143851.678571:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627617152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678581:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b480/2, rc 0, transno 17179874139 00000100:00100000:2.0:1746143851.678583:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627615488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143851.678587:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78a80/2, rc 0, transno 17179874140 00000100:00100000:2.0:1746143851.678589:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143851.678593:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb4e00/2, rc 0, transno 21474841394 00000100:00100000:2.0:1746143851.678595:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678599:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493800/2, rc 0, transno 21474841395 00000100:00100000:2.0:1746143851.678601:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627617024:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678604:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78e00/2, rc 0, transno 17179874137 00000100:00100000:2.0:1746143851.678606:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627615360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143851.678610:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7a300/2, rc 0, transno 17179874138 00000100:00100000:2.0:1746143851.678612:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627615872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143851.678616:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cb7100/2, rc 0, transno 21474841392 00000100:00100000:2.0:1746143851.678617:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616384:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143851.678621:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493b80/2, rc 0, transno 21474841393 00000100:00100000:2.0:1746143851.678623:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627616896:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746143851.678784:0:7246:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b495c50 reply state ffff88009c51b400 transno 8589945285 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746143851.678800:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746143851.678806:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.678808:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746143851.678812:0:7246:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746143851.678816:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143851.678818:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746143851.678822:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b72f7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412e8d expref: 7 pid: 14991 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746143851.678887:0:7246:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746143851.678905:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b495c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3196:x1830963625355648:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 13523us (16096us total) trans 8589945285 rc 0/0 00000100:00100000:1.0:1746143851.678929:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5539 00010000:00010000:3.0:1746143851.678987:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.678994:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.678999:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.679003:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918b6600 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143851.679007:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.679011:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.679018:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.679020:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143851.679022:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746143851.679027:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918b6600/0x87925e4cb73b73de lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00000100:00100000:1.0:1746143851.684228:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.684405:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625355904 00000100:00100000:2.0:1746143851.684413:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625355904 00000100:00100000:2.0:1746143851.684468:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14171 00000100:00100000:2.0:1746143851.684475:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+6:3196:x1830963625355904:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143851.684495:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.684511:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ef6 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.684560:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.684571:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.684586:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.684588:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143851.684592:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529c00, rc 0) 00000100:00100000:2.0:1746143851.685108:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3196:x1830963625355904:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 632us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.685115:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14171 00000100:00100000:2.0:1746143851.688122:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.689187:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625356160 00000100:00100000:1.0:1746143851.689196:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625356160 00000100:00100000:1.0:1746143851.689321:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5540 00000100:00100000:1.0:1746143851.689329:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3196:x1830963625356160:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1746143851.689502:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3196:x1830963625356160:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 174us (1386us total) trans 8589945286 rc 0/0 00000100:00100000:1.0:1746143851.689508:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5540 00000100:00100000:0.0:1746143851.710603:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.711055:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625356416 00000100:00100000:2.0:1746143851.711063:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625356416 00000100:00100000:2.0:1746143851.711185:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14172 00000100:00100000:2.0:1746143851.711193:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+260:3207:x1830963625356416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.711211:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.711226:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73b73ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412efd expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.711297:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711308:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711317:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711328:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711333:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711338:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711425:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711433:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711439:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143851.711446:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143851.711500:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711678:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711819:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711825:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711829:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c528000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143851.711833:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711838:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711848:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143851.711850:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143851.711853:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711858:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528000/0x87925e4cb73b73f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711888:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711892:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711897:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711900:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c528400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143851.711903:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711907:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711927:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009704c500) 00010000:00010000:2.0:1746143851.711928:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143851.711930:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711934:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528400/0x87925e4cb73b73fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.711967:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528e00/0x87925e4cb73b73ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.711977:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 262 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.711983:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.711985:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143851.711987:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c529600, rc 0) 00000100:00100000:2.0:1746143851.712042:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:3207:x1830963625356416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 850us (1448us total) trans 8589945287 rc 0/0 00000100:00100000:2.0:1746143851.712048:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14172 00000100:00100000:3.0:1746143851.712733:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.712804:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625356672 00000100:00100000:2.0:1746143851.712809:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625356672 00000100:00100000:2.0:1746143851.712841:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14173 00000100:00100000:2.0:1746143851.712847:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+7:3205:x1830963625356672:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143851.712861:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.712946:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b740f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f04 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.712990:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.712998:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713004:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713013:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713018:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713023:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713071:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713079:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713083:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143851.713089:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143851.713130:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713134:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713139:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713144:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713147:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097107c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143851.713150:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713154:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713161:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143851.713163:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143851.713165:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713170:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107c00/0x87925e4cb73b7416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713181:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713186:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713190:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713194:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143851.713195:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713199:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713203:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88007f167200) 00010000:00010000:2.0:1746143851.713205:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143851.713207:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713211:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b741d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.713232:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c528200/0x87925e4cb73b740f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.713254:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.713260:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.713262:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143851.713264:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107600, rc 0) 00000100:00100000:2.0:1746143851.713295:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3205:x1830963625356672:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 448us (563us total) trans 8589945288 rc 0/0 00000100:00100000:2.0:1746143851.713300:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14173 00000100:00100000:0.0:1746143851.719488:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.719531:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.719541:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625356800 00000100:00100000:1.0:1746143851.719549:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625356800 00000100:00100000:1.0:1746143851.719591:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17436 00000100:00100000:1.0:1746143851.719598:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:3207:x1830963625356800:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.719614:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.719629:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f0b expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.719653:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.719659:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143851.719661:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143851.719665:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.719690:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.719700:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.719710:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627617408:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.719878:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.719894:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357056 00000100:00100000:0.0:1746143851.719896:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357056 00000100:00100000:0.0:1746143851.719943:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357312 00000100:00100000:0.0:1746143851.719945:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357312 00000100:00100000:1.0:1746143851.719996:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.719998:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14174 00000100:00100000:0.0:1746143851.720003:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+262:3202:x1830963625357056:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143851.720015:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143851.720025:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b7439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f12 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.720078:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14175 00000100:00100000:2.0:1746143851.720086:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3208:x1830963625357312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.720094:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.720104:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x87925e4cb73b7440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f19 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.720158:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143851.720249:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.720268:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.720278:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143851.720288:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143851.720388:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.720399:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.720404:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 5/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.720419:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x87925e4cb73b7440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.720420:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.720427:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.720434:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627617536:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143851.720480:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.720488:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 263 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:0.0:1746143851.720495:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627617664:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.720511:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a300 going to sleep for 11 seconds 00010000:00010000:2.0:1746143851.720550:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.720603:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.720606:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143851.720608:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.720614:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.720619:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107800, rc 0) 00000100:00100000:2.0:1746143851.720645:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3208:x1830963625357312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 560us (766us total) trans 8589945289 rc 0/0 00000100:00100000:2.0:1746143851.720651:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14175 00000100:00100000:2.0:1746143851.721652:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627617536:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.721653:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136636d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627617408:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.721670:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 34 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.721681:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6000, rc 0) 00000100:00100000:1.0:1746143851.721767:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+34:3207:x1830963625356800:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2168us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.721848:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17436 00000100:00100000:0.0:1746143851.724563:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.724599:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.724652:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357440 00000100:00100000:3.0:1746143851.724659:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357440 00000100:00100000:0.0:1746143851.724684:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143851.724687:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.724715:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357568 00000100:00100000:3.0:1746143851.724717:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357568 00000100:00100000:0.0:1746143851.724724:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357696 00000100:00100000:0.0:1746143851.724727:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357696 00010000:00010000:3.0:1746143851.724728:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.724743:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 264 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.724750:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8566 00000100:00100000:3.0:1746143851.724756:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625357440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143851.724762:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8567 00000100:00100000:0.0:1746143851.724767:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2009:x1830963625357568:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.724768:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.724773:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.724778:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.724786:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.724787:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.724795:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.724806:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x87925e4cb73b7424 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f04 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.724809:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e77600/0x87925e4cb73b73b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ecc expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.724823:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.724824:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.724825:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.724828:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.724831:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.724835:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.724839:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.724840:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.724870:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2009:x1830963625357568:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 102us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143851.724871:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 33 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.724875:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8567 00000100:00100000:3.0:1746143851.724882:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627617792:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.724891:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8568 00000100:00100000:0.0:1746143851.724895:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2011:x1830963625357696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.724901:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.724905:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 264 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.724927:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 264 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:0.0:1746143851.724937:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143851.724940:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143851.724945:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd540 going to sleep for 11 seconds 00010000:00010000:0.0:1746143851.724945:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143851.724950:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143851.724961:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.724976:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2011:x1830963625357696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.724981:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8568 00010000:00010000:3.0:1746143851.724985:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529600/0x87925e4cb73b7401 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412efd expref: 264 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.724995:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627617664:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.725010:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.725016:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143851.725020:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:3.0:1746143851.725034:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143851.725128:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b96e00/0x87925e4cb73b7439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.725140:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 263 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.725146:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.725148:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143851.725150:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb2c00, rc 0) 00000100:00100000:3.0:1746143851.725172:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:3202:x1830963625357056:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5169us (5641us total) trans 8589945290 rc 0/0 00000100:00100000:3.0:1746143851.725178:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14174 00000100:00100000:0.0:1746143851.726464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.726538:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357824 00000100:00100000:3.0:1746143851.726543:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357824 00000100:00100000:0.0:1746143851.726892:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.727184:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625357952 00000100:00100000:3.0:1746143851.727188:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625357952 00000100:00100000:2.0:1746143851.727192:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14176 00000100:00100000:2.0:1746143851.727200:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3208:x1830963625357824:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.727217:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.727230:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x87925e4cb73b7463 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f20 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.727268:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14177 00000100:00100000:3.0:1746143851.727273:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:3207:x1830963625357952:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.727280:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.727287:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b746a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f27 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.727300:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.727310:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b746a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f27 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.727320:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.727325:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143851.727406:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b746a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f27 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.727415:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.727429:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 264 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.727436:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.727438:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143851.727438:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627617920:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.727440:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012323bc00, rc 0) 00000100:00100000:3.0:1746143851.728033:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+264:3207:x1830963625357952:12345-192.168.202.3@tcp:101:cat.0 Request processed in 759us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.728039:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14177 00000100:00100000:2.0:1746143851.728053:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.728076:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627617792:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.728091:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.728115:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625357440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3359us (3558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.728121:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8566 00000100:00100000:0.0:1746143851.733264:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.733290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.733316:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.733322:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625358208 00000100:00100000:3.0:1746143851.733329:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625358208 00002000:00100000:3.0:1746143851.733364:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129e6f480 x1830963625358208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.733373:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6f480 with x1830963625358208 ext(0->1048575) 00002000:00010000:3.0:1746143851.733377:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6f480 00000100:00100000:3.0:1746143851.733397:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7627 00000100:00100000:3.0:1746143851.733403:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625358208:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143851.733417:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627617920:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.733437:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143851.733462:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625358592 00000100:00100000:2.0:1746143851.733464:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625358592 00000100:00100000:2.0:1746143851.733484:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14178 00000100:00100000:2.0:1746143851.733487:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+264:3202:x1830963625358592:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143851.733499:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.733501:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746143851.733517:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012323bc00/0x87925e4cb73b746a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f27 expref: 264 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.733545:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.733549:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733556:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733560:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733565:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143851.733574:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b7478 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f2e expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.733614:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143851.733622:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.733628:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.733633:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733636:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 6/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143851.733647:0:7243:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733662:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.733670:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.733680:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627618048:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.733747:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.733754:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 7 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.733761:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627618176:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.733777:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.733799:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625358336 00000100:00100000:2.0:1746143851.733802:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625358336 00010000:00010000:2.0:1746143851.733814:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 265 pid: 14991 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.733828:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8569 00000100:00100000:2.0:1746143851.733832:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+265:2009:x1830963625358336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.733839:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.733842:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 265 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.733849:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 265 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.733859:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb2c00/0x87925e4cb73b744e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f12 expref: 265 pid: 14991 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.733867:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.733869:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733875:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733880:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733886:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143851.733890:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143851.733899:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.733935:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963625358336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 101us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.733940:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8569 00010000:00010000:2.0:1746143851.733957:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.733962:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143851.733993:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143851.733997:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143851.734009:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143851.734030:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x87925e4cb73b7463 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.734040:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.734046:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.734051:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106800, rc 0) 00000100:00100000:2.0:1746143851.734068:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+11:3208:x1830963625357824:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6870us (7606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.734073:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14176 00000100:00100000:0.0:1746143851.743290:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.743415:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801368e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627618048:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.743474:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.743777:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625358720 00000100:00100000:3.0:1746143851.743784:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625358720 00010000:00010000:3.0:1746143851.743812:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.743833:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625358848 00000100:00100000:3.0:1746143851.743836:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625358848 00010000:00010000:3.0:1746143851.743845:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 8 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.743907:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627618176:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.743943:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746143851.744126:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8570 00000100:00100000:3.0:1746143851.744133:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+11:2008:x1830963625358720:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.744144:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.744150:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.744162:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.744178:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x87925e4cb73b7447 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f19 expref: 11 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.744190:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.744194:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143851.744200:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143851.744204:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.744235:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625358720:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 102us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.744249:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8570 00000100:00100000:3.0:1746143851.744281:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8571 00000100:00100000:3.0:1746143851.744285:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2009:x1830963625358848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.744289:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.744292:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 8 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.744299:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 8 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.744308:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c529c00/0x87925e4cb73b73e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ef6 expref: 8 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.744315:0:7229:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.744318:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143851.744322:0:7229:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143851.744325:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.744336:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+7:2009:x1830963625358848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.744339:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8571 00000100:00100000:0.0:1746143851.744506:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.745187:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625358976 00000100:00100000:2.0:1746143851.745192:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625358976 00010000:00010000:2.0:1746143851.745209:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 10 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.745227:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8572 00000100:00100000:2.0:1746143851.745232:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:2008:x1830963625358976:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.745249:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.745254:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 10 pid: 6587 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.745261:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 10 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.745270:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+34:2010:x1830963625358208:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11867us (12013us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746143851.745271:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106800/0x87925e4cb73b7471 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f20 expref: 10 pid: 6587 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.745277:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7627 00010000:00010000:2.0:1746143851.745279:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.745282:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00002000:00100000:3.0:1746143851.745284:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880129e6f480 x1830963625358208/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746143851.745288:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00002000:00100000:3.0:1746143851.745292:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6f480 with x1830963625358208 ext(0->1048575) 00010000:00010000:2.0:1746143851.745294:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00002000:00010000:3.0:1746143851.745295:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129e6f480 00010000:00010000:2.0:1746143851.745307:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.745321:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2008:x1830963625358976:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 89us (815us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143851.745323:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746143851.745327:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8572 00010000:00010000:3.0:1746143851.745328:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143851.745488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000040:00080000:3.0:1746143851.745529:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3357, 88 off283280 00000004:00080000:3.0:1746143851.745533:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969620901ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745559:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3339, 88 off281344 00000004:00080000:3.0:1746143851.745563:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969650513ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745574:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3340, 88 off281432 00000004:00080000:3.0:1746143851.745576:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969663913ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745584:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3358, 88 off283368 00000004:00080000:3.0:1746143851.745586:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969673983ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745592:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3359, 88 off283456 00000004:00080000:3.0:1746143851.745595:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969682765ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745602:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3341, 88 off281520 00000004:00080000:3.0:1746143851.745604:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969691633ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745626:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3342, 88 off281608 00000004:00080000:3.0:1746143851.745630:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969717571ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745636:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3343, 88 off281696 00000004:00080000:3.0:1746143851.745638:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969726333ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745645:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3360, 88 off283544 00000004:00080000:3.0:1746143851.745647:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969735213ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745654:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3344, 88 off281784 00000004:00080000:3.0:1746143851.745656:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969744226ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745663:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3361, 88 off283632 00000004:00080000:3.0:1746143851.745665:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969753246ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745672:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3345, 88 off281872 00000004:00080000:3.0:1746143851.745674:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969762271ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143851.745681:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3362, 88 off283720 00000004:00080000:3.0:1746143851.745684:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969771783ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745691:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3363, 88 off283808 00000004:00080000:3.0:1746143851.745693:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969780850ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745700:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3364, 88 off283896 00000004:00080000:3.0:1746143851.745702:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969790243ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745710:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3365, 88 off283984 00000004:00080000:3.0:1746143851.745712:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 910969799785ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143851.745719:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3346, 88 off281960 00000004:00080000:3.0:1746143851.745722:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 910969809835ns, next at 850789974850ns, rc = 0 00000100:00100000:2.0:1746143851.745750:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359104 00000100:00100000:2.0:1746143851.745753:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359104 00000100:00100000:2.0:1746143851.745991:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14179 00000100:00100000:2.0:1746143851.745996:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3208:x1830963625359104:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.746008:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.746018:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f35 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.746048:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143851.746054:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.746210:0:6587:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143851.746222:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.746236:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.746246:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143851.746248:0:6587:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.746254:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189d200, rc 0) 00000100:00100000:2.0:1746143851.746284:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3208:x1830963625359104:12345-192.168.202.3@tcp:101:cat.0 Request processed in 287us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.746292:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14179 00000001:00080000:2.0:1746143851.749122:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945291 is committed 00000004:00080000:2.0:1746143851.749136:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2558 committed 00000004:00080000:2.0:1746143851.749142:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2580 committed 00000004:00080000:2.0:1746143851.749154:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2579 committed 00000004:00080000:2.0:1746143851.749155:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2578 committed 00000004:00080000:2.0:1746143851.749157:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2577 committed 00000004:00080000:2.0:1746143851.749158:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2557 committed 00000004:00080000:2.0:1746143851.749160:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2576 committed 00000004:00080000:2.0:1746143851.749161:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2556 committed 00000004:00080000:2.0:1746143851.749162:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2575 committed 00000004:00080000:2.0:1746143851.749163:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2555 committed 00000004:00080000:2.0:1746143851.749165:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2554 committed 00000004:00080000:2.0:1746143851.749166:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2553 committed 00000004:00080000:2.0:1746143851.749170:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2574 committed 00000004:00080000:2.0:1746143851.749172:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2573 committed 00000004:00080000:2.0:1746143851.749173:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2552 committed 00000004:00080000:2.0:1746143851.749174:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2551 committed 00000004:00080000:2.0:1746143851.749175:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2572 committed 00000001:00080000:2.0:1746143851.749184:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945289 is committed 00000001:00080000:2.0:1746143851.749191:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945286 is committed 00010000:00010000:2.0:1746143851.749272:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f2e expref: 262 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.749284:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.749286:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746143851.749290:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.749298:0:7243:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.749299:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.749299:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627618688:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143851.749305:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.749335:0:7243:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.749383:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143851.749400:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.749408:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.749418:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.749423:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143851.749434:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.749443:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627619584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.749450:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.749456:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627618432 00000100:00100000:3.0:1746143851.749458:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749464:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627618432 00000100:00100000:1.0:1746143851.749474:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627618688 00000100:00100000:3.0:1746143851.749475:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627620096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.749480:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627618688 00000100:00100000:3.0:1746143851.749490:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749500:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627618944 00000100:00100000:0.0:1746143851.749503:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627618944 00000100:00100000:3.0:1746143851.749506:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746143851.749507:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619200 00000100:00100000:1.0:1746143851.749509:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619200 00000100:00100000:3.0:1746143851.749511:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009e492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.749517:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619584 00000100:00100000:0.0:1746143851.749519:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619584 00000100:00100000:1.0:1746143851.749521:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627620096 00000100:00100000:3.0:1746143851.749522:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143851.749523:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627620096 00000100:00100000:3.0:1746143851.749532:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.749532:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627618304 00000100:00100000:0.0:1746143851.749534:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627618304 00000100:00100000:1.0:1746143851.749536:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17437 00000100:00100000:1.0:1746143851.749542:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3774:x1830963627618432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.749543:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749545:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17438 00000100:00100000:3.0:1746143851.749550:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627619456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.749552:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3772:x1830963627618688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.749562:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.749568:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627619968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.749578:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143851.749594:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627618816 00000100:00100000:3.0:1746143851.749597:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627618816 00000100:00100000:3.0:1746143851.749611:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439 00000100:00100000:3.0:1746143851.749616:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627618944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.749640:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143851.749652:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627620352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.749669:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143851.749682:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746143851.749687:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627618560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.749700:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963627618944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (274us total) trans 17179874143 rc 0/0 00000100:00100000:0.0:1746143851.749703:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627618688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (302us total) trans 17179874141 rc 0/0 00000100:00100000:3.0:1746143851.749706:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439 00000100:00100000:1.0:1746143851.749706:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749710:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17438 00000100:00100000:1.0:1746143851.749713:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.749723:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749724:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619456 00000100:00100000:0.0:1746143851.749727:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619456 00000100:00100000:1.0:1746143851.749729:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.749730:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619968 00000100:00100000:3.0:1746143851.749733:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619968 00000100:00100000:0.0:1746143851.749738:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619840 00000100:00100000:1.0:1746143851.749739:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749740:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619840 00000100:00100000:3.0:1746143851.749743:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627620352 00000100:00100000:3.0:1746143851.749745:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627620352 00000100:00100000:1.0:1746143851.749745:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627620224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.749748:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627618560 00000100:00100000:0.0:1746143851.749750:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627618560 00000100:00100000:3.0:1746143851.749752:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619072 00000100:00100000:3.0:1746143851.749754:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619072 00000100:00100000:1.0:1746143851.749755:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143851.749760:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627619712 00000100:00100000:0.0:1746143851.749762:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627619712 00000100:00100000:3.0:1746143851.749764:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627620224 00000100:00100000:3.0:1746143851.749765:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627620224 00000100:00100000:0.0:1746143851.749774:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440 00000004:00080000:1.0:1746143851.749775:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6fb80/2, rc 0, transno 17179874141 00000100:00100000:3.0:1746143851.749779:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17441 00000100:00100000:0.0:1746143851.749779:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627619200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.749783:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627619584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.749783:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627618688:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143851.749815:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143851.749817:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:1.0:1746143851.749819:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:1.0:1746143851.749821:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:1.0:1746143851.749822:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:0.0:1746143851.749827:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb size from disk: 7114752 -> 7114752 00002000:00010000:0.0:1746143851.749829:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143851.749832:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143851.749834:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143851.749836:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x3a3:0x0] updating lvb blocks from disk: 5584 -> 5584 00000100:00100000:1.0:1746143851.749840:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963627618432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (458us total) trans 17179874142 rc 0/0 00002000:00010000:3.0:1746143851.749842:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143851.749845:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00000100:00100000:1.0:1746143851.749846:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17437 00002000:00010000:3.0:1746143851.749847:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:3.0:1746143851.749848:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:3.0:1746143851.749850:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143851.749858:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17442 00000100:00100000:0.0:1746143851.749860:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627619200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (425us total) trans 17179874144 rc 0/0 00000100:00100000:1.0:1746143851.749863:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963627620096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.749866:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440 00000100:00100000:3.0:1746143851.749871:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963627619584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (412us total) trans 21474841396 rc 0/0 00000100:00100000:0.0:1746143851.749875:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443 00000100:00100000:3.0:1746143851.749880:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17441 00000100:00100000:0.0:1746143851.749880:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627618304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.749891:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444 00000100:00100000:3.0:1746143851.749895:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627618816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746143851.749907:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb size from disk: 3969024 -> 3969024 00002000:00010000:1.0:1746143851.749929:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143851.749931:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143851.749933:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143851.749934:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3c1:0x0] updating lvb blocks from disk: 1488 -> 1488 00002000:00010000:0.0:1746143851.749939:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143851.749942:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.749943:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:0.0:1746143851.749945:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143851.749947:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746143851.749953:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3774:x1830963627620096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (462us total) trans 21474841397 rc 0/0 00000100:00100000:1.0:1746143851.749958:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17442 00000100:00100000:1.0:1746143851.749968:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17445 00000100:00100000:0.0:1746143851.749970:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963627618304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (446us total) trans 17179874145 rc 0/0 00000100:00100000:1.0:1746143851.749973:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627619456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.749975:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443 00000100:00100000:3.0:1746143851.749976:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963627618816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (431us total) trans 17179874146 rc 0/0 00000100:00100000:3.0:1746143851.749981:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444 00000100:00100000:0.0:1746143851.749987:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17446 00000100:00100000:0.0:1746143851.749992:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3774:x1830963627619968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.749993:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447 00000100:00100000:3.0:1746143851.749999:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627619840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.750010:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448 00000100:00100000:3.0:1746143851.750014:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627620352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143851.750016:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746143851.750019:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:1.0:1746143851.750020:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:1.0:1746143851.750022:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:1.0:1746143851.750023:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746143851.750040:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627619456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (477us total) trans 21474841398 rc 0/0 00000100:00100000:1.0:1746143851.750044:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17445 00000100:00100000:0.0:1746143851.750052:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3774:x1830963627619968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (471us total) trans 21474841399 rc 0/0 00000100:00100000:1.0:1746143851.750055:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17449 00000100:00100000:0.0:1746143851.750059:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17446 00000100:00100000:1.0:1746143851.750060:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627618560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.750070:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627620352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (400us total) trans 21474841400 rc 0/0 00000100:00100000:0.0:1746143851.750070:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17450 00000100:00100000:0.0:1746143851.750075:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3772:x1830963627619072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143851.750076:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448 00000100:00100000:3.0:1746143851.750088:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17451 00000100:00100000:3.0:1746143851.750092:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3772:x1830963627619712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746143851.750100:0:13436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:1.0:1746143851.750102:0:13436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:1.0:1746143851.750103:0:13436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:1.0:1746143851.750105:0:13436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:1.0:1746143851.750106:0:13436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00002000:00010000:0.0:1746143851.750120:0:13430:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143851.750122:0:13430:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000100:00100000:1.0:1746143851.750123:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3772:x1830963627618560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (416us total) trans 17179874147 rc 0/0 00002000:00010000:0.0:1746143851.750124:0:13430:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143851.750125:0:13430:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00000100:00100000:1.0:1746143851.750127:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17449 00002000:00010000:0.0:1746143851.750127:0:13430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00002000:00010000:3.0:1746143851.750128:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143851.750130:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143851 -> 1746143851 00002000:00010000:3.0:1746143851.750132:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143851 -> 1746143851 00002000:00010000:3.0:1746143851.750133:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143852 -> 1746143852 00002000:00010000:3.0:1746143851.750135:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143851.750138:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17452 00000100:00100000:1.0:1746143851.750142:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627620224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143851.750147:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3772:x1830963627619072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (423us total) trans 17179874148 rc 0/0 00000100:00100000:0.0:1746143851.750152:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17450 00000100:00100000:3.0:1746143851.750154:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627619712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (413us total) trans 21474841401 rc 0/0 00000100:00100000:3.0:1746143851.750158:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17451 00000004:00080000:3.0:1746143851.750195:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e492300/2, rc 0, transno 17179874145 00000100:00100000:3.0:1746143851.750198:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143851.750203:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6f800/2, rc 0, transno 17179874146 00000100:00100000:3.0:1746143851.750205:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618816:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.750209:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627620224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (452us total) trans 21474841402 rc 0/0 00000004:00080000:3.0:1746143851.750211:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9880/2, rc 0, transno 21474841398 00000100:00100000:3.0:1746143851.750214:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627619456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.750214:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17452 00000004:00080000:3.0:1746143851.750220:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373ba300/2, rc 0, transno 21474841399 00000100:00100000:3.0:1746143851.750223:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627619968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143851.750229:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373ba680/2, rc 0, transno 21474841396 00000100:00100000:3.0:1746143851.750232:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627619584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.750233:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627619328:192.168.202.3@tcp:105: 00000004:00080000:3.0:1746143851.750237:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bbb80/2, rc 0, transno 21474841397 00000004:00080000:1.0:1746143851.750237:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6ca80/2, rc 0, transno 17179874147 00000100:00100000:3.0:1746143851.750249:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627620096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143851.750250:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627618560:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143851.750259:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009e493480/2, rc 0, transno 17179874142 00000100:00100000:3.0:1746143851.750261:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009e493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618432:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143851.750261:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f6a300/2, rc 0, transno 17179874148 00000100:00100000:1.0:1746143851.750264:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619072:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143851.750268:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129e6dc00/2, rc 0, transno 17179874143 00000100:00100000:3.0:1746143851.750270:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627618944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143851.750271:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b8a80/2, rc 0, transno 21474841401 00000100:00100000:1.0:1746143851.750274:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143851.750276:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:1.0:1746143851.750279:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9500/2, rc 0, transno 21474841402 00000100:00100000:3.0:1746143851.750280:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627620480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143851.750282:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627620224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143851.750287:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092b71f80/2, rc 0, transno 21474841400 00000100:00100000:1.0:1746143851.750289:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627620352:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143851.750296:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f69880/2, rc 0, transno 17179874144 00000100:00100000:3.0:1746143851.750298:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143851.750298:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143851.750307:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.750331:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627620480 00000100:00100000:2.0:1746143851.750334:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627620480 00002000:00010000:3.0:1746143851.750350:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746143851.750350:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17453 00002000:00010000:3.0:1746143851.750353:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00000100:00100000:2.0:1746143851.750354:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3774:x1830963627620480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746143851.750359:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746143851.750361:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:3.0:1746143851.750363:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:3.0:1746143851.750387:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3772:x1830963627619840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 387us (746us total) trans 21474841403 rc 0/0 00000100:00100000:3.0:1746143851.750391:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447 00000004:00080000:3.0:1746143851.750412:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373bb480/2, rc 0, transno 21474841403 00000100:00100000:3.0:1746143851.750415:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627619840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143851.750421:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093414a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3774:x1830963627620480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (122us total) trans 17179874149 rc 0/0 00000100:00100000:2.0:1746143851.750426:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17453 00000004:00080000:3.0:1746143851.750429:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093414700/2, rc 0, transno 17179874149 00000100:00100000:3.0:1746143851.750432:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627620480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143851.751300:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.751359:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359232 00000100:00100000:1.0:1746143851.751364:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359232 00000100:00100000:1.0:1746143851.751394:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17454 00000100:00100000:1.0:1746143851.751399:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+34:3207:x1830963625359232:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.751408:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.751419:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f3c expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.751440:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.751447:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143851.751449:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143851.751452:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.751473:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.751483:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00000100:00100000:1.0:1746143851.751491:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c4d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627620608:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143851.751544:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.752635:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.752693:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359360 00000100:00100000:1.0:1746143851.752696:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359360 00000100:00100000:1.0:1746143851.752718:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5541 00000100:00100000:1.0:1746143851.752722:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+8:3208:x1830963625359360:12345-192.168.202.3@tcp:49:cat.0 00000100:00100000:1.0:1746143851.752785:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+8:3208:x1830963625359360:12345-192.168.202.3@tcp:49:cat.0 Request processed in 62us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.752790:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5541 00000100:00100000:2.0:1746143851.752945:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627619328:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.752955:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143851.752988:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092136400/0x87925e4cb73b7478 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f2e expref: 262 pid: 7243 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746143851.753013:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f2e expref: 261 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.753037:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268e00, rc 0) 00000100:00100000:2.0:1746143851.753074:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+261:3202:x1830963625358592:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 19585us (19756us total) trans 8589945291 rc 0/0 00000100:00100000:3.0:1746143851.753077:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359488 00000100:00100000:3.0:1746143851.753081:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359488 00000100:00100000:2.0:1746143851.753081:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14178 00000100:00100000:3.0:1746143851.753108:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14180 00000100:00100000:3.0:1746143851.753113:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+8:3205:x1830963625359488:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.753120:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.753131:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73b7494 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f43 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.753158:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73b7494 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f43 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.753169:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73b7494 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f43 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.753180:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.753182:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143851.753185:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133566200, rc 0) 00000100:00100000:3.0:1746143851.753202:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3205:x1830963625359488:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 89us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.753206:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14180 00000100:00100000:0.0:1746143851.753765:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.754734:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c4d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3135:1830963627620608:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143851.754756:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143851.754768:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918b6200, rc 0) 00000100:00100000:1.0:1746143851.754796:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:3207:x1830963625359232:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3397us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.754802:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17454 00000100:00100000:2.0:1746143851.754902:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359616 00000100:00100000:2.0:1746143851.754907:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359616 00010000:00010000:2.0:1746143851.754939:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00000100:00100000:2.0:1746143851.754956:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8573 00000100:00100000:2.0:1746143851.754961:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625359616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.754970:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.754984:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.754993:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.755008:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e523200/0x87925e4cb73b73bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ed3 expref: 14 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.755022:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.755024:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.755029:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.755035:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.755055:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 34 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.755065:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627620736:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.755105:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.755360:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.755390:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.755459:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.755512:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625360000 00000100:00100000:3.0:1746143851.755516:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625360000 00000100:00100000:3.0:1746143851.755541:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1030 00000100:00100000:3.0:1746143851.755546:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:2011:x1830963625360000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.755552:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.755563:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133566200/0x87925e4cb73b7494 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f43 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755573:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143851.755577:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.755596:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+8:2011:x1830963625360000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.755600:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1030 00000100:00100000:3.0:1746143851.755623:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359744 00000100:00100000:3.0:1746143851.755626:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359744 00000100:00100000:3.0:1746143851.755639:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625359872 00000100:00100000:3.0:1746143851.755640:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625359872 00000100:00100000:3.0:1746143851.755651:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17455 00000100:00100000:3.0:1746143851.755655:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+19:3208:x1830963625359744:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.755664:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.755673:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f4a expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755683:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.755684:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.755688:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755697:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 20 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755703:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133567200, rc 0) 00000100:00100000:3.0:1746143851.755718:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3208:x1830963625359744:12345-192.168.202.3@tcp:101:cat.0 Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.755723:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17455 00000100:00100000:3.0:1746143851.755732:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17456 00000100:00100000:3.0:1746143851.755736:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3205:x1830963625359872:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.755743:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.755749:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f51 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755760:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755764:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.755765:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.755767:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1212416->1626111] (req 1212416->1626111) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755789:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.755797:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.755805:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627620864:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.755825:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.757387:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627620736:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.757400:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.757453:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627620864:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.757473:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1212416->1626111] (req 1212416->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.757484:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133567400, rc 0) 00000100:00100000:3.0:1746143851.757567:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3205:x1830963625359872:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 1829us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.757569:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625359616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2604us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.757574:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17456 00000100:00100000:2.0:1746143851.757576:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8573 00000100:00100000:0.0:1746143851.759169:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.759563:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625360128 00000100:00100000:2.0:1746143851.759569:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625360128 00010000:00010000:2.0:1746143851.759597:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.759665:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8574 00000100:00100000:3.0:1746143851.759674:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625360128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.759685:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143851.759702:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.759711:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.759729:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b73c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eda expref: 13 pid: 3134 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.759740:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.759742:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.759747:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.759760:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.759795:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.759806:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627620992:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.759863:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.761038:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.761182:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625360256 00000100:00100000:3.0:1746143851.761186:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625360256 00000100:00100000:3.0:1746143851.761222:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17457 00000100:00100000:3.0:1746143851.761228:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:3202:x1830963625360256:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143851.761248:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.761258:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f58 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.761277:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.761283:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.761284:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.761287:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1454080->1609727] (req 1454080->1609727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.761306:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 13 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.761316:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 13 pid: 13436 timeout: 1010 lvb_type: 0 00000100:00100000:3.0:1746143851.761323:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627621120:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143851.761458:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e180 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.761789:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.761851:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625360512 00000100:00100000:3.0:1746143851.761855:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625360512 00002000:00100000:3.0:1746143851.761877:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092b71c00 x1830963625360512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.761891:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71c00 with x1830963625360512 ext(0->1048575) 00002000:00010000:3.0:1746143851.761895:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b71c00 00000100:00100000:3.0:1746143851.761907:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7628 00000100:00100000:3.0:1746143851.761928:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625360512:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143851.764142:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627621120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.764167:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1454080->1609727] (req 1454080->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.764181:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a8c00, rc 0) 00000100:00100000:3.0:1746143851.764227:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:3202:x1830963625360256:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2998us (3189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.764234:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17457 00000100:00100000:1.0:1746143851.764614:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.764715:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093417100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627620992:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.764727:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.764749:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625360128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5077us (5583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.764756:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8574 00000100:00100000:0.0:1746143851.764893:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625360768 00000100:00100000:0.0:1746143851.764898:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625360768 00002000:00100000:0.0:1746143851.764939:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d6300 x1830963625360768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143851.764947:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6300 with x1830963625360768 ext(1048576->2097151) 00002000:00010000:0.0:1746143851.764951:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d6300 00000100:00100000:0.0:1746143851.764964:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7629 00000100:00100000:0.0:1746143851.764970:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625360768:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.766406:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.766471:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625361024 00000100:00100000:2.0:1746143851.766477:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625361024 00002000:00100000:2.0:1746143851.766503:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1212416->1216511) req@ffff88009c4d7480 x1830963625361024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.766511:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7480 with x1830963625361024 ext(1212416->1216511) 00010000:00010000:2.0:1746143851.766519:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.766530:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.766535:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d7480 00000100:00100000:2.0:1746143851.766561:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2787 00000100:00100000:2.0:1746143851.766567:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625361024:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143851.766649:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625361024:12345-192.168.202.3@tcp:3:cat.0 Request processed in 81us (246us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143851.766654:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2787 00002000:00100000:2.0:1746143851.766660:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3be:0x0] (1212416->1216511) req@ffff88009c4d7480 x1830963625361024/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.766666:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7480 with x1830963625361024 ext(1212416->1216511) 00010000:00010000:2.0:1746143851.766670:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1010 lvb_type: 0 00010000:00010000:2.0:1746143851.766678:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1010 lvb_type: 0 00002000:00010000:2.0:1746143851.766683:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c4d7480 00000100:00100000:3.0:1746143851.769370:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625360512:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7450us (7574us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.769381:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7628 00002000:00100000:3.0:1746143851.769395:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092b71c00 x1830963625360512/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.769404:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b71c00 with x1830963625360512 ext(0->1048575) 00002000:00010000:3.0:1746143851.769409:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b71c00 00000100:00100000:2.0:1746143851.772413:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625360768:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7435us (7792us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.772424:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7629 00002000:00100000:2.0:1746143851.772433:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff88009c4d6300 x1830963625360768/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.772441:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d6300 with x1830963625360768 ext(1048576->2097151) 00002000:00010000:2.0:1746143851.772445:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d6300 00000100:00100000:0.0:1746143851.776575:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.777719:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.777852:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625361408 00000100:00100000:2.0:1746143851.777860:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625361408 00000100:00100000:3.0:1746143851.777872:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625361152 00000100:00100000:3.0:1746143851.777877:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625361152 00002000:00100000:2.0:1746143851.777897:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1622016->1626111) req@ffff880092b70a80 x1830963625361408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.777906:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70a80 with x1830963625361408 ext(1622016->1626111) 00000100:00100000:3.0:1746143851.777928:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17458 00000100:00100000:3.0:1746143851.777934:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:3207:x1830963625361152:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.777937:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1010 lvb_type: 0 00010000:00010000:3.0:1746143851.777946:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.777948:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143851.777955:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b70a80 00010000:00010000:3.0:1746143851.777959:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f5f expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.777970:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2788 00000100:00100000:2.0:1746143851.777975:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625361408:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:3.0:1746143851.777978:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.777983:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1454080->1609727] (req 1454080->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.777988:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143851.777990:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.778023:0:13436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1454080->1609727] (req 1454080->1609727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.778034:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.778043:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a8000, rc 0) 00000100:00100000:3.0:1746143851.778094:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:3207:x1830963625361152:12345-192.168.202.3@tcp:101:cat.0 Request processed in 160us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.778097:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625361408:12345-192.168.202.3@tcp:3:cat.0 Request processed in 121us (380us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143851.778099:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17458 00000100:00100000:2.0:1746143851.778174:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2788 00002000:00100000:2.0:1746143851.778180:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1622016->1626111) req@ffff880092b70a80 x1830963625361408/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.778193:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b70a80 with x1830963625361408 ext(1622016->1626111) 00010000:00010000:2.0:1746143851.778198:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.778206:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 14 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143851.778212:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b70a80 00000100:00100000:0.0:1746143851.779106:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.779299:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625361536 00000100:00100000:2.0:1746143851.779303:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625361536 00000100:00100000:2.0:1746143851.779967:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17459 00000100:00100000:2.0:1746143851.779974:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3208:x1830963625361536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.779984:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.779995:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f66 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.780009:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.780010:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.780252:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.780267:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.780275:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189cc00, rc 0) 00000100:00100000:2.0:1746143851.780315:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3208:x1830963625361536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 342us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.780321:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17459 00000100:00100000:0.0:1746143851.783806:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.783887:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625362048 00000100:00100000:2.0:1746143851.783894:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625362048 00000100:00100000:2.0:1746143851.783953:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5542 00000100:00100000:2.0:1746143851.783959:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+8:3205:x1830963625362048:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143851.784127:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3205:x1830963625362048:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 167us (327us total) trans 8589945292 rc 0/0 00000100:00100000:2.0:1746143851.784132:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5542 00000100:00100000:0.0:1746143851.785299:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.785367:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625361792 00000100:00100000:2.0:1746143851.785371:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625361792 00002000:00100000:2.0:1746143851.785396:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1212416->1626111) req@ffff880095c6aa00 x1830963625361792/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.785404:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6aa00 with x1830963625361792 ext(1212416->1626111) 00010000:00010000:2.0:1746143851.785412:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 15 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.785423:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 15 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143851.785429:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6aa00 00000100:00100000:2.0:1746143851.785456:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2789 00000100:00100000:2.0:1746143851.785462:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625361792:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143851.788879:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.789459:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625362304 00000100:00100000:3.0:1746143851.789468:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625362304 00002000:00100000:3.0:1746143851.789502:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095c69880 x1830963625362304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.789830:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963625362304 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.789834:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:3.0:1746143851.789856:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7630 00000100:00100000:3.0:1746143851.789863:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625362304:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143851.794134:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2009:x1830963625361792:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8658us (8822us total) trans 21474841404 rc 0/0 00000100:00100000:3.0:1746143851.794148:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2789 00002000:00100000:3.0:1746143851.794161:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1212416->1626111) req@ffff880095c6aa00 x1830963625361792/t21474841404(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/448 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.794171:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6aa00 with x1830963625361792 ext(1212416->1626111) 00010000:00010000:3.0:1746143851.794182:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 19 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.794198:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 19 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143851.794205:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6aa00 00000100:00100000:3.0:1746143851.796683:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2010:x1830963625362304:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6807us (7797us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.796694:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7630 00002000:00100000:3.0:1746143851.796706:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880095c69880 x1830963625362304/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.796721:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69880 with x1830963625362304 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.796727:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c69880 00000100:00100000:0.0:1746143851.799807:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.799936:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625362432 00000100:00100000:3.0:1746143851.799946:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625362432 00010000:00010000:3.0:1746143851.799986:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143851.800024:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8575 00000100:00100000:3.0:1746143851.800032:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625362432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143851.800047:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746143851.800064:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143851 -> 1746143852 00010000:00010000:3.0:1746143851.800070:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.800083:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.800108:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133567400/0x87925e4cb73b74a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1212416->1626111) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f51 expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.800129:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.800131:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143851.800138:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.800146:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.800185:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.800197:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 36 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143851.800209:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627621376:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.802325:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1efd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.802428:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.802525:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625362560 00000100:00100000:3.0:1746143851.802532:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625362560 00000100:00100000:3.0:1746143851.802578:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17460 00000100:00100000:3.0:1746143851.802585:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3208:x1830963625362560:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.802601:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.802616:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f6d expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.802644:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.802649:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.802660:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 18 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.802670:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133566800, rc 0) 00000100:00100000:3.0:1746143851.802716:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3208:x1830963625362560:12345-192.168.202.3@tcp:101:cat.0 Request processed in 131us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.802723:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17460 00000100:00100000:0.0:1746143851.805642:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.805702:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.805712:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625362688 00000100:00100000:2.0:1746143851.805721:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625362688 00010000:00010000:2.0:1746143851.805757:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.805788:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8576 00000100:00100000:2.0:1746143851.805795:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625362688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.805808:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.805828:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.805840:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.805870:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.805873:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.805881:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.805890:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.805898:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.805899:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.805902:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.805909:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.805960:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.805972:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627621504:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.806057:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.806066:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627621632:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.806067:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f58 expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143851.806082:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10930:1830963627621376:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.806083:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143851.806100:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.806100:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625362816 00000100:00100000:2.0:1746143851.806103:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625362816 00000100:00100000:2.0:1746143851.806131:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17461 00000100:00100000:2.0:1746143851.806136:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:3202:x1830963625362816:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:3.0:1746143851.806148:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625362432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 6116us (6351us total) trans 0 rc 0/0 00010000:00010000:2.0:1746143851.806149:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746143851.806155:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8575 00010000:00010000:2.0:1746143851.806159:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f74 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.806176:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.806183:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.806188:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.806190:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.806193:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [1454080->1609727] (req 1454080->1609727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 38 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.806207:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 16 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.806217:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 16 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.806225:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627621760:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.806262:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.806270:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 38 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.806277:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627621888:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.808267:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.809447:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627621504:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143851.809460:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627621632:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143851.809482:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143851.809530:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625362688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3734us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.809541:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8576 00000100:00100000:2.0:1746143851.809741:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627621760:192.168.202.3@tcp:104: 00000100:00100000:0.0:1746143851.815263:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.815623:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.815769:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627621888:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.815801:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1454080->1609727] (req 1454080->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.815816:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ce00, rc 0) 00000100:00100000:2.0:1746143851.815863:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:3202:x1830963625362816:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9725us (10159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.815872:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17461 00000100:00100000:3.0:1746143851.816023:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363072 00000100:00100000:3.0:1746143851.816029:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363072 00002000:00100000:3.0:1746143851.816066:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c69c00 x1830963625363072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.816074:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963625363072 ext(1048576->2097151) 00010000:00010000:3.0:1746143851.816081:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.816090:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143851.816097:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c69c00 00000100:00100000:3.0:1746143851.816117:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363328 00000100:00100000:3.0:1746143851.816120:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363328 00000100:00100000:2.0:1746143851.816122:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2790 00000100:00100000:2.0:1746143851.816128:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625363072:12345-192.168.202.3@tcp:3:multiop.0 00002000:00100000:3.0:1746143851.816132:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c6a300 x1830963625363328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.816138:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963625363328 ext(1048576->2097151) 00010000:00010000:3.0:1746143851.816142:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.816149:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143851.816154:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6a300 00000100:00100000:3.0:1746143851.816164:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2791 00000100:00100000:3.0:1746143851.816168:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625363328:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143851.828641:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625363072:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 12504us (13377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.828653:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2790 00002000:00100000:2.0:1746143851.828663:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c69c00 x1830963625363072/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.828672:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c69c00 with x1830963625363072 ext(1048576->2097151) 00010000:00010000:2.0:1746143851.828680:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.828691:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143851.828698:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c69c00 00000100:00100000:3.0:1746143851.831248:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625363328:12345-192.168.202.3@tcp:3:cat.0 Request processed in 15062us (15609us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.831260:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2791 00002000:00100000:3.0:1746143851.831270:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880095c6a300 x1830963625363328/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.831279:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c6a300 with x1830963625363328 ext(1048576->2097151) 00010000:00010000:3.0:1746143851.831288:0:13437:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143851.831305:0:13437:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143851.831311:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095c6a300 00000100:00100000:1.0:1746143851.839488:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.839538:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.840074:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363456 00000100:00100000:3.0:1746143851.840081:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363456 00000100:00100000:2.0:1746143851.840081:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363584 00000100:00100000:2.0:1746143851.840085:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363584 00000100:00100000:3.0:1746143851.840117:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17462 00000100:00100000:3.0:1746143851.840123:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+34:3207:x1830963625363456:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.840138:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.840151:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f7b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.840173:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.840180:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.840181:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.840184:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.840206:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 12 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.840215:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 12 pid: 3134 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.840215:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17463 00000100:00100000:2.0:1746143851.840222:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+20:3208:x1830963625363584:12345-192.168.202.3@tcp:101:cat.0 00000100:00100000:3.0:1746143851.840229:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627622016:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.840229:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.840236:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f82 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.840265:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.840269:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.840277:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.840286:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092137c00, rc 0) 00000100:00100000:3.0:1746143851.840289:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.840307:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3208:x1830963625363584:12345-192.168.202.3@tcp:101:cat.0 Request processed in 86us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.840313:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17463 00000100:00100000:3.0:1746143851.842903:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.842976:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.843136:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363712 00000100:00100000:0.0:1746143851.843143:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363712 00000100:00100000:1.0:1746143851.843152:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363840 00000100:00100000:1.0:1746143851.843156:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363840 00010000:00010000:0.0:1746143851.843168:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143851.843171:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143851.843205:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8577 00000100:00100000:1.0:1746143851.843211:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625363840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143851.843219:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8578 00010000:00010000:1.0:1746143851.843221:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746143851.843225:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625363712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.843231:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143851.843235:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143851.843252:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143851.843254:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143851.843263:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143851.843320:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133566800/0x87925e4cb73b74be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f6d expref: 17 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143851.843343:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143851.843372:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625363840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143851.843378:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8577 00010000:00010000:0.0:1746143851.843651:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e5a8000/0x87925e4cb73b74b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f5f expref: 37 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143851.843672:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.843674:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.843679:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.843687:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.843715:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.843726:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627622144:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.843781:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.844726:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627622016:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.844747:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 35 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.844758:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a8c00, rc 0) 00000100:00100000:3.0:1746143851.844791:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+35:3207:x1830963625363456:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4667us (5310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.844798:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17462 00000100:00100000:0.0:1746143851.845086:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.845129:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625363968 00000100:00100000:2.0:1746143851.845134:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625363968 00010000:00010000:2.0:1746143851.845154:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 13 pid: 3134 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143851.845267:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627622144:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143851.845276:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.845293:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009610df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625363712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2069us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.845300:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8578 00000100:00100000:0.0:1746143851.845313:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8579 00000100:00100000:0.0:1746143851.845318:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2008:x1830963625363968:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143851.845326:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143851.845338:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 13 pid: 3134 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143851.845348:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 13 pid: 3134 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143851.845362:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74a00/0x87925e4cb73b73c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee1 expref: 13 pid: 3134 timeout: 1011 lvb_type: 0 00010000:00010000:0.0:1746143851.845371:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.845372:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.845377:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.845387:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.845394:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.845395:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143851.845398:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.845404:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143851.845422:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.845436:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627622272:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143851.845478:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 34 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.845485:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c68700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627622400:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.845498:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.849151:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.849254:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625364224 00000100:00100000:3.0:1746143851.849262:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625364224 00002000:00100000:3.0:1746143851.849295:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1454080->1458175) req@ffff880095c68a80 x1830963625364224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.849304:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68a80 with x1830963625364224 ext(1454080->1458175) 00002000:00010000:3.0:1746143851.849309:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68a80 00000100:00100000:3.0:1746143851.849343:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7631 00000100:00100000:3.0:1746143851.849350:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625364224:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143851.849485:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625364224:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 135us (341us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143851.849492:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7631 00002000:00100000:3.0:1746143851.849498:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1454080->1458175) req@ffff880095c68a80 x1830963625364224/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.849505:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68a80 with x1830963625364224 ext(1454080->1458175) 00002000:00010000:3.0:1746143851.849508:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095c68a80 00000100:00100000:0.0:1746143851.849632:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627622272:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.849668:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c68700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627622400:192.168.202.3@tcp:105: 00010000:00010000:0.0:1746143851.849682:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143851.849717:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625363968:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4398us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143851.849725:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8579 00000100:00100000:0.0:1746143851.852686:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.852879:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625364480 00000100:00100000:2.0:1746143851.852885:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625364480 00002000:00100000:2.0:1746143851.852943:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c68700 x1830963625364480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.852952:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68700 with x1830963625364480 ext(1048576->2097151) 00002000:00010000:2.0:1746143851.852957:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68700 00000100:00100000:2.0:1746143851.852986:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7632 00000100:00100000:2.0:1746143851.852994:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625364480:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:1.0:1746143851.854507:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.854645:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625364736 00000100:00100000:3.0:1746143851.854651:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625364736 00002000:00100000:3.0:1746143851.854677:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009c4d7b80 x1830963625364736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.854684:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7b80 with x1830963625364736 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.854687:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7b80 00000100:00100000:3.0:1746143851.854758:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7633 00000100:00100000:3.0:1746143851.854765:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625364736:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.857636:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.857696:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625364992 00000100:00100000:0.0:1746143851.857704:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625364992 00002000:00100000:0.0:1746143851.857740:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1605632->1609727) req@ffff88009c4d5180 x1830963625364992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143851.857748:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5180 with x1830963625364992 ext(1605632->1609727) 00002000:00010000:0.0:1746143851.857753:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5180 00000100:00100000:0.0:1746143851.858028:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7634 00000100:00100000:0.0:1746143851.858036:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625364992:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143851.858155:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625364992:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 120us (527us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143851.858162:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7634 00002000:00100000:0.0:1746143851.858167:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1605632->1609727) req@ffff88009c4d5180 x1830963625364992/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/4536 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143851.858173:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d5180 with x1830963625364992 ext(1605632->1609727) 00002000:00010000:0.0:1746143851.858176:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c4d5180 00000100:00100000:2.0:1746143851.859475:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625364480:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 6478us (6791us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.859483:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7632 00002000:00100000:2.0:1746143851.859490:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880095c68700 x1830963625364480/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.859498:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095c68700 with x1830963625364480 ext(1048576->2097151) 00002000:00010000:2.0:1746143851.859501:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095c68700 00000100:00100000:3.0:1746143851.862699:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2008:x1830963625364736:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7926us (8186us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.862710:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7633 00002000:00100000:3.0:1746143851.862721:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff88009c4d7b80 x1830963625364736/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.862729:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d7b80 with x1830963625364736 ext(1048576->2097151) 00002000:00010000:3.0:1746143851.862735:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c4d7b80 00000100:00100000:0.0:1746143851.864195:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.864271:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625365248 00000100:00100000:1.0:1746143851.864279:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625365248 00000100:00100000:1.0:1746143851.864318:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5543 00000100:00100000:1.0:1746143851.864324:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:3202:x1830963625365248:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143851.864509:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:3202:x1830963625365248:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 183us (317us total) trans 8589945293 rc 0/0 00000100:00100000:1.0:1746143851.864538:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5543 00000100:00100000:0.0:1746143851.868444:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.868516:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.868559:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.868640:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625365504 00000100:00100000:3.0:1746143851.868649:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625365504 00000100:00100000:3.0:1746143851.868679:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625365632 00000100:00100000:3.0:1746143851.868682:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625365632 00000100:00100000:3.0:1746143851.868692:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625365376 00000100:00100000:3.0:1746143851.868694:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625365376 00000100:00100000:3.0:1746143851.868704:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17464 00000100:00100000:3.0:1746143851.868711:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625365504:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.868725:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.868738:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189c400/0x87925e4cb73b74da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f90 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.868778:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627622528:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.868781:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17465 00000100:00100000:2.0:1746143851.868789:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625365632:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.868797:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.868805:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73b74e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f97 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.868828:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627622656:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.868837:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e180 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.868850:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.868853:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17466 00000100:00100000:3.0:1746143851.868858:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625365376:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.868864:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.868870:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b74e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f89 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143851.869121:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.869163:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.869293:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625365760 00000100:00100000:1.0:1746143851.869297:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625365760 00000100:00100000:1.0:1746143851.869314:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625365888 00000100:00100000:1.0:1746143851.869315:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625365888 00000100:00100000:1.0:1746143851.869327:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17467 00000100:00100000:1.0:1746143851.869331:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625365760:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.869340:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.869346:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73b74ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412f9e expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.869368:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627622784:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143851.869392:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143851.869404:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17468 00000100:00100000:1.0:1746143851.869409:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625365888:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143851.869415:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143851.869420:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73b74f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fa5 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.869437:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627622912:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143851.869453:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143851.869665:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627623040:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.870332:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e240 going to sleep for 11 seconds 00010000:00010000:3.0:1746143851.870880:0:9839:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.870902:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e33800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627622656:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.870942:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73b74e1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f97 expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.870952:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880123268600/0x87925e4cb73b74e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f97 expref: 19 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.870967:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268600, rc 0) 00000100:00100000:3.0:1746143851.870991:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625365632:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2203us (2474us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.870998:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17465 00010000:00010000:3.0:1746143851.871028:0:13436:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.871043:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13436:1830963627622528:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.871058:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189c400/0x87925e4cb73b74da lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f90 expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.871065:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189c400/0x87925e4cb73b74da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f90 expref: 22 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.871072:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c400, rc 0) 00000100:00100000:3.0:1746143851.871088:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625365504:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2378us (2652us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.871093:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17464 00010000:00010000:1.0:1746143851.872322:0:3135:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143851.872336:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627622784:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143851.872353:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73b74ef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f9e expref: 36 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.872361:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd84800/0x87925e4cb73b74ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f9e expref: 36 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143851.872382:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd84800, rc 0) 00010000:00010000:2.0:1746143851.872482:0:1947:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.872495:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627622912:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.872509:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73b74f6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fa5 expref: 37 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.872517:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84e800/0x87925e4cb73b74f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fa5 expref: 37 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.872526:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84e800, rc 0) 00000100:00100000:1.0:1746143851.872599:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625365760:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3266us (3479us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143851.872605:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17467 00000100:00100000:2.0:1746143851.872643:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625365888:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3233us (3479us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.872649:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17468 00002000:00010000:3.0:1746143851.873171:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime: 1746143851 -> 1746143852 00000100:00100000:3.0:1746143851.873179:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:1945:1830963627623040:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143851.873194:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b74e8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f89 expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.873201:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b74e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f89 expref: 17 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143851.873209:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c200, rc 0) 00000100:00100000:3.0:1746143851.873229:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625365376:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4371us (4670us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143851.873233:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17466 00000100:00100000:0.0:1746143851.875384:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143851.875431:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.875594:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625366016 00000100:00100000:3.0:1746143851.875602:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625366016 00000100:00100000:2.0:1746143851.875613:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625366144 00000100:00100000:2.0:1746143851.875617:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625366144 00000100:00100000:3.0:1746143851.875649:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17469 00000100:00100000:3.0:1746143851.875656:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+35:3207:x1830963625366016:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.875670:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.875683:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fac expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.875720:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17470 00000100:00100000:2.0:1746143851.875725:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3208:x1830963625366144:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.875731:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.875737:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fb3 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.875884:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.875891:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.875893:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.875896:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.875956:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.875968:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 11 pid: 3134 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.875978:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627623168:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143851.875995:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.876000:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.876009:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.876017:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e5a9c00, rc 0) 00000100:00100000:3.0:1746143851.876038:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:3207:x1830963625366016:12345-192.168.202.3@tcp:101:cat.0 Request processed in 384us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.876044:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17469 00000100:00100000:2.0:1746143851.876204:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.877025:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627623168:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.877041:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.877050:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269200, rc 0) 00000100:00100000:2.0:1746143851.877083:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3208:x1830963625366144:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1357us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.877089:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17470 00000100:00100000:0.0:1746143851.877823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.877935:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625366272 00000100:00100000:2.0:1746143851.877941:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625366272 00010000:00010000:2.0:1746143851.877961:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 12 pid: 3134 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.877990:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8580 00000100:00100000:2.0:1746143851.877996:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2011:x1830963625366272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.878005:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.878021:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 12 pid: 3134 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.878031:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 12 pid: 3134 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.878048:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091d74400/0x87925e4cb73b73d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ee8 expref: 12 pid: 3134 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.878059:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.878061:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.878065:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.878071:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.878077:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.878078:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.878081:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.878086:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.878106:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.878115:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627623296:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.878192:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.878200:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627623424:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.878391:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.880087:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627623296:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.880097:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627623424:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.880112:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.880145:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2011:x1830963625366272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2149us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.880153:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8580 00000100:00100000:0.0:1746143851.881397:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.881468:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625366528 00000100:00100000:3.0:1746143851.881475:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625366528 00002000:00100000:3.0:1746143851.881514:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136ac8a80 x1830963625366528/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.881523:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8a80 with x1830963625366528 ext(2097152->3145727) 00002000:00010000:3.0:1746143851.882069:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8a80 00000100:00100000:3.0:1746143851.882100:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7635 00000100:00100000:3.0:1746143851.882108:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625366528:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143851.882670:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.882852:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625366784 00000100:00100000:2.0:1746143851.882856:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625366784 00002000:00100000:2.0:1746143851.882878:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136acb800 x1830963625366784/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.882885:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb800 with x1830963625366784 ext(2097152->3145727) 00002000:00010000:2.0:1746143851.882889:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136acb800 00000100:00100000:2.0:1746143851.882901:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7636 00000100:00100000:2.0:1746143851.882906:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625366784:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143851.891254:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625366528:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9126us (9837us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143851.891266:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7635 00002000:00100000:3.0:1746143851.891276:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136ac8a80 x1830963625366528/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.891285:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136ac8a80 with x1830963625366528 ext(2097152->3145727) 00002000:00010000:3.0:1746143851.891289:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136ac8a80 00000100:00100000:2.0:1746143851.893355:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625366784:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10442us (10680us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.893364:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7636 00002000:00100000:2.0:1746143851.893371:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880136acb800 x1830963625366784/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.893378:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136acb800 with x1830963625366784 ext(2097152->3145727) 00002000:00010000:2.0:1746143851.893383:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136acb800 00000100:00100000:0.0:1746143851.897493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.897606:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625366912 00000100:00100000:2.0:1746143851.897614:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625366912 00000100:00100000:2.0:1746143851.897662:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17471 00000100:00100000:2.0:1746143851.897669:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:3208:x1830963625366912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.897683:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.897697:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fba expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.897726:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.897733:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.897735:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143851.897738:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.897762:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.897772:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 11 pid: 3135 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.897782:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627623552:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143851.897850:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.898609:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.898679:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625367040 00000100:00100000:3.0:1746143851.898683:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625367040 00000100:00100000:3.0:1746143851.898709:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17472 00000100:00100000:3.0:1746143851.898715:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+36:3207:x1830963625367040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.898722:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.898730:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fc1 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.898743:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143851.898747:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 37 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.898756:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 37 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143851.898765:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c200, rc 0) 00000100:00100000:3.0:1746143851.898788:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7448e42d-373a-41e0-9678-9a18291c6700+37:3207:x1830963625367040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143851.898871:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17472 00000100:00100000:2.0:1746143851.899430:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627623552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143851.899448:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.899456:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28e00, rc 0) 00000100:00100000:2.0:1746143851.899491:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3208:x1830963625366912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1822us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.899500:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17471 00000100:00100000:0.0:1746143851.900443:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.900529:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625367168 00000100:00100000:2.0:1746143851.900534:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625367168 00010000:00010000:2.0:1746143851.900552:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 12 pid: 3135 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143851.900607:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8581 00000100:00100000:2.0:1746143851.900614:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625367168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143851.900623:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143851.900638:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 12 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.900647:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 12 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.900663:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e77e00/0x87925e4cb73b73d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412eef expref: 12 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143851.900687:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.900689:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.900694:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.900702:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.900711:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.900712:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143851.900715:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.900726:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.900745:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.900754:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627623680:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.900797:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 16 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.900805:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627623808:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143851.900832:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.901898:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627623680:192.168.202.3@tcp:105: 00000100:00100000:0.0:1746143851.907903:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.908398:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627623808:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143851.908418:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143851.908463:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625367168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7849us (8020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143851.908474:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8581 00000100:00100000:0.0:1746143851.909584:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.909717:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625367552 00000100:00100000:3.0:1746143851.909723:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625367552 00002000:00100000:3.0:1746143851.909754:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800b4174700 x1830963625367552/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.909763:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4174700 with x1830963625367552 ext(2097152->4194303) 00002000:00010000:3.0:1746143851.909767:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b4174700 00000100:00100000:3.0:1746143851.909784:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625367680 00000100:00100000:3.0:1746143851.909786:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625367680 00002000:00100000:3.0:1746143851.909795:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800b4174a80 x1830963625367680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.909802:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4174a80 with x1830963625367680 ext(3145728->4194303) 00002000:00010000:3.0:1746143851.909805:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4174a80 00000100:00100000:3.0:1746143851.909819:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7637 00000100:00100000:3.0:1746143851.909824:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625367552:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143851.910430:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7638 00000100:00100000:0.0:1746143851.910436:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625367680:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.914260:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.914306:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625367936 00000100:00100000:3.0:1746143851.914313:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625367936 00002000:00100000:3.0:1746143851.914350:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b4b480 x1830963625367936/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.914360:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b480 with x1830963625367936 ext(2097152->4194303) 00002000:00010000:3.0:1746143851.914365:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4b480 00000100:00100000:3.0:1746143851.914857:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7639 00000100:00100000:3.0:1746143851.914864:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625367936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143851.915728:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.915773:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625368192 00000100:00100000:2.0:1746143851.915778:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625368192 00002000:00100000:2.0:1746143851.915798:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092b4b100 x1830963625368192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.915805:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b100 with x1830963625368192 ext(3145728->4194303) 00002000:00010000:2.0:1746143851.915809:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4b100 00000100:00100000:2.0:1746143851.915826:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7640 00000100:00100000:2.0:1746143851.915831:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625368192:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143851.919257:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625367680:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8813us (9667us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.919267:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7638 00002000:00100000:2.0:1746143851.919277:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800b4174a80 x1830963625367680/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.919286:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4174a80 with x1830963625367680 ext(3145728->4194303) 00002000:00010000:2.0:1746143851.919291:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4174a80 00000100:00100000:2.0:1746143851.932730:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625368192:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16889us (16994us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143851.932741:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7640 00002000:00100000:2.0:1746143851.932752:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff880092b4b100 x1830963625368192/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.932761:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b100 with x1830963625368192 ext(3145728->4194303) 00002000:00010000:2.0:1746143851.932772:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b4b100 00000100:00100000:3.0:1746143851.933247:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625367552:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23411us (25340us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143851.933254:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7637 00002000:00100000:3.0:1746143851.933260:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff8800b4174700 x1830963625367552/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.933266:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4174700 with x1830963625367552 ext(2097152->4194303) 00002000:00010000:3.0:1746143851.933269:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b4174700 00000100:00100000:3.0:1746143851.938173:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625367936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 23302us (23927us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746143851.938183:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7639 00002000:00100000:3.0:1746143851.938192:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->4194303) req@ffff880092b4b480 x1830963625367936/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.938200:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b4b480 with x1830963625367936 ext(2097152->4194303) 00002000:00010000:3.0:1746143851.938204:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092b4b480 00000100:00100000:0.0:1746143851.944791:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.944937:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625368320 00000100:00100000:3.0:1746143851.944944:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625368320 00000100:00100000:3.0:1746143851.945038:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17473 00000100:00100000:3.0:1746143851.945046:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625368320:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143851.945060:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143851.945248:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189c400/0x87925e4cb73b7519 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fc8 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143851.945290:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627623936:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143851.945364:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e240 going to sleep for 11 seconds 00000100:00100000:0.0:1746143851.946370:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143851.946452:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625368576 00000100:00100000:3.0:1746143851.946456:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625368576 00000100:00100000:2.0:1746143851.946466:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627623936:192.168.202.3@tcp:106: 00002000:00100000:3.0:1746143851.946480:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800b4175180 x1830963625368576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.946488:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4175180 with x1830963625368576 ext(4194304->4853759) 00010000:00010000:2.0:1746143851.946489:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189c400/0x87925e4cb73b7519 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc8 expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746143851.946492:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4175180 00010000:00010000:2.0:1746143851.946501:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189c400/0x87925e4cb73b7519 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc8 expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143851.946504:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7641 00000100:00100000:3.0:1746143851.946509:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625368576:12345-192.168.202.3@tcp:3:cat.0 00010000:00010000:2.0:1746143851.946526:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189c400, rc 0) 00000100:00100000:2.0:1746143851.946548:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625368320:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1502us (1764us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.946553:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17473 00000100:00100000:0.0:1746143851.949928:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.951659:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625368832 00000100:00100000:2.0:1746143851.951670:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625368832 00002000:00100000:2.0:1746143851.951710:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800b4175500 x1830963625368832/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/0 e 0 to 0 dl 1746143862 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.951720:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4175500 with x1830963625368832 ext(4194304->4853759) 00002000:00010000:2.0:1746143851.951725:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4175500 00000100:00100000:2.0:1746143851.951746:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7642 00000100:00100000:2.0:1746143851.951753:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625368832:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143851.952566:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625368576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6055us (6195us total) trans 0 rc 659456/659456 00000100:00100000:3.0:1746143851.952574:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7641 00002000:00100000:3.0:1746143851.952580:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800b4175180 x1830963625368576/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143851.952590:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4175180 with x1830963625368576 ext(4194304->4853759) 00002000:00010000:3.0:1746143851.952597:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4175180 00000100:00100000:2.0:1746143851.958537:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625368832:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6777us (8623us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143851.958547:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7642 00002000:00100000:2.0:1746143851.958558:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff8800b4175500 x1830963625368832/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:247/0 lens 488/440 e 0 to 0 dl 1746143862 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143851.958566:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4175500 with x1830963625368832 ext(4194304->4853759) 00002000:00010000:2.0:1746143851.958571:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4175500 00000100:00100000:0.0:1746143851.960355:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.960416:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625369088 00000100:00100000:1.0:1746143851.960423:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625369088 00000100:00100000:1.0:1746143851.960468:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5544 00000100:00100000:1.0:1746143851.960475:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:3207:x1830963625369088:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1746143851.961628:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.961684:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625369216 00000100:00100000:2.0:1746143851.961688:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625369216 00000100:00100000:2.0:1746143851.961713:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17474 00000100:00100000:2.0:1746143851.961717:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625369216:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.961729:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.961743:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b7520 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fcf expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.961999:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627624064:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143851.962611:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+263:3207:x1830963625369088:12345-192.168.202.3@tcp:35:cat.0 Request processed in 2136us (2259us total) trans 8589945294 rc 0/0 00000100:00100000:1.0:1746143851.962619:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5544 00000100:00100000:2.0:1746143851.962663:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.964221:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627624064:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.964259:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b7520 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fcf expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.964271:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28400/0x87925e4cb73b7520 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fcf expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.967328:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28400, rc 0) 00000100:00100000:2.0:1746143851.967393:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625369216:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5670us (5762us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.967401:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17474 00000100:00100000:0.0:1746143851.970530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.970604:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625369344 00000100:00100000:2.0:1746143851.970610:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625369344 00000100:00100000:2.0:1746143851.970643:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17475 00000100:00100000:2.0:1746143851.970648:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625369344:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143851.970661:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.970675:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73b7527 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fd6 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143851.970713:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627624192:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143851.970783:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143851.975107:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627624192:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143851.975138:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73b7527 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fd6 expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.975150:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28000/0x87925e4cb73b7527 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fd6 expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143851.975175:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28000, rc 0) 00000100:00100000:2.0:1746143851.975207:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2009:x1830963625369344:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4558us (4682us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143851.975215:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17475 00000100:00100000:0.0:1746143851.978227:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143851.978341:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625369600 00000100:00100000:1.0:1746143851.978348:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625369600 00000100:00100000:1.0:1746143851.978986:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5545 00000100:00100000:1.0:1746143851.978995:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b495850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+9:3208:x1830963625369600:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:1.0:1746143851.979162:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b495850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3208:x1830963625369600:12345-192.168.202.3@tcp:35:cat.0 Request processed in 167us (940us total) trans 8589945295 rc 0/0 00000100:00100000:1.0:1746143851.979168:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5545 00000100:00100000:0.0:1746143851.987502:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143851.987573:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625369856 00000100:00100000:2.0:1746143851.987581:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625369856 00000100:00100000:2.0:1746143851.987639:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14181 00000100:00100000:2.0:1746143851.987646:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+263:3213:x1830963625369856:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143851.987667:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143851.987683:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73b752e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fdd expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.987743:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987754:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987764:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987780:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987785:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987791:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987868:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987875:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987881:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143851.987888:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143851.987985:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987990:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.987995:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988000:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988005:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e28c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143851.988008:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988014:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988023:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143851.988025:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143851.988028:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988032:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28c00/0x87925e4cb73b7535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988253:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988258:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988263:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988266:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130e28000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143851.988268:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988273:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988280:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632ed00) 00010000:00010000:2.0:1746143851.988282:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143851.988283:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988287:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28000/0x87925e4cb73b753c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143851.988316:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130e28400/0x87925e4cb73b752e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 266 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.988326:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 265 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143851.988331:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143851.988332:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143851.988334:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97600, rc 0) 00000100:00100000:2.0:1746143851.988382:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+265:3213:x1830963625369856:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 736us (887us total) trans 8589945296 rc 0/0 00000100:00100000:2.0:1746143851.988388:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14181 00010000:00010000:2.0:1746143852.000108:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143852.010736:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.010826:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625370112 00000100:00100000:2.0:1746143852.010834:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625370112 00000100:00100000:3.0:1746143852.012448:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14182 00000100:00100000:3.0:1746143852.012464:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+10:3216:x1830963625370112:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143852.012488:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.012505:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c800/0x87925e4cb73b7551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412fe4 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.012570:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012584:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012593:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012603:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012607:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012612:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012699:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012707:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012714:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143852.012722:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143852.012777:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012783:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012788:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012794:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012800:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189c400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143852.012803:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012808:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012817:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:3.0:1746143852.012820:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143852.012823:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012828:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012856:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012861:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012865:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012869:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189de00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143852.012871:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012876:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012882:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8e00) 00010000:00010000:3.0:1746143852.012884:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746143852.012886:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012890:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b755f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.012942:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c800/0x87925e4cb73b7551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 13 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.012953:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.012958:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143852.012960:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143852.012962:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189dc00, rc 0) 00000100:00100000:3.0:1746143852.013016:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3216:x1830963625370112:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 559us (2286us total) trans 8589945297 rc 0/0 00000100:00100000:3.0:1746143852.013022:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14182 00000100:00100000:0.0:1746143852.021828:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.022069:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625370240 00000100:00100000:2.0:1746143852.022077:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625370240 00000100:00100000:2.0:1746143852.022145:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17476 00000100:00100000:2.0:1746143852.022153:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3216:x1830963625370240:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143852.022168:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.022184:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412feb expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.022210:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.022217:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.022223:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.022225:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.022227:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [737280->909311] (req 737280->909311) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.022264:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.022274:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.022285:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624320:192.168.202.3@tcp:104: 00000100:00080000:1.0:1746143852.022338:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746143852.022368:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.022376:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 35 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.022383:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.022400:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.031176:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.031611:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624320:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.031621:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624448:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.031646:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [737280->909311] (req 737280->909311) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 23 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.031667:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123268600, rc 0) 00000100:00100000:2.0:1746143852.031722:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3216:x1830963625370240:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 9569us (9902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.031731:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17476 00000100:00100000:1.0:1746143852.032011:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.032037:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625370368 00000100:00100000:1.0:1746143852.032042:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625370368 00010000:00010000:1.0:1746143852.032063:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 36 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.032082:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625370496 00000100:00100000:1.0:1746143852.032084:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625370496 00010000:00010000:1.0:1746143852.032091:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.032119:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8582 00000100:00100000:1.0:1746143852.032124:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625370368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.032134:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143852.032143:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8583 00010000:00010000:1.0:1746143852.032149:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 36 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.032151:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625370496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.032157:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 36 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.032159:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.032274:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.032284:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.032296:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133567200/0x87925e4cb73b749b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f4a expref: 23 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.032312:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.032314:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.032319:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.032325:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.032349:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.032360:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627624576:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143852.032413:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746143852.033336:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918b6000/0x87925e4cb73b7432 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f0b expref: 36 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.033353:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143852.033382:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625370368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1257us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.033387:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8582 00000100:00100000:2.0:1746143852.034648:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10930:1830963627624576:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143852.034664:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.034692:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2008:x1830963625370496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2542us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.034699:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8583 00000100:00100000:0.0:1746143852.035037:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.035094:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625370752 00000100:00100000:0.0:1746143852.035098:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625370752 00002000:00100000:0.0:1746143852.035124:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->741375) req@ffff8800b4176680 x1830963625370752/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.035132:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4176680 with x1830963625370752 ext(737280->741375) 00002000:00010000:0.0:1746143852.035136:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4176680 00000100:00100000:0.0:1746143852.035780:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7643 00000100:00100000:0.0:1746143852.035787:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625370752:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143852.035885:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625370752:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 99us (849us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143852.035891:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7643 00002000:00100000:0.0:1746143852.035896:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->741375) req@ffff8800b4176680 x1830963625370752/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.035903:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4176680 with x1830963625370752 ext(737280->741375) 00002000:00010000:0.0:1746143852.035906:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4176680 00000100:00100000:0.0:1746143852.039554:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.039606:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625371008 00000100:00100000:3.0:1746143852.039613:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625371008 00000100:00100000:0.0:1746143852.042136:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143852.042227:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (905216->909311) req@ffff8800b4176a00 x1830963625371008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.042244:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4176a00 with x1830963625371008 ext(905216->909311) 00002000:00010000:3.0:1746143852.042249:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4176a00 00000100:00100000:3.0:1746143852.042273:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7644 00000100:00100000:3.0:1746143852.042282:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625371008:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143852.042407:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4176a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625371008:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 127us (2858us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143852.042417:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7644 00002000:00100000:3.0:1746143852.042421:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (905216->909311) req@ffff8800b4176a00 x1830963625371008/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.042427:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4176a00 with x1830963625371008 ext(905216->909311) 00002000:00010000:3.0:1746143852.042429:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4176a00 00000100:00100000:2.0:1746143852.042494:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625371136 00000100:00100000:2.0:1746143852.042498:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625371136 00000100:00100000:2.0:1746143852.042531:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17477 00000100:00100000:2.0:1746143852.042536:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:3213:x1830963625371136:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143852.042546:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.042558:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ff2 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.042577:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.042584:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.042590:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.042591:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.042594:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->1261567] (req 1048576->1261567) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.042621:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 21 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.042630:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 21 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.042640:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624704:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.042731:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.042742:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.042749:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624832:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.042763:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092222780 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.044855:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624704:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.044862:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627624832:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.044880:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [1048576->1261567] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.044890:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e28c00, rc 0) 00000100:00100000:2.0:1746143852.045071:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:3213:x1830963625371136:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 2534us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.045080:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17477 00000100:00100000:0.0:1746143852.046979:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.047011:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.047307:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625371520 00000100:00100000:2.0:1746143852.047314:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625371520 00000100:00100000:2.0:1746143852.047347:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5546 00000100:00100000:2.0:1746143852.047354:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+12:3216:x1830963625371520:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:3.0:1746143852.047616:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625371264 00000100:00100000:3.0:1746143852.047620:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625371264 00000100:00100000:2.0:1746143852.047622:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3216:x1830963625371520:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 266us (645us total) trans 8589945298 rc 0/0 00000100:00100000:2.0:1746143852.047627:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5546 00010000:00010000:3.0:1746143852.047637:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.047742:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8584 00000100:00100000:3.0:1746143852.047748:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625371264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.047757:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.047773:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.047784:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.047793:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143852.047801:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092137c00/0x87925e4cb73b74d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f82 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.047805:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625371648 00000100:00100000:1.0:1746143852.047808:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625371648 00010000:00010000:3.0:1746143852.047821:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143852.047821:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.047840:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8585 00000100:00100000:3.0:1746143852.047842:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625371264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 94us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.047845:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625371648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746143852.047851:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8584 00010000:00010000:1.0:1746143852.047851:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143852.047858:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.047865:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.047875:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a8c00/0x87925e4cb73b74cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f7b expref: 36 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.047886:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.047888:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.047893:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.047899:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.047941:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.047950:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627624960:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143852.047992:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.051753:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627624960:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143852.051772:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143852.051818:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625371648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3971us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.051828:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8585 00000100:00100000:0.0:1746143852.056147:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.056376:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625371904 00000100:00100000:3.0:1746143852.056383:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625371904 00002000:00100000:3.0:1746143852.056417:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1257472->1261567) req@ffff8800b4177800 x1830963625371904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.056427:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4177800 with x1830963625371904 ext(1257472->1261567) 00002000:00010000:3.0:1746143852.056432:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4177800 00000100:00100000:3.0:1746143852.056460:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7645 00000100:00100000:3.0:1746143852.056466:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625371904:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:3.0:1746143852.056577:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2010:x1830963625371904:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 111us (523us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143852.056583:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7645 00002000:00100000:3.0:1746143852.056588:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1257472->1261567) req@ffff8800b4177800 x1830963625371904/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.056594:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b4177800 with x1830963625371904 ext(1257472->1261567) 00002000:00010000:3.0:1746143852.056597:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b4177800 00000100:00100000:0.0:1746143852.060231:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.062880:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625372160 00000100:00100000:2.0:1746143852.062890:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625372160 00000100:00100000:2.0:1746143852.063087:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5547 00000100:00100000:2.0:1746143852.063095:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+265:3213:x1830963625372160:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143852.063296:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+266:3213:x1830963625372160:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 201us (3070us total) trans 8589945299 rc 0/0 00000100:00100000:2.0:1746143852.063302:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5547 00000100:00080000:1.0:1746143852.063770:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746143852.081252:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.081935:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625372416 00000100:00100000:2.0:1746143852.081944:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625372416 00000100:00100000:2.0:1746143852.081992:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14183 00000100:00100000:2.0:1746143852.081999:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+266:3221:x1830963625372416:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.082019:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.082033:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73b7582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248412ff9 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.082107:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b7589 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.082122:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b7589 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.082130:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b7589 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143852.082138:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143852.082206:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123269c00/0x87925e4cb73b7582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff9 expref: 269 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.082232:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b7589 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff9 expref: 268 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.082248:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143852.082250:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143852.082253:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a53400, rc 0) 00000100:00100000:2.0:1746143852.082935:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+268:3221:x1830963625372416:12345-192.168.202.3@tcp:101:cat.0 Request processed in 935us (1695us total) trans 8589945300 rc 0/0 00000100:00100000:2.0:1746143852.082942:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14183 00000100:00100000:0.0:1746143852.089329:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.089503:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625372544 00000100:00100000:2.0:1746143852.089512:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625372544 00000100:00100000:2.0:1746143852.089579:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17478 00000100:00100000:2.0:1746143852.089587:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625372544:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.089603:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.092738:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73b7597 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413000 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.092799:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627625088:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143852.094128:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00002000:00010000:2.0:1746143852.096466:0:1947:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime: 1746143851 -> 1746143852 00002000:00010000:2.0:1746143852.096473:0:1947:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime: 1746143851 -> 1746143852 00000100:00100000:2.0:1746143852.096491:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627625088:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.096518:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73b7597 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413000 expref: 36 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.096531:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52a00/0x87925e4cb73b7597 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413000 expref: 36 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.096557:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52a00, rc 0) 00000100:00100000:2.0:1746143852.096599:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2009:x1830963625372544:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7013us (7280us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.096606:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17478 00000100:00100000:0.0:1746143852.101628:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.101789:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625372672 00000100:00100000:2.0:1746143852.101796:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625372672 00000100:00100000:2.0:1746143852.101843:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17479 00000100:00100000:2.0:1746143852.101850:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:3221:x1830963625372672:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.101863:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.101878:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413007 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.101904:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.101927:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143852.101930:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143852.101934:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.101959:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 20 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.101969:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 20 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.101980:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627625216:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.102062:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f879c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.107085:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.107126:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.107302:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1947:1830963627625216:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.107329:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.107344:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52600, rc 0) 00000100:00100000:3.0:1746143852.107391:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:3221:x1830963625372672:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5541us (5768us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.107402:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17479 00000100:00100000:3.0:1746143852.107433:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373056 00000100:00100000:3.0:1746143852.107438:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373056 00002000:00100000:3.0:1746143852.107466:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->909311) req@ffff88009c4d4a80 x1830963625373056/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.107474:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4a80 with x1830963625373056 ext(737280->909311) 00010000:00010000:3.0:1746143852.107480:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 21 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.107490:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 21 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.107496:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d4a80 00000100:00100000:3.0:1746143852.107510:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2792 00000100:00100000:3.0:1746143852.107516:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2011:x1830963625373056:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143852.107625:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625372928 00000100:00100000:2.0:1746143852.107628:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625372928 00000100:00100000:2.0:1746143852.107658:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14184 00000100:00100000:2.0:1746143852.107662:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+13:3224:x1830963625372928:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.107680:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.107694:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b75a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841300e expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.107767:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b75ac lrc: 3/1,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.107777:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b75ac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.107786:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b75ac lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143852.107794:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143852.107874:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53c00/0x87925e4cb73b75a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841300e expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.107904:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b75ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841300e expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.107932:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143852.107935:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746143852.107937:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52c00, rc 0) 00000100:00100000:2.0:1746143852.107958:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3224:x1830963625372928:12345-192.168.202.3@tcp:101:cat.0 Request processed in 295us (880us total) trans 8589945301 rc 0/0 00000100:00100000:2.0:1746143852.107963:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14184 00000100:00100000:0.0:1746143852.114027:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.114059:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.114108:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373184 00000100:00100000:2.0:1746143852.114115:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373184 00000100:00100000:2.0:1746143852.114149:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373312 00000100:00100000:2.0:1746143852.114151:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373312 00000100:00100000:2.0:1746143852.114177:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17480 00000100:00100000:2.0:1746143852.114184:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625373184:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.114200:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.114212:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b75ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413015 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.114265:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627625344:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143852.114321:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.114336:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17481 00000100:00100000:2.0:1746143852.114341:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625373312:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.114348:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.114359:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73b75c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841301c expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.114381:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627625472:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143852.114399:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122667300 going to sleep for 11 seconds 00000100:00080000:3.0:1746143852.114501:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746143852.115147:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.115642:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373440 00000100:00100000:1.0:1746143852.115647:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373440 00000100:00100000:1.0:1746143852.115861:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17482 00000100:00100000:1.0:1746143852.115868:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2008:x1830963625373440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143852.115876:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.115885:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b75c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413023 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.115936:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627625600:192.168.202.3@tcp:106: 00000100:00100000:1.0:1746143852.115994:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143852.116583:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2011:x1830963625373056:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 9065us (9455us total) trans 17179874150 rc 0/0 00000100:00100000:3.0:1746143852.116591:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2792 00002000:00100000:3.0:1746143852.116604:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (737280->909311) req@ffff88009c4d4a80 x1830963625373056/t17179874150(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/448 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.116612:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c4d4a80 with x1830963625373056 ext(737280->909311) 00010000:00010000:3.0:1746143852.116618:0:9592:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 27 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.116634:0:9592:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 27 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.116639:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c4d4a80 00000100:00100000:0.0:1746143852.118426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.118532:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373568 00000100:00100000:2.0:1746143852.118538:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373568 00000100:00100000:2.0:1746143852.118612:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14185 00000100:00100000:2.0:1746143852.118618:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+6:3225:x1830963625373568:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143852.118635:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.118648:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b75cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841302a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.118693:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.118704:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.118712:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.118723:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.118727:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.118731:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00080000:3.0:1746143852.118883:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746143852.119130:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119138:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119144:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:2.0:1746143852.119171:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:2.0:1746143852.119174:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746143852.119187:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119195:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119202:0:6587:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119207:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119212:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119216:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119221:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e30a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143852.119224:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119230:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119246:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143852.119249:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143852.119252:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119256:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e30a00/0x87925e4cb73b75d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119279:0:6587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119283:0:6587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119287:0:6587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119290:0:6587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143852.119292:0:6587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119296:0:6587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119306:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009632e700) 00010000:00010000:2.0:1746143852.119308:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143852.119310:0:6587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119314:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31c00/0x87925e4cb73b75dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:2.0:1746143852.119335:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b75cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.119347:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 7 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.119351:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143852.119353:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143852.119355:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31e00, rc 0) 00000100:00100000:2.0:1746143852.119395:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3225:x1830963625373568:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 777us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.119401:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14185 00000100:00100000:3.0:1746143852.120000:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627625472:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143852.120025:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73b75c1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841301c expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.120035:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30200/0x87925e4cb73b75c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841301c expref: 18 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.120045:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:3.0:1746143852.120065:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625373312:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5723us (6005us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143852.120070:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17481 00002000:00010000:1.0:1746143852.120129:0:1945:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime: 1746143851 -> 1746143852 00002000:00010000:1.0:1746143852.120132:0:1945:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime: 1746143851 -> 1746143852 00000100:00100000:1.0:1746143852.120141:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627625600:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143852.120155:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b75c8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413023 expref: 26 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.120162:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9c00/0x87925e4cb73b75c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413023 expref: 26 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.120171:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9c00, rc 0) 00000100:00100000:1.0:1746143852.120189:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625373440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4322us (5043us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143852.120193:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17482 00000100:00100000:2.0:1746143852.120612:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627625344:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.120626:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b75ba lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413015 expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.120635:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269c00/0x87925e4cb73b75ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413015 expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.120720:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880123269c00, rc 0) 00000100:00100000:2.0:1746143852.120749:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625373184:12345-192.168.202.3@tcp:101:cat.0 Request processed in 6566us (6729us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.120755:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17480 00000100:00100000:0.0:1746143852.122483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.122681:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373696 00000100:00100000:1.0:1746143852.122691:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373696 00010000:00010000:1.0:1746143852.122724:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 23 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.122762:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8586 00000100:00100000:1.0:1746143852.122779:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625373696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.122795:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143852.122814:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 23 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.123444:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 23 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.123469:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123268600/0x87925e4cb73b7574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 737280->909311) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412feb expref: 23 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.123486:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.123488:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.123496:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.123505:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.123544:0:12362:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.123557:0:12362:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627625728:192.168.202.3@tcp:105: 00000100:00100000:1.0:1746143852.123643:0:12362:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.124584:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.124612:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.124640:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.124657:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373824 00000100:00100000:0.0:1746143852.124661:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.124668:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373824 00000100:00100000:0.0:1746143852.124680:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625373952 00000100:00100000:0.0:1746143852.124684:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625373952 00000100:00080000:3.0:1746143852.124741:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746143852.124746:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746143852.124760:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625374080 00000100:00100000:3.0:1746143852.124764:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625374080 00000100:00100000:2.0:1746143852.124849:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625374208 00000100:00100000:2.0:1746143852.124852:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625374208 00000100:00100000:1.0:1746143852.124859:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17483 00000100:00100000:2.0:1746143852.125000:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17484 00000100:00100000:2.0:1746143852.125008:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625374208:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143852.125023:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746143852.125024:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625373824:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143852.125037:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b75eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413046 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.125039:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.125049:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413031 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.125064:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.125065:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.125072:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.125084:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746143852.125088:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627625856:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143852.125122:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9800, rc 0) 00000100:00100000:2.0:1746143852.125150:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880122667300 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.125151:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625373824:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 284us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.125158:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17483 00000100:00100000:0.0:1746143852.125231:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17485 00000100:00100000:3.0:1746143852.125248:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17486 00000100:00100000:3.0:1746143852.125255:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2009:x1830963625374080:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143852.125262:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.125272:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189de00/0x87925e4cb73b75f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841303f expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.125302:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627625984:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143852.125323:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.125347:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625373952:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:0.0:1746143852.125355:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.125364:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413038 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.125376:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.125377:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.125382:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.125391:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.125398:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d551e00, rc 0) 00000100:00100000:0.0:1746143852.125415:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625373952:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 179us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.125420:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17485 00000100:00100000:0.0:1746143852.125805:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.125856:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.126025:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625374336 00000100:00100000:1.0:1746143852.126030:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625374336 00000100:00100000:1.0:1746143852.126059:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625374464 00000100:00100000:1.0:1746143852.126061:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625374464 00000100:00100000:1.0:1746143852.126073:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17487 00000100:00100000:1.0:1746143852.126078:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625374336:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:1.0:1746143852.126085:0:1945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.126094:0:1945:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841304d expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.126105:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.126106:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.126110:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.126119:0:1945:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.126125:0:1945:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a52400, rc 0) 00000100:00100000:1.0:1746143852.126145:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625374336:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 67us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.126150:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17487 00000100:00100000:2.0:1746143852.126162:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17488 00000100:00100000:2.0:1746143852.126171:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625374464:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:2.0:1746143852.126179:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.126250:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413054 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.126264:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.126265:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.126271:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.126282:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 15 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.126290:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30600, rc 0) 00000100:00100000:2.0:1746143852.126307:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625374464:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 139us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.126394:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17488 00000100:00100000:0.0:1746143852.129315:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.131086:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625374592 00000100:00100000:2.0:1746143852.131101:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625374592 00000100:00100000:0.0:1746143852.131140:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.131189:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17489 00000100:00100000:2.0:1746143852.131198:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3224:x1830963625374592:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.131216:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.131233:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841305b expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.131271:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.131273:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.131282:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.131297:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 24 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.131306:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31200, rc 0) 00000100:00100000:1.0:1746143852.131312:0:12362:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b4aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:12362:1830963627625728:192.168.202.3@tcp:105: 00010000:00010000:1.0:1746143852.131330:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.131347:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3224:x1830963625374592:12345-192.168.202.3@tcp:101:cat.0 Request processed in 151us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.131347:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625373696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8580us (8873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.131354:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17489 00000100:00100000:1.0:1746143852.131356:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8586 00000100:00100000:3.0:1746143852.131709:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625374976 00000100:00100000:3.0:1746143852.131713:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625374976 00000100:00100000:0.0:1746143852.131737:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:3.0:1746143852.131743:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1753087) req@ffff8801368eb480 x1830963625374976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 504/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.131752:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb480 with x1830963625374976 ext(1048576->1753087) 00002000:00010000:3.0:1746143852.131757:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb480 00000100:00100000:3.0:1746143852.131807:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625375104 00000100:00100000:3.0:1746143852.131810:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625375104 00002000:00100000:3.0:1746143852.131828:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8801368e9f80 x1830963625375104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.131834:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9f80 with x1830963625375104 ext(0->1048575) 00000100:00100000:2.0:1746143852.131834:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7646 00002000:00010000:3.0:1746143852.131837:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9f80 00000100:00100000:2.0:1746143852.131840:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625374976:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143852.131843:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.131999:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625375232 00000100:00100000:3.0:1746143852.132002:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625375232 00000100:00100000:2.0:1746143852.132005:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7647 00000100:00100000:2.0:1746143852.132010:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625375104:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143852.132014:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39e:0x0] (1261568->2097151) req@ffff8801368e8000 x1830963625375232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.132020:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8000 with x1830963625375232 ext(1261568->2097151) 00002000:00010000:3.0:1746143852.132023:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8000 00000100:00100000:3.0:1746143852.132041:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7648 00000100:00100000:3.0:1746143852.132045:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625375232:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143852.135572:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627625856:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143852.135616:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b75eb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413046 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.135631:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b75eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413046 expref: 14 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.135657:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:3.0:1746143852.135946:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625374208:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 10692us (11035us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143852.135955:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17484 00000100:00100000:3.0:1746143852.137083:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627625984:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143852.137113:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189de00/0x87925e4cb73b75f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841303f expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.137127:0:1947:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189de00/0x87925e4cb73b75f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841303f expref: 14 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.137137:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189de00, rc 0) 00000100:00100000:3.0:1746143852.137584:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625374080:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 12326us (12940us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143852.137592:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17486 00000100:00100000:0.0:1746143852.143393:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.143493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.143751:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2009:x1830963625375104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11734us (12009us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143852.143765:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7647 00002000:00100000:2.0:1746143852.143778:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff8801368e9f80 x1830963625375104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.143789:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e9f80 with x1830963625375104 ext(0->1048575) 00002000:00010000:2.0:1746143852.143795:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e9f80 00000100:00100000:2.0:1746143852.143821:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625375616 00000100:00100000:2.0:1746143852.143829:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625375616 00002000:00100000:2.0:1746143852.143858:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092b44700 x1830963625375616/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.143865:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44700 with x1830963625375616 ext(0->1048575) 00002000:00010000:2.0:1746143852.143868:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b44700 00000100:00100000:3.0:1746143852.143871:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625375232:12345-192.168.202.3@tcp:3:cat.0 Request processed in 11826us (12029us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746143852.143878:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7648 00000100:00100000:2.0:1746143852.143881:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7649 00002000:00100000:3.0:1746143852.143883:0:20387:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x39e:0x0] (1261568->2097151) req@ffff8801368e8000 x1830963625375232/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746143852.143887:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963625375616:12345-192.168.202.3@tcp:3:cat.0 00002000:00100000:3.0:1746143852.143890:0:20387:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368e8000 with x1830963625375232 ext(1261568->2097151) 00002000:00010000:3.0:1746143852.143893:0:20387:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801368e8000 00000100:00100000:3.0:1746143852.143937:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625375872 00000100:00100000:3.0:1746143852.143940:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625375872 00000100:00100000:3.0:1746143852.143964:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14186 00000100:00100000:3.0:1746143852.143968:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+7:3225:x1830963625375872:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143852.143978:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.143994:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b761c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413062 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144091:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.144105:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 267 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144113:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144118:0:6587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144124:0:6587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.144154:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144168:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 8 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.144179:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627626112:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.144247:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 14 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144255:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 14 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.144262:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627626240:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.144286:0:6587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 267 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.144293:0:6587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 267 pid: 14991 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.144301:0:6587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627626368:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.144316:0:6587:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.147824:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.147927:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376000 00000100:00100000:1.0:1746143852.147936:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376000 00010000:00010000:1.0:1746143852.147975:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 9 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.148006:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8587 00000100:00100000:1.0:1746143852.148014:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2010:x1830963625376000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.148028:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143852.148033:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 9 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.148043:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 9 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.148065:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143852.148069:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143852.148077:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143852.148082:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143852.148104:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31e00/0x87925e4cb73b75e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841302a expref: 9 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.148119:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:2010:x1830963625376000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.148123:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627626112:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.148126:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8587 00000100:00100000:3.0:1746143852.148134:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627626240:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.148142:0:6587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:6587:1830963627626368:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.148168:0:6587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000100:00100000:2.0:1746143852.148263:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625374976:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16423us (17128us total) trans 0 rc 548864/548864 00000100:00100000:2.0:1746143852.148271:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7646 00002000:00100000:2.0:1746143852.148280:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->1753087) req@ffff8801368eb480 x1830963625374976/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 504/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 548864/548864 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.148288:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801368eb480 with x1830963625374976 ext(1048576->1753087) 00002000:00010000:2.0:1746143852.148293:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801368eb480 00000100:00100000:0.0:1746143852.148845:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.148877:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.148960:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376128 00000100:00100000:1.0:1746143852.148964:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376128 00010000:00010000:1.0:1746143852.148977:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 15 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.149011:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376256 00000100:00100000:1.0:1746143852.149013:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376256 00010000:00010000:1.0:1746143852.149027:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 268 pid: 14991 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.149044:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8588 00000100:00100000:1.0:1746143852.149050:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2008:x1830963625376128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.149060:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143852.149064:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 15 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.149073:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 15 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.149087:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189dc00/0x87925e4cb73b7566 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fe4 expref: 15 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.149124:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:1.0:1746143852.149128:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143852.149134:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:1.0:1746143852.149138:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.149158:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8589 00000100:00100000:3.0:1746143852.149166:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+268:2008:x1830963625376256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746143852.149167:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+14:2008:x1830963625376128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.149174:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8588 00010000:00010000:3.0:1746143852.149175:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.149180:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 268 pid: 14991 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.149189:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 268 pid: 14991 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.149202:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7543 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fdd expref: 268 pid: 14991 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.149210:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143852.149213:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.149221:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.149227:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.149265:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.149281:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+267:2008:x1830963625376256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.149287:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8589 00010000:00010000:3.0:1746143852.149304:0:6587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.149310:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143852.149330:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143852.149459:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e513a00/0x87925e4cb73b761c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413062 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.149472:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413062 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.149478:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143852.149480:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143852.149483:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512200, rc 0) 00000100:00100000:3.0:1746143852.149517:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3225:x1830963625375872:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 5548us (6024us total) trans 8589945302 rc 0/0 00000100:00100000:3.0:1746143852.149524:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14186 00000100:00100000:2.0:1746143852.151273:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2010:x1830963625375616:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7376us (7882us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143852.151285:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7649 00002000:00100000:2.0:1746143852.151298:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff880092b44700 x1830963625375616/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.151307:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b44700 with x1830963625375616 ext(0->1048575) 00002000:00010000:2.0:1746143852.151314:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092b44700 00000100:00100000:0.0:1746143852.151702:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.152596:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376512 00000100:00100000:3.0:1746143852.152604:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376512 00000100:00100000:3.0:1746143852.152660:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14187 00000100:00100000:3.0:1746143852.152669:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3225:x1830963625376512:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143852.152693:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.152697:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143852.152731:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512200/0x87925e4cb73b7623 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413062 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.152746:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143852.152750:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143852.152769:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7631 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413069 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.152879:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.152893:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143852.152901:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143852.152933:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143852.153303:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189c400/0x87925e4cb73b7631 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.153314:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.153321:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143852.153323:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143852.153324:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189de00, rc 0) 00000100:00100000:3.0:1746143852.153375:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3225:x1830963625376512:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 708us (1674us total) trans 8589945303 rc 0/0 00000100:00100000:3.0:1746143852.153380:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14187 00000100:00100000:1.0:1746143852.159322:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.159392:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376640 00000100:00100000:3.0:1746143852.159403:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376640 00000100:00100000:3.0:1746143852.159450:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14188 00000100:00100000:3.0:1746143852.159458:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3225:x1830963625376640:12345-192.168.202.3@tcp:101:mirror_io.0 00010000:00010000:3.0:1746143852.159489:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746143852.159507:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143852.159509:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73b7646 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413070 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.159568:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376768 00000100:00100000:2.0:1746143852.159572:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376768 00000100:00100000:2.0:1746143852.159607:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17490 00000100:00100000:2.0:1746143852.159612:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3224:x1830963625376768:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.159620:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.159631:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413077 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.159661:0:1947:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.159669:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143852.159671:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143852.159674:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.159707:0:1947:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 36 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.159719:0:1947:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.159730:0:1947:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627626496:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.159815:0:1947:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746143852.159882:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73b7646 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413070 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.159896:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73b7646 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413070 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.159933:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143852.159936:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143852.159939:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e512e00, rc 0) 00000100:00100000:3.0:1746143852.159966:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3225:x1830963625376640:12345-192.168.202.3@tcp:101:mirror_io.0 Request processed in 508us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.159972:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14188 00000100:00100000:2.0:1746143852.163162:0:1947:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1947:1830963627626496:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.163198:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 18 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.163218:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:2.0:1746143852.163270:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3224:x1830963625376768:12345-192.168.202.3@tcp:101:cat.0 Request processed in 3656us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.163279:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17490 00000100:00100000:0.0:1746143852.163990:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.164023:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.164052:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.164070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.164092:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.164284:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377024 00000100:00100000:3.0:1746143852.164292:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377024 00000100:00100000:3.0:1746143852.164337:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377152 00000100:00100000:3.0:1746143852.164340:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377152 00000100:00100000:3.0:1746143852.164355:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377408 00000100:00100000:3.0:1746143852.164357:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377408 00000100:00100000:3.0:1746143852.164366:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377664 00000100:00100000:3.0:1746143852.164368:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377664 00000100:00100000:1.0:1746143852.164375:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17491 00000100:00100000:1.0:1746143852.164390:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625377024:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:3.0:1746143852.164394:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17492 00000100:00100000:3.0:1746143852.164400:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625377152:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143852.164432:0:1945:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164433:0:3134:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164448:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164448:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164456:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164462:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.164462:0:1945:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.164468:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.164470:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164470:0:1945:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.164472:0:1945:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164476:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.164478:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.164480:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164501:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164501:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 14 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.164510:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 14 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.164511:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 17 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.164522:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627626752:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.164522:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627626624:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.164582:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17493 00000100:00100000:3.0:1746143852.164588:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625377408:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143852.164599:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 22 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164603:0:12327:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164611:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 22 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.164613:0:12327:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.164619:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627626880:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.164624:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143852.164625:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143852.164627:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164643:0:12327:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164644:0:1945:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 35 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164650:0:12327:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 35 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.164651:0:1945:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 35 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.164658:0:12327:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627627008:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.164658:0:1945:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627627136:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.164674:0:1945:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514840 going to sleep for 11 seconds 00000100:00100000:3.0:1746143852.164679:0:12327:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e180 going to sleep for 11 seconds 00010000:00010000:1.0:1746143852.164693:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 14 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143852.164695:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17494 00000100:00100000:3.0:1746143852.164701:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625377664:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:1.0:1746143852.164701:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 14 pid: 13436 timeout: 1011 lvb_type: 1 00000100:00100000:1.0:1746143852.164708:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627627264:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.164716:0:9839:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164726:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.164728:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164733:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 14 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.164736:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 36 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.164739:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164745:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.164746:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.164748:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.164748:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627627392:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.164761:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803ee40 going to sleep for 11 seconds 00010000:00010000:3.0:1746143852.164763:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 36 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164771:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 36 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.164778:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627627520:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.164804:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 14 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.164811:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 14 pid: 3134 timeout: 1011 lvb_type: 1 00000100:00100000:3.0:1746143852.164824:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627627648:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.164842:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164849:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.164860:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627627776:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.164872:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.164902:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.164926:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377280 00000100:00100000:3.0:1746143852.164929:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377280 00000100:00100000:3.0:1746143852.164948:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17495 00000100:00100000:3.0:1746143852.164953:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625377280:12345-192.168.202.3@tcp:1:mirror_io.0 00000100:00100000:0.0:1746143852.164966:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143852.164967:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164975:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746143852.164978:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.164984:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746143852.164986:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165005:0:3135:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 17 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165014:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.165030:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377536 00000100:00100000:3.0:1746143852.165032:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377536 00000100:00100000:3.0:1746143852.165047:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17496 00000100:00100000:3.0:1746143852.165052:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625377536:12345-192.168.202.3@tcp:1:mirror_io.0 00010000:00010000:3.0:1746143852.165066:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165076:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165082:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.165089:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165096:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.165097:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.165099:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165112:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165119:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.165127:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627628032:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.165181:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.165193:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 1011 lvb_type: 1 00000100:00100000:3.0:1746143852.165200:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009610c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627628160:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.165223:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.165230:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.165249:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627628288:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.165264:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f8796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.165361:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625376896 00000100:00100000:2.0:1746143852.165365:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625376896 00002000:00100000:2.0:1746143852.165387:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1454080->2097151) req@ffff880092b45180 x1830963625376896/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 504/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.165396:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963625376896 ext(1454080->2097151) 00010000:00010000:2.0:1746143852.165402:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.165411:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143852.165416:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b45180 00000100:00100000:2.0:1746143852.165444:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2793 00000100:00100000:2.0:1746143852.165451:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625376896:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:2.0:1746143852.169986:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627626880:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.170329:0:12327:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12327:1830963627627008:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.170358:0:12327:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.170388:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627628032:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.170396:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627628160:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.170402:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9586:1830963627628288:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.170417:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.170443:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627627520:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.170451:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627627648:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143852.170458:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627627776:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143852.170473:0:9839:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.170529:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627626624:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.170535:0:1945:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:1945:1830963627627136:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.170553:0:1945:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.170668:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009610d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627626752:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.170677:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627627392:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.173779:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625376896:12345-192.168.202.3@tcp:4:cat.0 Request processed in 8317us (9779us total) trans 21474841405 rc 0/0 00000100:00100000:2.0:1746143852.173793:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2793 00002000:00100000:2.0:1746143852.173805:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1454080->2097151) req@ffff880092b45180 x1830963625376896/t21474841405(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 504/448 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.173814:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092b45180 with x1830963625376896 ext(1454080->2097151) 00010000:00010000:2.0:1746143852.173824:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 39 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.173837:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 39 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:2.0:1746143852.173843:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092b45180 00000100:00100000:1.0:1746143852.177211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.177252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.177254:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.177281:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.177284:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625379456 00000100:00100000:1.0:1746143852.177293:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625379456 00000100:00100000:0.0:1746143852.177294:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.177306:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.177318:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.177332:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.177338:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14189 00000100:00100000:0.0:1746143852.177343:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.177345:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+14:3227:x1830963625379456:12345-192.168.202.3@tcp:101:multiop.0 00000100:00100000:0.0:1746143852.177354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.177363:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143852.177372:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.177392:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73b767e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841307e expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143852.177409:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627627264:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143852.177447:0:3134:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.177469:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143852.177475:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143852.177482:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00000100:00100000:0.0:1746143852.177491:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1746143852.177492:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143852.177504:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143852.177508:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143852.177514:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000100:00100000:3.0:1746143852.177564:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378176 00000100:00100000:3.0:1746143852.177567:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378176 00010000:00010000:3.0:1746143852.177585:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 18 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177597:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377920 00000100:00100000:3.0:1746143852.177599:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377920 00010000:00010000:3.0:1746143852.177608:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 16 pid: 1945 timeout: 1011 lvb_type: 1 00000100:00100000:3.0:1746143852.177618:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378304 00000100:00100000:3.0:1746143852.177620:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378304 00010000:00010000:3.0:1746143852.177629:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177636:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378560 00000100:00100000:3.0:1746143852.177638:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378560 00010000:00010000:3.0:1746143852.177645:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 39 pid: 3135 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177655:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378816 00000100:00100000:3.0:1746143852.177657:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378816 00010000:00010000:3.0:1746143852.177664:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 17 pid: 1945 timeout: 1011 lvb_type: 1 00000100:00100000:3.0:1746143852.177672:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625377792 00000100:00100000:3.0:1746143852.177673:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625377792 00010000:00010000:3.0:1746143852.177680:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 23 pid: 13436 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177687:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378432 00000100:00100000:3.0:1746143852.177689:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378432 00010000:00010000:3.0:1746143852.177697:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 16 pid: 3134 timeout: 1011 lvb_type: 1 00000100:00100000:3.0:1746143852.177703:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378688 00000100:00100000:3.0:1746143852.177705:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378688 00010000:00010000:3.0:1746143852.177711:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 19 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177718:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378944 00000100:00100000:3.0:1746143852.177719:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378944 00010000:00010000:3.0:1746143852.177726:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 37 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177733:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625379200 00000100:00100000:3.0:1746143852.177734:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625379200 00010000:00010000:3.0:1746143852.177741:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 17 pid: 13436 timeout: 1011 lvb_type: 1 00000100:00100000:3.0:1746143852.177750:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625379072 00000100:00100000:3.0:1746143852.177751:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625379072 00010000:00010000:3.0:1746143852.177758:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 24 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.177767:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8590 00000100:00100000:3.0:1746143852.177771:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2010:x1830963625378176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.177782:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.177799:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 19 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.177809:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 19 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.177824:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189cc00/0x87925e4cb73b74b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f66 expref: 19 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.177845:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.177885:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2010:x1830963625378176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.177892:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8590 00000100:00100000:3.0:1746143852.177959:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8591 00000100:00100000:3.0:1746143852.177964:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2008:x1830963625377920:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.177971:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.177984:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 17 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.177992:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 17 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178003:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800973b9800/0x87925e4cb73b75f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413031 expref: 17 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178012:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.178024:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625377920:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 60us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.178029:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8591 00000100:00100000:3.0:1746143852.178037:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8592 00000100:00100000:3.0:1746143852.178041:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625378304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.178047:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.178052:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178059:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178069:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52600/0x87925e4cb73b759e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413007 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178077:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.178088:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625378304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.178093:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8592 00000100:00100000:3.0:1746143852.178101:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8593 00000100:00100000:3.0:1746143852.178105:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625378560:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.178110:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.178116:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 39 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178124:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 39 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178134:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918b6200/0x87925e4cb73b748d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f3c expref: 39 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178141:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.178151:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625378560:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.178155:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8593 00000100:00100000:3.0:1746143852.178162:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8594 00000100:00100000:3.0:1746143852.178166:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2008:x1830963625378816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.178171:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.178179:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178186:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178199:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a52400/0x87925e4cb73b7607 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841304d expref: 15 pid: 1945 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178206:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.178216:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2008:x1830963625378816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 49us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.178220:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8594 00000100:00100000:3.0:1746143852.178228:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8595 00000100:00100000:3.0:1746143852.178232:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+24:2008:x1830963625377792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.178251:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.178257:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 24 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178265:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 24 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178274:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31200/0x87925e4cb73b7615 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841305b expref: 24 pid: 13436 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178283:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.178285:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.178289:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.178296:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.178318:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.178330:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2008:x1830963625377792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 98us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.178335:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8595 00000100:00100000:3.0:1746143852.178343:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8596 00000100:00100000:3.0:1746143852.178347:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+17:2008:x1830963625378432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.178353:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.178360:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 17 pid: 3134 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178367:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 17 pid: 3134 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178376:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30600/0x87925e4cb73b760e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413054 expref: 17 pid: 3134 timeout: 1011 lvb_type: 1 00010000:00010000:3.0:1746143852.178385:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143852.178386:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.178398:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+16:2008:x1830963625378432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 50us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.178403:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8596 00000100:00100000:3.0:1746143852.178410:0:7229:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625379584 00000100:00100000:3.0:1746143852.178412:0:7229:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625379584 00010000:00010000:3.0:1746143852.178420:0:7229:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 38 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.178433:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8597 00000100:00100000:3.0:1746143852.178437:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2008:x1830963625378688:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.178443:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.178448:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178455:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.178463:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e28e00/0x87925e4cb73b750b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fba expref: 17 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.178596:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143852.178607:0:14991:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.178613:0:14991:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:1.0:1746143852.178637:0:14991:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.178646:0:14991:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 9 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.178671:0:14991:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627628416:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.178732:0:14991:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.178751:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8598 00000100:00100000:1.0:1746143852.178758:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625378944:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.178764:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746143852.178772:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.178779:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 35 pid: 1945 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.178830:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8599 00000100:00100000:2.0:1746143852.178839:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+15:2009:x1830963625379200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.178846:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.178854:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 15 pid: 13436 timeout: 1011 lvb_type: 1 00010000:00010000:2.0:1746143852.178861:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 15 pid: 13436 timeout: 1011 lvb_type: 1 00010000:00010000:2.0:1746143852.178872:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d551e00/0x87925e4cb73b7600 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413038 expref: 15 pid: 13436 timeout: 1011 lvb_type: 1 00010000:00010000:2.0:1746143852.178889:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.178891:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.178894:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.178899:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.178929:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143852.178946:0:3134:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.178949:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+14:2009:x1830963625379200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (1472us total) trans 0 rc 0/0 00010000:00010000:0.0:1746143852.178954:0:3134:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.178955:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8599 00000100:00100000:2.0:1746143852.178967:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8600 00010000:00010000:0.0:1746143852.178969:0:3134:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.178972:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2009:x1830963625379072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143852.178976:0:3134:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.178979:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143852.178983:0:3134:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.178989:0:3134:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b97600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143852.178992:0:3134:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.178999:0:3134:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.179008:0:3134:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.179015:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b97600/0x87925e4cb73b7654 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143852.179066:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625377152:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 14666us (15012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.179074:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17492 00010000:00010000:3.0:1746143852.180036:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.180067:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2008:x1830963625378688:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1626us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.180074:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8597 00000100:00100000:3.0:1746143852.180115:0:7229:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8601 00000100:00100000:3.0:1746143852.180122:0:7229:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625379584:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.180131:0:7229:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.180141:0:7229:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 38 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.180149:0:7229:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 38 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.180166:0:7229:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189c200/0x87925e4cb73b7512 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fc1 expref: 38 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.180174:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.180176:0:7229:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.180179:0:7229:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180185:0:7229:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180202:0:7229:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.180216:0:7229:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625379584:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 95us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.180221:0:7229:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8601 00010000:00010000:3.0:1746143852.180260:0:9839:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180268:0:9839:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180281:0:9839:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180287:0:9839:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180298:0:9839:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180303:0:9839:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f635800 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143852.180306:0:9839:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180313:0:9839:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180322:0:9839:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180328:0:9839:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7669 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.180363:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625377664:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 15661us (16269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.180369:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17494 00000100:00100000:3.0:1746143852.180410:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625378048 00000100:00100000:3.0:1746143852.180416:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625378048 00002000:00100000:3.0:1746143852.180445:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1261567) req@ffff880087df5880 x1830963625378048/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.180454:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5880 with x1830963625378048 ext(1048576->1261567) 00010000:00010000:3.0:1746143852.180460:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.180470:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.180476:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087df5880 00000100:00100000:3.0:1746143852.180490:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2794 00000100:00100000:3.0:1746143852.180495:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625378048:12345-192.168.202.3@tcp:4:cat.0 00010000:00010000:3.0:1746143852.180597:0:1945:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180605:0:1945:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180616:0:1945:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180621:0:1945:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180627:0:1945:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180632:0:1945:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a53c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143852.180635:0:1945:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180644:0:1945:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180654:0:1945:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.180659:0:1945:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a53c00/0x87925e4cb73b765b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1945 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.180694:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+13:2009:x1830963625377024:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 16307us (16670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.180700:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17491 00010000:00010000:2.0:1746143852.180711:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.180721:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.180733:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880123269200/0x87925e4cb73b7504 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fb3 expref: 22 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.180742:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.180762:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+21:2009:x1830963625379072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1790us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.180768:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8600 00010000:00010000:1.0:1746143852.180822:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e5a9c00/0x87925e4cb73b74fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412fac expref: 37 pid: 1945 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.180843:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.180844:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.180847:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.180852:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.180876:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143852.180895:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625378944:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2138us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.180900:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8598 00000100:00100000:1.0:1746143852.180954:0:14991:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14991:1830963627628416:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143852.180971:0:14991:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:3.0:1746143852.181061:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181069:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181082:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181088:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181093:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181102:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8aa00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143852.181104:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181110:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181118:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.181124:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8aa00/0x87925e4cb73b7677 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.181154:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7af03b7-614a-4deb-9941-d1d04a49a814+12:2008:x1830963625377536:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 16101us (16187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.181159:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17496 00000100:00100000:0.0:1746143852.181427:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.181466:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625379712 00000100:00100000:2.0:1746143852.181470:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625379712 00010000:00010000:2.0:1746143852.181488:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 10 pid: 6587 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.181517:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8602 00000100:00100000:2.0:1746143852.181523:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2009:x1830963625379712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.181533:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.181537:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 10 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.181544:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 10 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.181557:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189de00/0x87925e4cb73b7638 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413069 expref: 10 pid: 6587 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.181565:0:12362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143852.181570:0:12362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.181577:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.181583:0:12362:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.181600:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.181617:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2009:x1830963625379712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.181622:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8602 00010000:00010000:0.0:1746143852.181626:0:14991:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181632:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143852.181647:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143852.181740:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181746:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181750:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181754:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b8200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143852.181757:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181762:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181769:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143852.181772:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143852.181775:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181779:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8200/0x87925e4cb73b7693 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181794:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181799:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181803:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181807:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181811:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b8c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143852.181813:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181817:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181823:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143852.181824:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143852.181827:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181831:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b8c00/0x87925e4cb73b7685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181838:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181842:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181847:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181850:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800973b9c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143852.181852:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181857:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181862:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880082e65000) 00010000:00010000:0.0:1746143852.181863:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143852.181865:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181869:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9c00/0x87925e4cb73b768c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.181908:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73b767e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841307e expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.181937:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800973b9400/0x87925e4cb73b767e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841307e expref: 16 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.181944:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800973b9400, rc 0) 00000100:00100000:0.0:1746143852.181965:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3227:x1830963625379456:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 4620us (4712us total) trans 8589945304 rc 301/301 00000100:00100000:0.0:1746143852.181975:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14189 00000100:00100000:1.0:1746143852.183546:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.183616:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625379840 00000100:00100000:3.0:1746143852.183624:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625379840 00010000:00010000:3.0:1746143852.183653:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.183675:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8603 00000100:00100000:3.0:1746143852.183680:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2009:x1830963625379840:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143852.183691:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143852.183709:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.183720:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.183737:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189ce00/0x87925e4cb73b74c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1454080->1609727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f74 expref: 37 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.183749:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.183751:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.183757:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.183764:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.183793:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 15 pid: 1947 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.183803:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 15 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:3.0:1746143852.183814:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627628544:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143852.183875:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e900 going to sleep for 11 seconds 00000100:00100000:3.0:1746143852.186490:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625378048:12345-192.168.202.3@tcp:4:cat.0 Request processed in 5984us (9145us total) trans 17179874151 rc 0/0 00000100:00100000:3.0:1746143852.186501:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2794 00002000:00100000:3.0:1746143852.186516:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->1261567) req@ffff880087df5880 x1830963625378048/t17179874151(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/448 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.186525:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5880 with x1830963625378048 ext(1048576->1261567) 00010000:00010000:3.0:1746143852.186535:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.186548:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.186555:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087df5880 00000100:00100000:3.0:1746143852.186884:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627628544:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143852.186900:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143852.187568:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2009:x1830963625379840:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3884us (4028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.187577:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8603 00000100:00100000:0.0:1746143852.189859:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.189932:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.189942:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625380352 00000100:00100000:3.0:1746143852.189952:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625380352 00002000:00100000:3.0:1746143852.189994:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880087df5f80 x1830963625380352/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.190003:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5f80 with x1830963625380352 ext(1048576->2097151) 00010000:00010000:3.0:1746143852.190013:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.190025:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143852.190033:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625380096 00002000:00010000:3.0:1746143852.190036:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df5f80 00000100:00100000:0.0:1746143852.190037:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625380096 00000100:00100000:3.0:1746143852.190054:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2795 00000100:00100000:3.0:1746143852.190060:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625380352:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143852.190066:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14190 00000100:00100000:0.0:1746143852.190071:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+267:3230:x1830963625380096:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:0.0:1746143852.190087:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.190105:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b76a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413085 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.190178:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190193:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190203:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190217:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190223:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190228:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190344:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190353:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190359:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:0.0:1746143852.190368:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:0.0:1746143852.190448:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190455:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190460:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190465:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2daa00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143852.190470:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190476:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190486:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143852.190489:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746143852.190492:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190497:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2daa00/0x87925e4cb73b76b6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190533:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190538:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190547:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190563:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190567:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2da800 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143852.190570:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190575:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190581:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143852.190583:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143852.190585:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190589:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da800/0x87925e4cb73b76a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190596:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190601:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190605:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190609:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88011e2db400 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143852.190612:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190619:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190624:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800969c8b00) 00010000:00010000:0.0:1746143852.190626:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143852.190629:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190633:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2db400/0x87925e4cb73b76af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:0.0:1746143852.190664:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b76a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413085 expref: 269 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.190671:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011e2da000/0x87925e4cb73b76a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413085 expref: 269 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.190678:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da000, rc 0) 00000100:00100000:0.0:1746143852.190734:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+268:3230:x1830963625380096:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 662us (823us total) trans 8589945305 rc 301/301 00000100:00100000:0.0:1746143852.190739:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14190 00000100:00100000:2.0:1746143852.199211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.199300:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2010:x1830963625380352:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9236us (9447us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143852.199313:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2795 00002000:00100000:3.0:1746143852.199327:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880087df5f80 x1830963625380352/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.199336:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5f80 with x1830963625380352 ext(1048576->2097151) 00010000:00010000:3.0:1746143852.199345:0:13453:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.199358:0:13453:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.199366:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087df5f80 00000100:00100000:2.0:1746143852.199374:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625380480 00000100:00100000:2.0:1746143852.199382:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625380480 00010000:00010000:2.0:1746143852.199410:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.199433:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8604 00000100:00100000:2.0:1746143852.199440:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625380480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.199574:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.199593:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.199603:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.199625:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130e28c00/0x87925e4cb73b757b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff2 expref: 36 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.199653:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.199655:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.199660:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.199672:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.199700:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.199750:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+35:2008:x1830963625380480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 310us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.199755:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8604 00010000:00010000:3.0:1746143852.200121:0:12327:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200131:0:12327:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200148:0:12327:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200160:0:12327:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200167:0:12327:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200174:0:12327:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88007f634e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143852.200177:0:12327:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200184:0:12327:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200195:0:12327:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.200201:0:12327:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634e00/0x87925e4cb73b7662 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.200276:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625377408:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 35687us (36204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.200284:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17493 00000100:00100000:0.0:1746143852.204703:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.204807:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625380608 00000100:00100000:3.0:1746143852.204818:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625380608 00000100:00100000:3.0:1746143852.204867:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17497 00000100:00100000:3.0:1746143852.204875:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+21:3224:x1830963625380608:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143852.204894:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.204941:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73b76c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841308c expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143852.204964:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a6c, atime: 0x68140a6c, ctime: 0x68140a6c, blocks: 0x808 00010000:00010000:3.0:1746143852.204988:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.204990:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.204998:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73b76c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841308c expref: 22 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.205014:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73b76c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841308c expref: 22 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.205023:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635e00, rc 0) 00000100:00100000:3.0:1746143852.205086:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:cbf1bf88-cf31-404b-8cff-930e280d3743+22:3224:x1830963625380608:12345-192.168.202.3@tcp:101:cat.0 Request processed in 211us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.205092:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17497 00000100:00100000:0.0:1746143852.206785:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.207507:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625380736 00000100:00100000:2.0:1746143852.207518:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625380736 00010000:00010000:2.0:1746143852.207554:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.207597:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8605 00000100:00100000:2.0:1746143852.207605:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2009:x1830963625380736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.207619:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.207638:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.207650:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.207672:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31000/0x87925e4cb73b764d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413077 expref: 16 pid: 1947 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.207690:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.207693:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.207697:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.207706:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.207805:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.207853:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+15:2009:x1830963625380736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 249us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.207860:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8605 00010000:00010000:3.0:1746143852.207941:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.207950:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.207968:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.207975:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.207984:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.207990:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096d9d200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143852.207994:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.208002:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.208012:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.208017:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096d9d200/0x87925e4cb73b7670 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.208063:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2008:x1830963625377280:12345-192.168.202.3@tcp:1:mirror_io.0 Request processed in 43108us (43160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.208070:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17495 00000100:00100000:0.0:1746143852.208742:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.208778:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625380864 00000100:00100000:3.0:1746143852.208783:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625380864 00000100:00100000:3.0:1746143852.208814:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17498 00000100:00100000:3.0:1746143852.208821:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+35:3230:x1830963625380864:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:3.0:1746143852.208837:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.208852:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413093 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143852.208871:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6c, blocks: 0x1510 00010000:00010000:3.0:1746143852.208887:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.208889:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.208895:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.208908:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 36 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143852.208947:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634800, rc 0) 00000100:00100000:3.0:1746143852.210127:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+36:3230:x1830963625380864:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 155us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.210136:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17498 00000100:00100000:0.0:1746143852.212863:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.213340:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625381120 00000100:00100000:3.0:1746143852.213351:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625381120 00002000:00100000:3.0:1746143852.213399:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880087df7800 x1830963625381120/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.213409:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7800 with x1830963625381120 ext(1048576->2097151) 00002000:00010000:3.0:1746143852.213414:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df7800 00000100:00100000:3.0:1746143852.213447:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7650 00000100:00100000:3.0:1746143852.213454:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625381120:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143852.214044:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.214799:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625381376 00000100:00100000:2.0:1746143852.214806:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625381376 00002000:00100000:2.0:1746143852.214839:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3432448->3436543) req@ffff880087df5c00 x1830963625381376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746143852.214846:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00100000:2.0:1746143852.214848:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5c00 with x1830963625381376 ext(3432448->3436543) 00002000:00010000:2.0:1746143852.214851:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df5c00 00000100:00100000:2.0:1746143852.214870:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7651 00000100:00100000:2.0:1746143852.214876:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625381376:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143852.214876:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625381632 00000100:00100000:0.0:1746143852.214881:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625381632 00000100:00100000:0.0:1746143852.214945:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14191 00000100:00100000:0.0:1746143852.214952:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3225:x1830963625381632:12345-192.168.202.3@tcp:36:mirror_io.0 00010000:00010000:0.0:1746143852.214995:0:14991:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746143852.215008:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+36:2011:x1830963625381376:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 132us (967us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746143852.215014:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7651 00002000:00100000:2.0:1746143852.215020:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x39f:0x0] (3432448->3436543) req@ffff880087df5c00 x1830963625381376/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746143852.215025:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e512e00/0x87925e4cb73b7646 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413070 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746143852.215026:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df5c00 with x1830963625381376 ext(3432448->3436543) 00002000:00010000:2.0:1746143852.215029:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df5c00 00010000:00010000:0.0:1746143852.215061:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143852.215067:0:14991:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143852.215109:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3225:x1830963625381632:12345-192.168.202.3@tcp:36:mirror_io.0 Request processed in 156us (263us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746143852.215115:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14191 00000100:00100000:2.0:1746143852.217331:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.217891:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625381888 00000100:00100000:1.0:1746143852.217900:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625381888 00000100:00100000:1.0:1746143852.217969:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5548 00000100:00100000:1.0:1746143852.217976:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+8:3225:x1830963625381888:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:1.0:1746143852.218190:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3225:x1830963625381888:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 213us (865us total) trans 8589945306 rc 0/0 00000100:00100000:1.0:1746143852.218199:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5548 00000100:00100000:1.0:1746143852.227107:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.227172:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.227231:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625382144 00000100:00100000:3.0:1746143852.227311:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2010:x1830963625381120:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13855us (14456us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143852.227324:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7650 00002000:00100000:3.0:1746143852.227338:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880087df7800 x1830963625381120/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.227347:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087df7800 with x1830963625381120 ext(1048576->2097151) 00002000:00010000:3.0:1746143852.227353:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087df7800 00000100:00100000:2.0:1746143852.227424:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625382400 00000100:00100000:2.0:1746143852.227436:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625382400 00000100:00100000:0.0:1746143852.227612:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625382144 00002000:00100000:0.0:1746143852.227640:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3723264->3727359) req@ffff880090e58380 x1830963625382144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.227648:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58380 with x1830963625382144 ext(3723264->3727359) 00002000:00010000:0.0:1746143852.227652:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58380 00000100:00100000:0.0:1746143852.227663:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7652 00000100:00100000:0.0:1746143852.227668:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625382144:12345-192.168.202.3@tcp:3:multiop.0 00000100:00100000:0.0:1746143852.227769:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2010:x1830963625382144:12345-192.168.202.3@tcp:3:multiop.0 Request processed in 101us (674us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746143852.227775:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7652 00002000:00100000:0.0:1746143852.227779:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3723264->3727359) req@ffff880090e58380 x1830963625382144/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.227786:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e58380 with x1830963625382144 ext(3723264->3727359) 00002000:00010000:0.0:1746143852.227789:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e58380 00000100:00100000:2.0:1746143852.227933:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5549 00000100:00100000:2.0:1746143852.227940:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:3225:x1830963625382400:12345-192.168.202.3@tcp:35:mirror_io.0 00000100:00100000:2.0:1746143852.229133:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:3225:x1830963625382400:12345-192.168.202.3@tcp:35:mirror_io.0 Request processed in 1188us (1954us total) trans 8589945307 rc 0/0 00000100:00100000:2.0:1746143852.229141:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5549 00000100:00100000:0.0:1746143852.233771:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.233813:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.233957:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.234394:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625382528 00000100:00100000:3.0:1746143852.234405:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625382528 00000100:00100000:3.0:1746143852.234449:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625382656 00000100:00100000:3.0:1746143852.234451:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625382656 00000100:00100000:3.0:1746143852.234463:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625382784 00000100:00100000:3.0:1746143852.234465:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625382784 00000100:00100000:3.0:1746143852.234489:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17499 00000100:00100000:3.0:1746143852.234506:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+22:2011:x1830963625382528:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143852.234531:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.234551:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73b76d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841309a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143852.234573:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a6c, atime: 0x68140a6b, ctime: 0x68140a6c, blocks: 0x800 00010000:00010000:3.0:1746143852.234592:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.234594:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.234604:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73b76d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841309a expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.234621:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73b76d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841309a expref: 23 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.234632:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634400, rc 0) 00000100:00100000:3.0:1746143852.234676:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625382528:12345-192.168.202.3@tcp:101:cat.0 Request processed in 172us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.234685:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17499 00000100:00100000:3.0:1746143852.234704:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17500 00000100:00100000:3.0:1746143852.234709:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625382656:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143852.234715:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.234725:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73b76d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130a1 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143852.234738:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6c, blocks: 0x808 00010000:00010000:3.0:1746143852.234746:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.234747:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.234751:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73b76d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130a1 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.234760:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73b76d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130a1 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.234767:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635000, rc 0) 00000100:00100000:3.0:1746143852.234781:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625382656:12345-192.168.202.3@tcp:101:cat.0 Request processed in 72us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.234786:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17500 00000100:00100000:3.0:1746143852.234796:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17501 00000100:00100000:3.0:1746143852.234800:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2011:x1830963625382784:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143852.234806:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.234813:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b76e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130a8 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143852.234828:0:3135:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a6c, atime: 0x68140a6c, ctime: 0x68140a6c, blocks: 0x808 00010000:00010000:3.0:1746143852.234835:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.234836:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143852.234840:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b76e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130a8 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.234848:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b76e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130a8 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.234853:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634a00, rc 0) 00000100:00100000:3.0:1746143852.234867:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625382784:12345-192.168.202.3@tcp:101:cat.0 Request processed in 66us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.234871:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17501 00000100:00100000:0.0:1746143852.235048:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.235064:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625382912 00000100:00100000:0.0:1746143852.235068:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625382912 00000100:00100000:0.0:1746143852.235086:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17502 00000100:00100000:0.0:1746143852.235091:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625382912:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.235106:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.235114:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88011e2da000/0x87925e4cb73b76e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130af expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143852.235152:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627628672:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143852.235213:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.235287:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.235432:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625383040 00000100:00100000:1.0:1746143852.235436:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625383040 00000100:00100000:1.0:1746143852.235457:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17503 00000100:00100000:1.0:1746143852.235462:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2011:x1830963625383040:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143852.235468:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.235477:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130b6 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143852.235488:0:9586:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6c, blocks: 0x1008 00010000:00010000:1.0:1746143852.235496:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.235497:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.235502:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.235510:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 18 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.235517:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25000, rc 0) 00000100:00100000:1.0:1746143852.235537:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625383040:12345-192.168.202.3@tcp:101:cat.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.235542:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17503 00000100:00100000:0.0:1746143852.238256:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.238327:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625383296 00000100:00100000:2.0:1746143852.238337:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625383296 00000100:00100000:2.0:1746143852.238395:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5550 00000100:00100000:2.0:1746143852.238403:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+268:3230:x1830963625383296:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143852.239394:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+269:3230:x1830963625383296:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 991us (1156us total) trans 8589945308 rc 0/0 00000100:00100000:2.0:1746143852.239401:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5550 00000100:00100000:0.0:1746143852.240589:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.240642:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625383424 00000100:00100000:1.0:1746143852.240650:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625383424 00000100:00100000:1.0:1746143852.240765:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17504 00000100:00100000:1.0:1746143852.240773:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:3227:x1830963625383424:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143852.240787:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.240806:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130bd expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.240836:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.240844:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.240846:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143852.240849:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2830336->3145727] (req 2830336->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.240880:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.240892:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 1011 lvb_type: 1 00000100:00100000:1.0:1746143852.240903:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627628800:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.240988:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514a80 going to sleep for 11 seconds 00002000:00010000:2.0:1746143852.242206:0:3134:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime: 1746143851 -> 1746143852 00002000:00010000:2.0:1746143852.242212:0:3134:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime: 1746143851 -> 1746143852 00000100:00100000:2.0:1746143852.242232:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bdf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627628672:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.242272:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88011e2da000/0x87925e4cb73b76e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130af expref: 24 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.242285:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88011e2da000/0x87925e4cb73b76e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130af expref: 24 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.242309:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88011e2da000, rc 0) 00000100:00100000:2.0:1746143852.242684:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+23:2011:x1830963625382912:12345-192.168.202.3@tcp:101:cat.0 Request processed in 7590us (7634us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.242692:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17502 00000100:00100000:1.0:1746143852.246262:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9839:1830963627628800:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143852.246298:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2830336->3145727] (req 2830336->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 19 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.246317:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24200, rc 0) 00000100:00100000:1.0:1746143852.246372:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+19:3227:x1830963625383424:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 5600us (5787us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.246381:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17504 00000100:00100000:0.0:1746143852.247588:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.247798:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625383552 00000100:00100000:2.0:1746143852.247806:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625383552 00000100:00100000:0.0:1746143852.247843:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.247864:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627628928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746143852.247876:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625383680 00000100:00100000:1.0:1746143852.247880:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625383680 00000100:00100000:3.0:1746143852.247906:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143852.247923:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17505 00000100:00100000:1.0:1746143852.247930:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+23:3224:x1830963625383680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143852.247945:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.247960:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130c4 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.247976:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 1011 lvb_type: 1 00010000:00010000:1.0:1746143852.247993:0:9839:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.247995:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8606 00000100:00100000:2.0:1746143852.248001:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625383552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143852.248001:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143852.248003:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143852.248007:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130c4 expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.248010:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.248030:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 1011 lvb_type: 1 00010000:00010000:1.0:1746143852.248030:0:9839:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 35 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.248039:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 1011 lvb_type: 1 00010000:00010000:1.0:1746143852.248041:0:9839:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 35 pid: 3135 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.248050:0:9839:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627629056:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.248057:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b25000/0x87925e4cb73b76ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130b6 expref: 19 pid: 9586 timeout: 1011 lvb_type: 1 00010000:00010000:2.0:1746143852.248082:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.248084:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.248090:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 18 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.248096:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 18 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143852.248101:0:9839:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.248114:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627628928 00000100:00100000:1.0:1746143852.248117:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627628928 00010000:00010000:2.0:1746143852.248121:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 18 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.248130:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627629184:192.168.202.3@tcp:105: 00000100:00080000:3.0:1746143852.248138:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143852.248148:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1746143852.248153:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963627628928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746143852.248167:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1158922304 pending 3915776 free 3906142208 avail 3674619904 00000100:00100000:2.0:1746143852.248573:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e240 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.249139:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830963627628928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 983us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.249147:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1746143852.249184:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3774:1830963627628928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746143852.250632:0:9839:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9839:1830963627629056:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143852.250657:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130c4 expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.250673:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b25c00, rc 0) 00000100:00100000:1.0:1746143852.250703:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3224:x1830963625383680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2773us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.250711:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17505 00000100:00100000:2.0:1746143852.250843:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627629184:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143852.250861:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.250882:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2008:x1830963625383552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2880us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.250890:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8606 00000100:00100000:0.0:1746143852.251044:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.251579:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625383936 00000100:00100000:3.0:1746143852.251587:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625383936 00002000:00100000:3.0:1746143852.251696:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2830336->2834431) req@ffff88009391e300 x1830963625383936/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.251707:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391e300 with x1830963625383936 ext(2830336->2834431) 00002000:00010000:3.0:1746143852.251711:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391e300 00000100:00100000:3.0:1746143852.251735:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7653 00000100:00100000:3.0:1746143852.251741:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625383936:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143852.251848:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625383936:12345-192.168.202.3@tcp:3:cat.0 Request processed in 107us (804us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143852.251854:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7653 00002000:00100000:3.0:1746143852.251858:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x3bf:0x0] (2830336->2834431) req@ffff88009391e300 x1830963625383936/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.251865:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391e300 with x1830963625383936 ext(2830336->2834431) 00002000:00010000:3.0:1746143852.251868:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391e300 00000100:00100000:0.0:1746143852.251998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.252170:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625384064 00000100:00100000:1.0:1746143852.252182:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625384064 00002000:00100000:1.0:1746143852.252584:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3432448->3727359) req@ffff88009391d180 x1830963625384064/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.252593:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d180 with x1830963625384064 ext(3432448->3727359) 00010000:00010000:1.0:1746143852.252601:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 36 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.252612:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 36 pid: 3135 timeout: 1011 lvb_type: 0 00002000:00010000:1.0:1746143852.252623:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391d180 00000100:00100000:1.0:1746143852.252658:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2796 00000100:00100000:1.0:1746143852.252664:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+36:2008:x1830963625384064:12345-192.168.202.3@tcp:4:multiop.0 00000100:00100000:2.0:1746143852.256470:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.256670:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625384192 00000100:00100000:1.0:1746143852.256679:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625384192 00000100:00100000:1.0:1746143852.256728:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17506 00000100:00100000:1.0:1746143852.256735:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+24:3227:x1830963625384192:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:1.0:1746143852.256752:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.256765:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130cb expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.256789:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143852.256791:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143852.256794:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.256804:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 25 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.256813:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092b24400, rc 0) 00000100:00100000:1.0:1746143852.256866:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:3227:x1830963625384192:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 131us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.256872:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17506 00000100:00100000:1.0:1746143852.258061:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625384064:12345-192.168.202.3@tcp:4:multiop.0 Request processed in 5394us (6060us total) trans 17179874152 rc 0/0 00000100:00100000:1.0:1746143852.258072:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2796 00002000:00100000:1.0:1746143852.258081:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3432448->3727359) req@ffff88009391d180 x1830963625384064/t17179874152(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/448 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.258089:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391d180 with x1830963625384064 ext(3432448->3727359) 00010000:00010000:1.0:1746143852.258096:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 38 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.258106:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 38 pid: 3135 timeout: 1011 lvb_type: 0 00002000:00010000:1.0:1746143852.258112:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009391d180 00000100:00100000:0.0:1746143852.261582:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.261814:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625384320 00000100:00100000:2.0:1746143852.261823:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625384320 00010000:00010000:2.0:1746143852.261854:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 38 pid: 3135 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.261879:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8607 00000100:00100000:2.0:1746143852.261884:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+38:2008:x1830963625384320:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.261895:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.261933:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 38 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.261943:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 38 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.261966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b76cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3432448->3727359) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413093 expref: 38 pid: 3135 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.261992:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.261994:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.262001:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130c4 expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.262007:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130c4 expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.262014:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.262015:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.262018:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.262024:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.262050:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.262058:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627629312:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143852.262134:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130c4 expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.262145:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627629440:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143852.262160:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a803e240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.267448:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627629312:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143852.267461:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627629440:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143852.267484:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.267520:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625384320:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5635us (5945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.267529:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8607 00000100:00100000:0.0:1746143852.267788:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.268057:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625384576 00000100:00100000:1.0:1746143852.268062:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625384576 00002000:00100000:1.0:1746143852.268092:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3416064->3420159) req@ffff88009391c000 x1830963625384576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.268100:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963625384576 ext(3416064->3420159) 00002000:00010000:1.0:1746143852.268104:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391c000 00000100:00100000:1.0:1746143852.268126:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7654 00000100:00100000:1.0:1746143852.268131:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625384576:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143852.268219:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625384576:12345-192.168.202.3@tcp:3:cat.0 Request processed in 87us (431us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746143852.268225:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7654 00002000:00100000:1.0:1746143852.268230:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (3416064->3420159) req@ffff88009391c000 x1830963625384576/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.268255:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391c000 with x1830963625384576 ext(3416064->3420159) 00002000:00010000:1.0:1746143852.268257:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391c000 00000100:00100000:0.0:1746143852.268559:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.268593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.268658:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625384960 00000100:00100000:1.0:1746143852.268662:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625384960 00002000:00100000:1.0:1746143852.268676:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88009391dc00 x1830963625384960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.268682:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963625384960 ext(2097152->3145727) 00002000:00010000:1.0:1746143852.268685:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391dc00 00000100:00100000:1.0:1746143852.268706:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625385088 00000100:00100000:1.0:1746143852.268708:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625385088 00002000:00100000:1.0:1746143852.268720:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2830335) req@ffff88009391e680 x1830963625385088/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.268727:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391e680 with x1830963625385088 ext(2097152->2830335) 00002000:00010000:1.0:1746143852.268824:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391e680 00000100:00100000:3.0:1746143852.268838:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7655 00000100:00100000:3.0:1746143852.268846:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625384960:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143852.268848:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7656 00000100:00100000:2.0:1746143852.268860:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625385088:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143852.270673:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.271477:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625385344 00000100:00100000:2.0:1746143852.271484:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625385344 00000100:00100000:2.0:1746143852.271534:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5551 00000100:00100000:2.0:1746143852.271541:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b495450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+15:3227:x1830963625385344:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:2.0:1746143852.271700:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b495450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:3227:x1830963625385344:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 159us (1032us total) trans 8589945309 rc 0/0 00000100:00100000:2.0:1746143852.271706:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5551 00000100:00100000:2.0:1746143852.277398:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625385088:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8535us (8796us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746143852.277409:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7656 00002000:00100000:2.0:1746143852.277418:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2830335) req@ffff88009391e680 x1830963625385088/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.277433:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391e680 with x1830963625385088 ext(2097152->2830335) 00002000:00010000:2.0:1746143852.277438:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009391e680 00000100:00100000:3.0:1746143852.278711:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625384960:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9864us (10150us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143852.278718:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7655 00002000:00100000:3.0:1746143852.278723:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff88009391dc00 x1830963625384960/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.278730:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009391dc00 with x1830963625384960 ext(2097152->3145727) 00002000:00010000:3.0:1746143852.278733:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009391dc00 00000100:00100000:0.0:1746143852.284625:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.284725:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625385600 00000100:00100000:3.0:1746143852.284734:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625385600 00002000:00100000:3.0:1746143852.284771:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3420160->4194303) req@ffff88009322f800 x1830963625385600/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.284780:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f800 with x1830963625385600 ext(3420160->4194303) 00002000:00010000:3.0:1746143852.284785:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322f800 00000100:00100000:3.0:1746143852.284815:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7657 00000100:00100000:3.0:1746143852.284822:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625385600:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143852.289703:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.289844:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625385856 00000100:00100000:2.0:1746143852.289853:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625385856 00002000:00100000:2.0:1746143852.289893:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009322f480 x1830963625385856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.289902:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f480 with x1830963625385856 ext(3145728->4194303) 00002000:00010000:2.0:1746143852.289907:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322f480 00000100:00100000:2.0:1746143852.289954:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7658 00000100:00100000:2.0:1746143852.289961:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625385856:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143852.295200:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625385600:12345-192.168.202.3@tcp:3:cat.0 Request processed in 10370us (10573us total) trans 0 rc 774144/774144 00000100:00100000:3.0:1746143852.295211:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7657 00002000:00100000:3.0:1746143852.295221:0:13453:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x39f:0x0] (3420160->4194303) req@ffff88009322f800 x1830963625385600/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.295228:0:13453:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f800 with x1830963625385600 ext(3420160->4194303) 00002000:00010000:3.0:1746143852.295246:0:13453:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009322f800 00000100:00100000:2.0:1746143852.297275:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2011:x1830963625385856:12345-192.168.202.3@tcp:3:cat.0 Request processed in 7309us (9241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143852.297285:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7658 00002000:00100000:2.0:1746143852.297293:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff88009322f480 x1830963625385856/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.297301:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009322f480 with x1830963625385856 ext(3145728->4194303) 00002000:00010000:2.0:1746143852.297306:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009322f480 00000100:00100000:0.0:1746143852.304089:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.304190:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625385984 00000100:00100000:2.0:1746143852.304197:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625385984 00000100:00100000:2.0:1746143852.306120:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17507 00000100:00100000:2.0:1746143852.306131:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625385984:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.306147:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.306161:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b770a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130d2 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.306203:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627629568:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143852.306847:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.310987:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627629568:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.311021:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b770a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130d2 expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.311033:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30e00/0x87925e4cb73b770a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130d2 expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.311056:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30e00, rc 0) 00000100:00100000:2.0:1746143852.311097:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2008:x1830963625385984:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4969us (7014us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.311105:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17507 00000100:00100000:1.0:1746143852.320671:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.320766:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625386240 00000100:00100000:2.0:1746143852.320774:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625386240 00002000:00100000:2.0:1746143852.320812:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880090e5bb80 x1830963625386240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.320821:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5bb80 with x1830963625386240 ext(4194304->4853759) 00002000:00010000:2.0:1746143852.320825:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5bb80 00000100:00100000:2.0:1746143852.321289:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7659 00000100:00100000:2.0:1746143852.321297:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625386240:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143852.330603:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2011:x1830963625386240:12345-192.168.202.3@tcp:3:cat.0 Request processed in 9298us (9931us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143852.330616:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7659 00002000:00100000:2.0:1746143852.330626:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff880090e5bb80 x1830963625386240/t0(0) o3->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.330634:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e5bb80 with x1830963625386240 ext(4194304->4853759) 00002000:00010000:2.0:1746143852.330639:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090e5bb80 00000100:00100000:0.0:1746143852.335847:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.335944:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625386368 00000100:00100000:2.0:1746143852.335952:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625386368 00000100:00100000:2.0:1746143852.335998:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17508 00000100:00100000:2.0:1746143852.336006:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625386368:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.336020:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.336034:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b7711 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130d9 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.336077:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627629696:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143852.336160:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.340763:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627629696:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.340797:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b7711 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130d9 expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.340809:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b7711 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130d9 expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.340869:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:2.0:1746143852.340937:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625386368:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4931us (5096us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.340945:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17508 00000100:00100000:0.0:1746143852.348830:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.348908:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625386496 00000100:00100000:2.0:1746143852.348944:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625386496 00000100:00100000:2.0:1746143852.348992:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17509 00000100:00100000:2.0:1746143852.348999:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625386496:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.349016:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.349031:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b7718 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130e0 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.349074:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627629824:192.168.202.3@tcp:106: 00000100:00100000:2.0:1746143852.349252:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.353106:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627629824:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.353137:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b7718 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e0 expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.353149:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31000/0x87925e4cb73b7718 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e0 expref: 26 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.353173:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:2.0:1746143852.353207:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2010:x1830963625386496:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4207us (4385us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.353214:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17509 00000100:00100000:0.0:1746143852.371806:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.372144:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625386752 00000100:00100000:2.0:1746143852.372152:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625386752 00000100:00100000:2.0:1746143852.372191:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14192 00000100:00100000:2.0:1746143852.372198:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+269:3235:x1830963625386752:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143852.372220:0:14991:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.372258:0:14991:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b771f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130e7 expref: -99 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.372314:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372322:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372328:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372336:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372339:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372342:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372404:0:14991:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372409:0:14991:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372411:0:14991:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00000004:00200000:2.0:1746143852.372416:0:14991:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:2.0:1746143852.372462:0:14991:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372468:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372471:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372474:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372477:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31200 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143852.372479:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372483:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372489:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:2.0:1746143852.372490:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143852.372492:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372495:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31200/0x87925e4cb73b7726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372802:0:14991:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372808:0:14991:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372812:0:14991:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372816:0:14991:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31000 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143852.372822:0:14991:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372829:0:14991:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372836:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009e601e00) 00010000:00010000:2.0:1746143852.372838:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746143852.372840:0:14991:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372844:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b772d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14991 initiator: MDT0 00010000:00010000:2.0:1746143852.372876:0:14991:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31600/0x87925e4cb73b771f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 272 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.372885:0:14991:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 271 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.372891:0:14991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143852.372893:0:14991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746143852.372895:0:14991:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00000100:00100000:2.0:1746143852.372956:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+271:3235:x1830963625386752:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 757us (1156us total) trans 8589945310 rc 0/0 00000100:00100000:2.0:1746143852.372962:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14192 00000100:00100000:0.0:1746143852.385017:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.388317:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.388350:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.388374:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.388653:0:8215:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625386880 00000100:00100000:0.0:1746143852.388661:0:8215:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625386880 00000100:00100000:0.0:1746143852.388697:0:8215:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 245 00000100:00100000:0.0:1746143852.388703:0:8215:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2010:x1830963625386880:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143852.388857:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387008 00000100:00100000:2.0:1746143852.388861:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387008 00000100:00100000:2.0:1746143852.388895:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387264 00000100:00100000:2.0:1746143852.388897:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387264 00000100:00100000:2.0:1746143852.388909:0:14991:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387136 00000100:00100000:2.0:1746143852.388924:0:14991:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387136 00000100:00100000:2.0:1746143852.388938:0:14991:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1230 00000100:00100000:2.0:1746143852.388943:0:14991:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+20:2010:x1830963625387008:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1746143852.389050:0:8215:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2010:x1830963625386880:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 344us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.389058:0:8215:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 245 00000100:00100000:0.0:1746143852.389101:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1231 00000100:00100000:0.0:1746143852.389108:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2010:x1830963625387264:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1746143852.389735:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1232 00000100:00100000:3.0:1746143852.389744:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2010:x1830963625387136:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1746143852.390019:0:14991:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7448e42d-373a-41e0-9678-9a18291c6700+20:2010:x1830963625387008:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1074us (5009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.390026:0:14991:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1230 00000100:00080000:2.0:1746143852.390059:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746143852.390435:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2010:x1830963625387136:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 691us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143852.390441:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1232 00000100:00100000:0.0:1746143852.390619:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2010:x1830963625387264:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1511us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.390625:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1231 00000100:00100000:0.0:1746143852.401368:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.401409:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.401433:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.401458:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.401472:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.401493:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.401524:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387392 00000100:00100000:0.0:1746143852.401531:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387392 00000100:00100000:0.0:1746143852.401566:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17510 00000100:00100000:0.0:1746143852.401574:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+37:2010:x1830963625387392:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.401588:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.401602:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130ee expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.401620:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401622:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401630:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401643:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 38 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401652:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2c00, rc 0) 00000100:00100000:0.0:1746143852.401686:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625387392:12345-192.168.202.3@tcp:101:cat.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.401692:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17510 00000100:00100000:0.0:1746143852.401705:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387520 00000100:00100000:0.0:1746143852.401708:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387520 00000100:00100000:0.0:1746143852.401719:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387648 00000100:00100000:0.0:1746143852.401721:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387648 00000100:00100000:0.0:1746143852.401730:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387776 00000100:00100000:0.0:1746143852.401732:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387776 00000100:00100000:0.0:1746143852.401740:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625387904 00000100:00100000:0.0:1746143852.401741:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625387904 00000100:00100000:0.0:1746143852.401748:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625388032 00000100:00100000:0.0:1746143852.401749:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625388032 00000100:00100000:0.0:1746143852.401759:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17511 00000100:00100000:0.0:1746143852.401763:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625387520:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.401784:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.401792:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130f5 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.401803:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401804:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401808:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401817:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401823:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2400, rc 0) 00000100:00100000:0.0:1746143852.401839:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625387520:12345-192.168.202.3@tcp:101:cat.0 Request processed in 75us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.401844:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17511 00000100:00100000:0.0:1746143852.401854:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17512 00000100:00100000:0.0:1746143852.401858:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625387648:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.401864:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.401869:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484130fc expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.401878:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401879:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401883:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401890:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 39 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401896:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3400, rc 0) 00000100:00100000:0.0:1746143852.401933:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625387648:12345-192.168.202.3@tcp:101:cat.0 Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.401939:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17512 00000100:00100000:0.0:1746143852.401952:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17513 00000100:00100000:0.0:1746143852.401956:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625387776:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.401961:0:9586:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.401967:0:9586:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413103 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143852.401975:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401976:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143852.401980:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 40 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401986:0:9586:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 40 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.401992:0:9586:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b3e00, rc 0) 00000100:00100000:3.0:1746143852.402048:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17514 00000100:00100000:3.0:1746143852.402055:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963625387904:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143852.402060:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.402067:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b775e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841310a expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.402097:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627629952:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143852.402146:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800973580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746143852.402161:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17515 00000100:00100000:3.0:1746143852.402165:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625388032:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1746143852.402174:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143852.402180:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7765 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413111 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143852.402200:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627630080:192.168.202.3@tcp:106: 00000100:00100000:3.0:1746143852.402218:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.403264:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625387776:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1305us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143852.403272:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17513 00000100:00100000:3.0:1746143852.406688:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627629952:192.168.202.3@tcp:106: 00010000:00010000:3.0:1746143852.406719:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b775e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841310a expref: 40 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.406729:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634800/0x87925e4cb73b775e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841310a expref: 40 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143852.407155:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f634800, rc 0) 00000100:00100000:3.0:1746143852.407303:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625387904:12345-192.168.202.3@tcp:101:cat.0 Request processed in 5248us (5828us total) trans 0 rc 301/301 00000100:00100000:3.0:1746143852.407311:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17514 00002000:00010000:0.0:1746143852.411267:0:13436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143852.411274:0:13436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime: 1746143851 -> 1746143852 00000100:00100000:0.0:1746143852.411292:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627630080:192.168.202.3@tcp:106: 00010000:00010000:0.0:1746143852.411321:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7765 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413111 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.411333:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635800/0x87925e4cb73b7765 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413111 expref: 39 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143852.411359:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88007f635800, rc 0) 00000100:00100000:0.0:1746143852.411395:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625388032:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9228us (9900us total) trans 0 rc 301/301 00000100:00100000:0.0:1746143852.411403:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17515 00000100:00100000:0.0:1746143852.434679:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.434815:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625388288 00000100:00100000:2.0:1746143852.434824:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625388288 00002000:00100000:2.0:1746143852.434862:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88011e309180 x1830963625388288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.434871:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309180 with x1830963625388288 ext(0->1048575) 00002000:00010000:2.0:1746143852.434876:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e309180 00000100:00100000:2.0:1746143852.435766:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7660 00000100:00100000:2.0:1746143852.435777:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625388288:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:0.0:1746143852.443593:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.444181:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.444273:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.444303:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625388544 00000100:00100000:0.0:1746143852.444309:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625388544 00002000:00100000:0.0:1746143852.444343:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880093cfa300 x1830963625388544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.444352:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa300 with x1830963625388544 ext(1048576->2097151) 00002000:00010000:0.0:1746143852.444356:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfa300 00000100:00100000:0.0:1746143852.444388:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625388800 00000100:00100000:0.0:1746143852.444391:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625388800 00002000:00100000:0.0:1746143852.444402:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880093cfb800 x1830963625388800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.444407:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfb800 with x1830963625388800 ext(1048576->2097151) 00002000:00010000:0.0:1746143852.444409:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfb800 00000100:00100000:0.0:1746143852.444418:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389056 00000100:00100000:0.0:1746143852.444419:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389056 00002000:00100000:0.0:1746143852.444427:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093cf8e00 x1830963625389056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.444433:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8e00 with x1830963625389056 ext(1048576->2097151) 00002000:00010000:0.0:1746143852.444435:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8e00 00000100:00100000:0.0:1746143852.444444:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7661 00000100:00100000:0.0:1746143852.444449:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625388544:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143852.444662:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7662 00000100:00100000:1.0:1746143852.444670:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625388800:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143852.445227:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7663 00000100:00100000:1.0:1746143852.445243:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625389056:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143852.453054:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:2011:x1830963625388288:12345-192.168.202.3@tcp:3:cat.0 Request processed in 17269us (18372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143852.453065:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7660 00002000:00100000:2.0:1746143852.453075:0:9592:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x39c:0x0] (0->1048575) req@ffff88011e309180 x1830963625388288/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.453084:0:9592:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e309180 with x1830963625388288 ext(0->1048575) 00002000:00010000:2.0:1746143852.453091:0:9592:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e309180 00000100:00100000:0.0:1746143852.463138:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.463354:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625389056:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18120us (19080us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143852.463359:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625388800:12345-192.168.202.3@tcp:3:cat.0 Request processed in 18689us (19177us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143852.463363:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7663 00000100:00100000:1.0:1746143852.463369:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7662 00002000:00100000:0.0:1746143852.463371:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39e:0x0] (1048576->2097151) req@ffff880093cf8e00 x1830963625389056/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.463375:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3be:0x0] (1048576->2097151) req@ffff880093cfb800 x1830963625388800/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746143852.463379:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8e00 with x1830963625389056 ext(1048576->2097151) 00002000:00100000:1.0:1746143852.463382:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfb800 with x1830963625388800 ext(1048576->2097151) 00002000:00010000:0.0:1746143852.463384:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cf8e00 00002000:00010000:1.0:1746143852.463385:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfb800 00000100:00100000:2.0:1746143852.464001:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389184 00000100:00100000:2.0:1746143852.464007:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389184 00000100:00100000:2.0:1746143852.464054:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17516 00000100:00100000:2.0:1746143852.464060:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+40:3235:x1830963625389184:12345-192.168.202.3@tcp:101:multiop.0 00010000:00010000:2.0:1746143852.464078:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.464093:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413118 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.464120:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 17 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.464127:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143852.464128:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143852.464131:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2191360->2850815] (req 2191360->2850815) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 41 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.464159:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 17 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.464168:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 17 pid: 9839 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.464178:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627630208:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143852.464250:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.470443:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625388544:12345-192.168.202.3@tcp:3:cat.0 Request processed in 25984us (26848us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143852.470453:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7661 00002000:00100000:2.0:1746143852.470463:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bd:0x0] (1048576->2097151) req@ffff880093cfa300 x1830963625388544/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.470470:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa300 with x1830963625388544 ext(1048576->2097151) 00002000:00010000:2.0:1746143852.470475:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfa300 00000100:00100000:2.0:1746143852.473884:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627630208:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143852.473932:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2191360->2850815] (req 2191360->2850815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 39 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.473947:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:2.0:1746143852.476120:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+39:3235:x1830963625389184:12345-192.168.202.3@tcp:101:multiop.0 Request processed in 12051us (12981us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.476129:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17516 00000100:00100000:1.0:1746143852.481483:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.481738:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389312 00000100:00100000:3.0:1746143852.481746:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389312 00002000:00100000:3.0:1746143852.481783:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2830336->3145727) req@ffff880090e59180 x1830963625389312/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.481792:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59180 with x1830963625389312 ext(2830336->3145727) 00010000:00010000:3.0:1746143852.481799:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 18 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.481812:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 18 pid: 9839 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.481818:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e59180 00000100:00100000:3.0:1746143852.481836:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2797 00000100:00100000:3.0:1746143852.481843:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+18:2009:x1830963625389312:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:0.0:1746143852.491973:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.492007:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.492034:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389440 00000100:00100000:0.0:1746143852.492040:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389440 00000100:00100000:0.0:1746143852.492072:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389568 00000100:00100000:0.0:1746143852.492073:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389568 00000100:00100000:0.0:1746143852.492086:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17517 00000100:00100000:0.0:1746143852.492091:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625389440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.492106:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.492118:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73b7773 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841311f expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143852.492154:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627630336:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143852.492210:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746143852.492296:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17518 00000100:00100000:0.0:1746143852.492301:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625389568:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1746143852.492307:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143852.492316:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b777a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413126 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143852.492334:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627630464:192.168.202.3@tcp:106: 00000100:00100000:0.0:1746143852.492351:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a834af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143852.492475:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2009:x1830963625389312:12345-192.168.202.3@tcp:4:cat.0 Request processed in 10631us (10998us total) trans 21474841406 rc 0/0 00000100:00100000:3.0:1746143852.492483:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2797 00002000:00100000:3.0:1746143852.492491:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2830336->3145727) req@ffff880090e59180 x1830963625389312/t21474841406(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/448 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.492497:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090e59180 with x1830963625389312 ext(2830336->3145727) 00010000:00010000:3.0:1746143852.492503:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 20 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:3.0:1746143852.492513:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 20 pid: 9839 timeout: 1011 lvb_type: 0 00002000:00010000:3.0:1746143852.492519:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090e59180 00000100:00100000:1.0:1746143852.496302:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cfaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3134:1830963627630464:192.168.202.3@tcp:106: 00010000:00010000:1.0:1746143852.496329:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b777a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413126 expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.496342:0:3134:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2600/0x87925e4cb73b777a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413126 expref: 40 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143852.496367:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2600, rc 0) 00000100:00100000:1.0:1746143852.496401:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625389568:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4099us (4392us total) trans 0 rc 301/301 00000100:00100000:1.0:1746143852.496408:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17518 00000100:00100000:2.0:1746143852.496551:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627630336:192.168.202.3@tcp:106: 00010000:00010000:2.0:1746143852.496565:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73b7773 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841311f expref: 40 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.496574:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2000/0x87925e4cb73b7773 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841311f expref: 40 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143852.496584:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800820b2000, rc 0) 00000100:00100000:2.0:1746143852.496601:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625389440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4510us (4634us total) trans 0 rc 301/301 00000100:00100000:2.0:1746143852.496606:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17517 00000100:00100000:0.0:1746143852.500563:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.501077:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389696 00000100:00100000:2.0:1746143852.501085:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389696 00000100:00100000:2.0:1746143852.501130:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17519 00000100:00100000:2.0:1746143852.501136:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+39:3240:x1830963625389696:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1746143852.501152:0:3135:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143852.501166:0:3135:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841312d expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.501188:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.501189:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.501195:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 40 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.501207:0:3135:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 40 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.501216:0:3135:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31600, rc 0) 00000100:00100000:2.0:1746143852.501260:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+40:3240:x1830963625389696:12345-192.168.202.3@tcp:101:cat.0 Request processed in 123us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.501266:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17519 00000100:00100000:0.0:1746143852.509499:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.509711:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625389824 00000100:00100000:2.0:1746143852.509721:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625389824 00010000:00010000:2.0:1746143852.509755:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 20 pid: 9839 timeout: 1011 lvb_type: 0 00000100:00100000:0.0:1746143852.510354:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.511079:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8608 00000100:00100000:2.0:1746143852.511089:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2008:x1830963625389824:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.511101:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.511119:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 20 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.511131:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 20 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.511154:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092b24200/0x87925e4cb73b76f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2830336->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130bd expref: 20 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.511969:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.511972:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.511979:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.511987:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.512014:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 38 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.512023:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627630592:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143852.512076:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097362240 going to sleep for 11 seconds 00000100:00100000:3.0:1746143852.512850:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625390080 00000100:00100000:3.0:1746143852.512858:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625390080 00002000:00100000:3.0:1746143852.512889:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093cfb480 x1830963625390080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.512898:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfb480 with x1830963625390080 ext(2097152->3145727) 00002000:00010000:3.0:1746143852.512901:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cfb480 00000100:00100000:3.0:1746143852.512933:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7664 00000100:00100000:3.0:1746143852.512940:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963625390080:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143852.518571:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7231:1830963627630592:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143852.518595:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.518641:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2008:x1830963625389824:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7554us (9149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.518650:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8608 00000100:00100000:0.0:1746143852.519954:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.520983:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963625390080:12345-192.168.202.3@tcp:3:cat.0 Request processed in 8040us (10626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143852.520992:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7664 00002000:00100000:3.0:1746143852.521001:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (2097152->3145727) req@ffff880093cfb480 x1830963625390080/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.521009:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfb480 with x1830963625390080 ext(2097152->3145727) 00002000:00010000:3.0:1746143852.521015:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093cfb480 00000100:00100000:3.0:1746143852.521031:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625390336 00000100:00100000:3.0:1746143852.521036:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625390336 00002000:00100000:3.0:1746143852.521057:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2191360->2195455) req@ffff880093cf9f80 x1830963625390336/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.521064:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9f80 with x1830963625390336 ext(2191360->2195455) 00002000:00010000:3.0:1746143852.521066:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9f80 00000100:00100000:3.0:1746143852.521078:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7665 00000100:00100000:3.0:1746143852.521083:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625390336:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143852.521164:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2008:x1830963625390336:12345-192.168.202.3@tcp:3:cat.0 Request processed in 81us (1213us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143852.521169:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7665 00002000:00100000:3.0:1746143852.521173:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2191360->2195455) req@ffff880093cf9f80 x1830963625390336/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.521179:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9f80 with x1830963625390336 ext(2191360->2195455) 00002000:00010000:3.0:1746143852.521181:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9f80 00000100:00100000:0.0:1746143852.527094:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.527578:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625390592 00000100:00100000:1.0:1746143852.527587:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625390592 00002000:00100000:1.0:1746143852.527625:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2191359) req@ffff880093cf9180 x1830963625390592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.527633:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9180 with x1830963625390592 ext(2097152->2191359) 00002000:00010000:1.0:1746143852.527639:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9180 00000100:00100000:1.0:1746143852.527671:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7666 00000100:00100000:1.0:1746143852.527678:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625390592:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143852.530592:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625390592:12345-192.168.202.3@tcp:3:cat.0 Request processed in 2906us (3498us total) trans 0 rc 94208/94208 00000100:00100000:1.0:1746143852.530603:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7666 00002000:00100000:1.0:1746143852.530612:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2097152->2191359) req@ffff880093cf9180 x1830963625390592/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 94208/94208 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.530621:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf9180 with x1830963625390592 ext(2097152->2191359) 00002000:00010000:1.0:1746143852.530626:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf9180 00000100:00100000:0.0:1746143852.533431:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.534708:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143852.534898:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625390848 00000100:00100000:3.0:1746143852.534908:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625390848 00000100:00100000:1.0:1746143852.534946:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625391104 00000100:00100000:1.0:1746143852.534953:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625391104 00002000:00100000:3.0:1746143852.534978:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2846720->2850815) req@ffff880093cf8a80 x1830963625390848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.534988:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8a80 with x1830963625390848 ext(2846720->2850815) 00002000:00100000:1.0:1746143852.534989:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2850816->3145727) req@ffff880093cfa680 x1830963625391104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746143852.534993:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf8a80 00002000:00100000:1.0:1746143852.534997:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa680 with x1830963625391104 ext(2850816->3145727) 00002000:00010000:1.0:1746143852.535002:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfa680 00000100:00100000:3.0:1746143852.535039:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7667 00000100:00100000:1.0:1746143852.535045:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7668 00000100:00100000:3.0:1746143852.535047:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625390848:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143852.535053:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2010:x1830963625391104:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1746143852.535189:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625390848:12345-192.168.202.3@tcp:3:cat.0 Request processed in 142us (1768us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746143852.535197:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7667 00002000:00100000:3.0:1746143852.535202:0:13437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x3bf:0x0] (2846720->2850815) req@ffff880093cf8a80 x1830963625390848/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/4536 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746143852.535208:0:13437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cf8a80 with x1830963625390848 ext(2846720->2850815) 00002000:00010000:3.0:1746143852.535210:0:13437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cf8a80 00000100:00100000:0.0:1746143852.540998:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.541098:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625391360 00000100:00100000:2.0:1746143852.541109:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625391360 00000100:00100000:2.0:1746143852.541177:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5552 00000100:00100000:2.0:1746143852.541185:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+271:3235:x1830963625391360:12345-192.168.202.3@tcp:35:multiop.0 00000100:00100000:1.0:1746143852.541191:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+39:2010:x1830963625391104:12345-192.168.202.3@tcp:3:cat.0 Request processed in 6137us (6486us total) trans 0 rc 294912/294912 00000100:00100000:1.0:1746143852.541202:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7668 00002000:00100000:1.0:1746143852.541213:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (2850816->3145727) req@ffff880093cfa680 x1830963625391104/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 294912/294912 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.541224:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cfa680 with x1830963625391104 ext(2850816->3145727) 00002000:00010000:1.0:1746143852.541242:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093cfa680 00000100:00100000:2.0:1746143852.541388:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+272:3235:x1830963625391360:12345-192.168.202.3@tcp:35:multiop.0 Request processed in 203us (400us total) trans 8589945311 rc 0/0 00000100:00100000:2.0:1746143852.541394:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5552 00000100:00100000:0.0:1746143852.544014:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.544158:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625391488 00000100:00100000:1.0:1746143852.544167:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625391488 00000100:00100000:1.0:1746143852.544220:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17520 00000100:00100000:1.0:1746143852.544227:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+40:3240:x1830963625391488:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1746143852.544252:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143852.544270:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413134 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.544300:0:3134:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.544308:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143852.544310:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143852.544313:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.544347:0:3134:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 24 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.544359:0:3134:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 24 pid: 9839 timeout: 1011 lvb_type: 0 00000100:00100000:1.0:1746143852.544370:0:3134:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627630720:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143852.545198:0:3134:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746143852.548726:0:3134:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3134:1830963627630720:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143852.548754:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 41 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143852.548774:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55a200, rc 0) 00000100:00100000:1.0:1746143852.548810:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+41:3240:x1830963625391488:12345-192.168.202.3@tcp:101:cat.0 Request processed in 4585us (4806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143852.548818:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17520 00000100:00100000:0.0:1746143852.549799:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.550094:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625391616 00000100:00100000:1.0:1746143852.550100:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625391616 00002000:00100000:1.0:1746143852.550130:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3420159) req@ffff8800972ebb80 x1830963625391616/t0(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.550137:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ebb80 with x1830963625391616 ext(3145728->3420159) 00010000:00010000:1.0:1746143852.550143:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 25 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.550153:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 25 pid: 9839 timeout: 1011 lvb_type: 0 00002000:00010000:1.0:1746143852.550158:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972ebb80 00000100:00100000:1.0:1746143852.550503:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2798 00000100:00100000:1.0:1746143852.550510:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+25:2009:x1830963625391616:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143852.555330:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2009:x1830963625391616:12345-192.168.202.3@tcp:4:cat.0 Request processed in 4807us (5519us total) trans 17179874153 rc 0/0 00000100:00100000:1.0:1746143852.555345:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2798 00002000:00100000:1.0:1746143852.555358:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->3420159) req@ffff8800972ebb80 x1830963625391616/t17179874153(0) o4->cbf1bf88-cf31-404b-8cff-930e280d3743@192.168.202.3@tcp:248/0 lens 488/448 e 0 to 0 dl 1746143863 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.555374:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972ebb80 with x1830963625391616 ext(3145728->3420159) 00010000:00010000:1.0:1746143852.555385:0:20386:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 27 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:1.0:1746143852.555401:0:20386:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 27 pid: 9839 timeout: 1011 lvb_type: 0 00002000:00010000:1.0:1746143852.555408:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800972ebb80 00000100:00100000:0.0:1746143852.558749:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.558965:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625391744 00000100:00100000:2.0:1746143852.558976:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625391744 00010000:00010000:2.0:1746143852.559018:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 27 pid: 9839 timeout: 1011 lvb_type: 0 00000100:00100000:2.0:1746143852.559063:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8609 00000100:00100000:2.0:1746143852.559071:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+27:2010:x1830963625391744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143852.559087:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143852.559108:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 27 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.559120:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 27 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.559144:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b24400/0x87925e4cb73b7703 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130cb expref: 27 pid: 9839 timeout: 1011 lvb_type: 0 00010000:00010000:2.0:1746143852.559168:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.559170:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143852.559177:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.559187:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143852.559223:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 40 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143852.559246:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627630848:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143852.559340:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e72b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746143852.560940:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7231:1830963627630848:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143852.560964:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143852.561003:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2010:x1830963625391744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1931us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143852.561013:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8609 00000100:00100000:0.0:1746143852.564131:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143852.564413:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143852.564482:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625392128 00000100:00100000:1.0:1746143852.564492:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625392128 00002000:00100000:1.0:1746143852.564537:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800972e9500 x1830963625392128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.564546:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9500 with x1830963625392128 ext(3145728->4194303) 00002000:00010000:1.0:1746143852.564552:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9500 00000100:00100000:1.0:1746143852.564581:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625392256 00000100:00100000:1.0:1746143852.564584:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625392256 00002000:00100000:1.0:1746143852.564598:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800972e8380 x1830963625392256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.564604:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8380 with x1830963625392256 ext(3145728->4194303) 00002000:00010000:1.0:1746143852.564608:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8380 00000100:00100000:1.0:1746143852.564621:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7669 00000100:00100000:1.0:1746143852.564628:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625392128:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143852.565070:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7670 00000100:00100000:2.0:1746143852.565080:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625392256:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:1.0:1746143852.578150:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625392128:12345-192.168.202.3@tcp:3:cat.0 Request processed in 13510us (14017us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143852.578167:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7669 00002000:00100000:1.0:1746143852.578179:0:20386:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x39f:0x0] (3145728->4194303) req@ffff8800972e9500 x1830963625392128/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746143852.578189:0:20386:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e9500 with x1830963625392128 ext(3145728->4194303) 00002000:00010000:1.0:1746143852.578194:0:20386:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800972e9500 00000100:00100000:2.0:1746143852.581715:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800972e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2009:x1830963625392256:12345-192.168.202.3@tcp:3:cat.0 Request processed in 16625us (17289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143852.581731:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7670 00002000:00100000:2.0:1746143852.581743:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (3145728->4194303) req@ffff8800972e8380 x1830963625392256/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.581753:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800972e8380 with x1830963625392256 ext(3145728->4194303) 00002000:00010000:2.0:1746143852.581760:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800972e8380 00000100:00100000:0.0:1746143852.586098:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143852.586304:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625392512 00000100:00100000:2.0:1746143852.586314:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625392512 00002000:00100000:2.0:1746143852.586367:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009eb86a00 x1830963625392512/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/0 e 0 to 0 dl 1746143863 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.586383:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb86a00 with x1830963625392512 ext(4194304->4853759) 00002000:00010000:2.0:1746143852.586389:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb86a00 00000100:00100000:2.0:1746143852.586420:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7671 00000100:00100000:2.0:1746143852.586427:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625392512:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:2.0:1746143852.591687:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625392512:12345-192.168.202.3@tcp:3:cat.0 Request processed in 5245us (5585us total) trans 0 rc 659456/659456 00000100:00100000:2.0:1746143852.591701:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7671 00002000:00100000:2.0:1746143852.591716:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x39f:0x0] (4194304->4853759) req@ffff88009eb86a00 x1830963625392512/t0(0) o3->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:248/0 lens 488/440 e 0 to 0 dl 1746143863 ref 1 fl Complete:/200/0 rc 659456/659456 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143852.591725:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009eb86a00 with x1830963625392512 ext(4194304->4853759) 00002000:00010000:2.0:1746143852.591731:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009eb86a00 00010000:00010000:3.0:1746143853.003301:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143853.154730:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.154835:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625392768 00000100:00100000:3.0:1746143853.154845:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625392768 00000100:00100000:3.0:1746143853.155200:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5553 00000100:00100000:3.0:1746143853.155209:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+16:3262:x1830963625392768:12345-192.168.202.3@tcp:35:umount.0 00000100:00080000:2.0:1746143853.155393:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143853.156045:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009eb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+17:3262:x1830963625392768:12345-192.168.202.3@tcp:35:umount.0 Request processed in 834us (1322us total) trans 8589945312 rc 0/0 00000100:00100000:3.0:1746143853.156052:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5553 00000100:00100000:0.0:1746143853.159202:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.159253:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.159272:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625393152 00000100:00100000:0.0:1746143853.159282:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.159283:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625393152 00000100:00100000:0.0:1746143853.159313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.159360:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625393536 00000100:00100000:1.0:1746143853.159364:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625393536 00000100:00100000:1.0:1746143853.159396:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17521 00000100:00100000:1.0:1746143853.159403:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+26:2007:x1830963625393536:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:1.0:1746143853.159433:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac18 00000020:00010000:1.0:1746143853.159440:0:3134:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d7dd000: total 0 00000100:00080000:1.0:1746143853.159444:0:3134:0:(import.c:66:import_set_state_nolock()) ffff88012d7d9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143853.159482:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874153 00000100:00100000:2.0:1746143853.159547:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625393664 00000100:00100000:0.0:1746143853.159547:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625393408 00000100:00100000:2.0:1746143853.159550:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625393664 00000100:00100000:0.0:1746143853.159550:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625393408 00000100:00100000:2.0:1746143853.159568:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1031 00000100:00100000:0.0:1746143853.159572:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1032 00000100:00100000:2.0:1746143853.159573:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93450669-9bf3-4ab5-957d-82afaeb40d5e+17:2009:x1830963625393152:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143853.159576:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93450669-9bf3-4ab5-957d-82afaeb40d5e+17:2009:x1830963625393664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.159582:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.159582:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.159599:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009e513e00/0x87925e4cb73aabee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bdf3 expref: 17 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.159600:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009e522c00/0x87925e4cb73aabfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840be2b expref: 17 pid: 8213 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.159615:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143853.159615:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143853.159655:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1033 00000100:00100000:0.0:1746143853.159656:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963625393664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 80us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.159661:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93450669-9bf3-4ab5-957d-82afaeb40d5e+15:2009:x1830963625393408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143853.159662:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1032 00010000:00010000:3.0:1746143853.159670:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143853.159677:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009e523400/0x87925e4cb73aabf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840be24 expref: 14 pid: 8213 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.159687:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143853.159718:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93450669-9bf3-4ab5-957d-82afaeb40d5e+13:2009:x1830963625393152:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 144us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.159727:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1031 00000020:00010000:2.0:1746143853.159783:0:7232:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d7dd000: total 0 00010000:00010000:2.0:1746143853.159786:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143853.159823:0:7232:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d7dd000, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746143853.159864:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f635e00/0x87925e4cb73b76c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841308c expref: 25 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.159884:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88007f634400/0x87925e4cb73b76d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841309a expref: 24 pid: 3135 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.159902:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092b25c00/0x87925e4cb73b76fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130c4 expref: 23 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.159929:0:7232:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d7dd000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746143853.159941:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143853.159943:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746143853.159944:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143853.160165:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93450669-9bf3-4ab5-957d-82afaeb40d5e+12:2009:x1830963625393408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 503us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.160165:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+20:2007:x1830963625393536:12345-192.168.202.3@tcp:9:umount.0 Request processed in 761us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.160171:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17521 00000100:00100000:3.0:1746143853.160172:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1033 00000100:00100000:0.0:1746143853.175172:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.175285:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625394048 00000100:00100000:1.0:1746143853.175295:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625394048 00000100:00100000:1.0:1746143853.175350:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17522 00000100:00100000:1.0:1746143853.175358:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+19:2007:x1830963625394048:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:1.0:1746143853.175391:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac11 00000020:00010000:1.0:1746143853.175397:0:3134:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d7d8800: total 0 00000100:00080000:1.0:1746143853.175402:0:3134:0:(import.c:66:import_set_state_nolock()) ffff88012d7dc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143853.175456:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841406 00000020:00010000:3.0:1746143853.175641:0:7233:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d7d8800: total 0 00010000:00010000:3.0:1746143853.175685:0:7233:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d7d8800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746143853.175734:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f635000/0x87925e4cb73b76d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130a1 expref: 17 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143853.175761:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2007:x1830963625394048:12345-192.168.202.3@tcp:9:umount.0 Request processed in 395us (593us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143853.175762:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88007f634a00/0x87925e4cb73b76e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130a8 expref: 16 pid: 3135 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746143853.175773:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17522 00010000:00010000:3.0:1746143853.175774:0:7233:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d7d8800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746143853.175782:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143853.175784:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143853.175785:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143853.184824:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.186081:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625394432 00000100:00100000:2.0:1746143853.186092:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625394432 00000100:00100000:2.0:1746143853.186152:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14193 00000100:00100000:2.0:1746143853.186160:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+17:2007:x1830963625394432:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:2.0:1746143853.186195:0:6587:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac03 00000020:00010000:2.0:1746143853.186205:0:6587:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009e4d5800: total 0 00000100:00080000:2.0:1746143853.186210:0:6587:0:(import.c:66:import_set_state_nolock()) ffff88009e4d6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143853.186299:0:6587:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945312 00000100:00100000:2.0:1746143853.186450:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbf1bf88-cf31-404b-8cff-930e280d3743+16:2007:x1830963625394432:12345-192.168.202.3@tcp:39:umount.0 Request processed in 290us (1637us total) trans 8589945313 rc 0/0 00000100:00100000:2.0:1746143853.186462:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14193 00000020:00010000:0.0:1746143853.186562:0:10929:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009e4d5800: total 0 00010000:00010000:0.0:1746143853.186611:0:10929:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009e4d5800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1746143853.186643:0:10929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143853.186655:0:10929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746143853.186661:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a52c00/0x87925e4cb73b75ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841300e expref: 15 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.186683:0:10929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143853.186685:0:10929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1746143853.186688:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466c00/0x87925e4cb73ad921 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840d6ea expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.186701:0:10929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143853.186703:0:10929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746143853.186706:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849600/0x87925e4cb73aac8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bed3 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.186715:0:10929:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:0.0:1746143853.186717:0:10929:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746143853.186719:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189d200/0x87925e4cb73b7486 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f35 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.186726:0:10929:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009e4d5800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1746143853.186735:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143853.186736:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143853.186737:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143853.192062:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.192131:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625394560 00000100:00100000:3.0:1746143853.192142:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625394560 00000100:00100000:3.0:1746143853.192204:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14194 00000100:00100000:3.0:1746143853.192212:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+5:2007:x1830963625394560:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:3.0:1746143853.192261:0:7243:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac0a 00000100:00080000:3.0:1746143853.192269:0:7243:0:(import.c:66:import_set_state_nolock()) ffff88012d965000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143853.192300:0:7243:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967757 00010000:00010000:0.0:1746143853.192490:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746143853.192892:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbf1bf88-cf31-404b-8cff-930e280d3743+3:2007:x1830963625394560:12345-192.168.202.3@tcp:39:umount.0 Request processed in 671us (833us total) trans 4294967758 rc 0/0 00000100:00100000:3.0:1746143853.192902:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14194 00000100:00100000:0.0:1746143853.544085:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143853.544107:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627630976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143853.544176:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.544262:0:13946:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627630976 00000100:00100000:1.0:1746143853.544273:0:13946:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627630976 00000100:00100000:1.0:1746143853.544326:0:13946:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1746143853.544333:0:13946:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627630976:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1746143853.544356:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1746143853.544356:0:13946:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 684032 granted 684469440 pending 5984256 free 3910172672 avail 3678650368 00000100:00100000:1.0:1746143853.544416:0:13946:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3772:x1830963627630976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.544422:0:13946:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1746143853.544470:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3772:1830963627630976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746143853.716594:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.716643:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.716668:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.716709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.716755:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625395200 00000100:00100000:0.0:1746143853.716764:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625395200 00000100:00100000:0.0:1746143853.716810:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625395072 00000100:00100000:0.0:1746143853.716812:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625395072 00000100:00100000:0.0:1746143853.716823:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625395328 00000100:00100000:0.0:1746143853.716825:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625395328 00000100:00100000:0.0:1746143853.716839:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1034 00000100:00100000:0.0:1746143853.716846:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+14:2009:x1830963625395200:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143853.716859:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.716880:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5bb4800/0x87925e4cb73aac26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840be8d expref: 14 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.716900:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143853.716976:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+13:2009:x1830963625395200:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.716982:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1034 00000100:00100000:0.0:1746143853.716996:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1035 00000100:00100000:0.0:1746143853.717000:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+12:2009:x1830963625395072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143853.717006:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.717013:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5bb5800/0x87925e4cb73aac1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840be5c expref: 12 pid: 8215 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.717020:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143853.717031:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+11:2009:x1830963625395072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 31us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.717036:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1035 00000100:00100000:0.0:1746143853.717043:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1036 00000100:00100000:0.0:1746143853.717047:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+10:2009:x1830963625395328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143853.717052:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.717059:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091d75000/0x87925e4cb73aac2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840be94 expref: 10 pid: 8213 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.717069:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143853.717078:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:93450669-9bf3-4ab5-957d-82afaeb40d5e+9:2009:x1830963625395328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.717083:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1036 00000100:00100000:1.0:1746143853.717655:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625394944 00000100:00100000:1.0:1746143853.717660:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625394944 00000100:00100000:1.0:1746143853.717701:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17523 00000100:00100000:1.0:1746143853.717706:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2007:x1830963625394944:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:1.0:1746143853.717737:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac49 00000020:00010000:1.0:1746143853.717744:0:3134:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d7df800: total 0 00000100:00080000:1.0:1746143853.717748:0:3134:0:(import.c:66:import_set_state_nolock()) ffff88012d7dc000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1746143853.717795:0:7233:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d7df800: total 0 00010000:00010000:3.0:1746143853.717801:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143853.717854:0:7233:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d7df800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746143853.717903:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800942a3c00/0x87925e4cb73adc93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840d8e9 expref: 10 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.717985:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466800/0x87925e4cb73ad7d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 7012352->7024639) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840d626 expref: 9 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.718000:0:7233:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d7df800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746143853.718010:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1746143853.718011:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874153 00010000:00010000:3.0:1746143853.718012:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746143853.718014:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746143853.718505:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e30b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+6:2007:x1830963625394944:12345-192.168.202.3@tcp:9:umount.0 Request processed in 797us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.718512:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17523 00000100:00100000:0.0:1746143853.722460:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.722557:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625395712 00000100:00100000:1.0:1746143853.722567:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625395712 00000100:00100000:1.0:1746143853.722625:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17524 00000100:00100000:1.0:1746143853.722634:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+11:2007:x1830963625395712:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:1.0:1746143853.722671:0:3134:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac42 00000020:00010000:1.0:1746143853.722681:0:3134:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d962000: total 0 00000100:00080000:1.0:1746143853.722686:0:3134:0:(import.c:66:import_set_state_nolock()) ffff88012d961000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746143853.722727:0:3134:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841406 00000100:00100000:1.0:1746143853.722872:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2007:x1830963625395712:12345-192.168.202.3@tcp:9:umount.0 Request processed in 239us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.722879:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17524 00000020:00010000:0.0:1746143853.723042:0:10929:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d962000: total 0 00010000:00010000:0.0:1746143853.723078:0:10929:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d962000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746143853.723127:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d467200/0x87925e4cb73ad7d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3866624->3878911) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840d61f expref: 8 pid: 12328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.723171:0:10929:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880082086800/0x87925e4cb73adc8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->114687) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840d8e2 expref: 7 pid: 9839 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.723183:0:10929:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d962000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746143853.723194:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143853.723195:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143853.723197:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1746143853.726156:0:30462:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7af03b7-614a-4deb-9941-d1d04a49a814 00000001:00100000:0.0:1746143853.726168:0:30462:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cbf1bf88-cf31-404b-8cff-930e280d3743 00000001:00080000:0.0:1746143853.726175:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841406 is committed 00000001:00080000:0.0:1746143853.726193:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841405 is committed 00000001:00080000:0.0:1746143853.726204:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841403 is committed 00000001:00080000:0.0:1746143853.726240:0:30462:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841387 is committed 00000020:00000080:0.0:1746143853.726248:0:30462:0:(genops.c:904:class_export_put()) final put ffff88012d962000/f7af03b7-614a-4deb-9941-d1d04a49a814 00000020:00000080:3.0:1746143853.727463:0:1012:0:(genops.c:863:class_export_destroy()) destroying export ffff88012d962000/f7af03b7-614a-4deb-9941-d1d04a49a814 for lustre-OST0000 00000020:00000080:0.0:1746143853.728070:0:30462:0:(genops.c:904:class_export_put()) final put ffff88012d7d8800/cbf1bf88-cf31-404b-8cff-930e280d3743 00000020:00000080:3.0:1746143853.729001:0:1012:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012d961000 for lustre-OST0000 00000020:00000080:3.0:1746143853.729010:0:1012:0:(genops.c:863:class_export_destroy()) destroying export ffff88012d7d8800/cbf1bf88-cf31-404b-8cff-930e280d3743 for lustre-OST0000 00000020:00000080:3.0:1746143853.729041:0:1012:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012d7dc800 for lustre-OST0000 00000100:00100000:0.0:1746143853.732964:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.733085:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625395968 00000100:00100000:3.0:1746143853.733096:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625395968 00000100:00100000:3.0:1746143853.733973:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14195 00000100:00100000:3.0:1746143853.733984:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+10:2007:x1830963625395968:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:3.0:1746143853.734020:0:7243:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac34 00000020:00010000:3.0:1746143853.734028:0:7243:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d964800: total 0 00000100:00080000:3.0:1746143853.734033:0:7243:0:(import.c:66:import_set_state_nolock()) ffff88012d965800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746143853.734055:0:7243:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945313 00000100:00100000:3.0:1746143853.734211:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7af03b7-614a-4deb-9941-d1d04a49a814+9:2007:x1830963625395968:12345-192.168.202.3@tcp:39:umount.0 Request processed in 229us (1257us total) trans 8589945314 rc 0/0 00000100:00100000:3.0:1746143853.734217:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14195 00000020:00010000:0.0:1746143853.734446:0:7232:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d964800: total 0 00010000:00010000:0.0:1746143853.734494:0:7232:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d964800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746143853.734526:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009705f500) 00010000:00010000:0.0:1746143853.734529:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746143853.734536:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d849800/0x87925e4cb73aac57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424840bec5 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.734567:0:7232:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d964800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746143853.734578:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143853.734580:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746143853.734581:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143853.740785:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.740950:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625396096 00000100:00100000:2.0:1746143853.740960:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625396096 00000100:00100000:2.0:1746143853.741021:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14196 00000100:00100000:2.0:1746143853.741030:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+5:2007:x1830963625396096:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:2.0:1746143853.741068:0:6587:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x87925e4cb73aac3b 00000100:00080000:2.0:1746143853.741077:0:6587:0:(import.c:66:import_set_state_nolock()) ffff88009e4d0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746143853.741106:0:6587:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967758 00000100:00100000:2.0:1746143853.741268:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f7af03b7-614a-4deb-9941-d1d04a49a814+3:2007:x1830963625396096:12345-192.168.202.3@tcp:39:umount.0 Request processed in 239us (496us total) trans 4294967759 rc 0/0 00000100:00100000:2.0:1746143853.741275:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14196 00010000:00010000:0.0:1746143853.741331:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746143853.765908:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.766128:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625396352 00000100:00100000:3.0:1746143853.766138:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625396352 00000100:00100000:3.0:1746143853.766609:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14197 00000100:00100000:3.0:1746143853.766617:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+272:3284:x1830963625396352:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.766645:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.766664:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b778f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841313b expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.766765:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.766780:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 273 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.766788:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.766819:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 273 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.766830:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 273 pid: 14991 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143853.766842:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627631104:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143853.767432:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746143853.770303:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.770554:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625396480 00000100:00100000:2.0:1746143853.770563:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625396480 00010000:00010000:2.0:1746143853.770602:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 274 pid: 14991 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143853.770632:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8610 00000100:00100000:2.0:1746143853.770640:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:2008:x1830963625396480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.770653:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.770659:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 274 pid: 14991 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143853.770670:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 274 pid: 14991 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143853.770693:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143853.770698:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.770707:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.770714:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.770733:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143853.770790:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+274:2008:x1830963625396480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.770797:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8610 00010000:00010000:3.0:1746143853.770883:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7734 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130e7 expref: 273 pid: 14991 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143853.770901:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627631104:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.770945:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.770953:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.770958:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143853.770980:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143853.771106:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8a200/0x87925e4cb73b778f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 274 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.771119:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 273 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.771126:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.771128:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746143853.771130:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb8b800, rc 0) 00000100:00100000:3.0:1746143853.771156:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009391f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:3284:x1830963625396352:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4541us (5262us total) trans 8589945315 rc 0/0 00000100:00100000:3.0:1746143853.771162:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14197 00000100:00100000:0.0:1746143853.773215:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.773473:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625396608 00000100:00100000:3.0:1746143853.773482:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625396608 00000100:00100000:3.0:1746143853.773615:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14198 00000100:00100000:3.0:1746143853.773621:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:3284:x1830963625396608:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.773646:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.773664:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096fc6400/0x87925e4cb73b77a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413142 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.773742:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.773753:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 274 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.773759:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 4/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.773785:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 274 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.773794:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 274 pid: 7243 timeout: 1012 lvb_type: 0 00000100:00100000:3.0:1746143853.773806:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627631232:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143853.774815:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746143853.776257:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830963627631232:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.776278:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746143853.777334:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.777503:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625396736 00000100:00100000:2.0:1746143853.777512:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625396736 00010000:00010000:2.0:1746143853.777545:0:10930:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 275 pid: 7243 timeout: 1012 lvb_type: 0 00000100:00100000:2.0:1746143853.777584:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8611 00000100:00100000:2.0:1746143853.777591:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+275:2008:x1830963625396736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.777606:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.777612:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 275 pid: 7243 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143853.777623:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 275 pid: 7243 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143853.777646:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb8b800/0x87925e4cb73b7796 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x34d:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841313b expref: 275 pid: 7243 timeout: 1012 lvb_type: 0 00010000:00010000:2.0:1746143853.777683:0:10930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143853.777687:0:10930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.777697:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.777704:0:10930:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.777735:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143853.777804:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+274:2008:x1830963625396736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 212us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.777814:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8611 00010000:00010000:3.0:1746143853.777835:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.777841:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143853.777899:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143853.777903:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143853.777945:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.777977:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096fc6400/0x87925e4cb73b77a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413142 expref: 274 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.777989:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413142 expref: 273 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.777996:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.777998:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143853.778001:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096d9c400, rc 0) 00000100:00100000:3.0:1746143853.778025:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:3284:x1830963625396608:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4404us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.778031:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14198 00000100:00100000:0.0:1746143853.780370:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.780495:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625396992 00000100:00100000:3.0:1746143853.780504:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625396992 00000100:00100000:3.0:1746143853.780547:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5554 00000100:00100000:3.0:1746143853.780553:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+273:3284:x1830963625396992:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1746143853.780744:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7448e42d-373a-41e0-9678-9a18291c6700+274:3284:x1830963625396992:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 191us (382us total) trans 8589945316 rc 0/0 00000100:00100000:3.0:1746143853.780750:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5554 00000100:00100000:0.0:1746143853.783303:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.784393:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625397248 00000100:00100000:3.0:1746143853.784403:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625397248 00000100:00100000:3.0:1746143853.784466:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14199 00000100:00100000:3.0:1746143853.784475:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+274:3284:x1830963625397248:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.784498:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.784501:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746143853.784531:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a53400/0x87925e4cb73b7589 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412ff9 expref: 274 pid: 14991 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.784549:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.784552:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143853.784564:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b77b2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413149 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.784665:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b77b9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.784678:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b77b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.784686:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b77b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746143853.784698:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00010000:00010000:3.0:1746143853.786200:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76600/0x87925e4cb73b77b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413149 expref: 276 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.786216:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b77b9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413149 expref: 275 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.786233:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.786236:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746143853.786239:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ee76400, rc 0) 00000100:00100000:3.0:1746143853.786315:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+275:3284:x1830963625397248:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1839us (3018us total) trans 8589945317 rc 0/0 00000100:00100000:3.0:1746143853.786323:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14199 00000100:00100000:1.0:1746143853.789756:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.789785:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.789816:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.789846:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.790231:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625397376 00000100:00100000:2.0:1746143853.790241:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625397376 00000100:00080000:2.0:1746143853.790266:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746143853.790295:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625397504 00000100:00100000:2.0:1746143853.790297:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625397504 00000100:00080000:2.0:1746143853.790305:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746143853.790310:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625397632 00000100:00100000:1.0:1746143853.790314:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625397632 00000100:00100000:2.0:1746143853.790319:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625397760 00000100:00100000:2.0:1746143853.790321:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625397760 00000100:00100000:2.0:1746143853.790907:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17525 00000100:00100000:3.0:1746143853.790932:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17526 00000100:00100000:2.0:1746143853.790933:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625397376:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:3.0:1746143853.790940:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625397504:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:3.0:1746143853.790978:0:9586:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.790978:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.790994:0:9586:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.790995:0:9585:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.791001:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.791003:0:9586:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.791005:0:9586:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.791006:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.791007:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.791010:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.791034:0:9586:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.791035:0:9585:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.791045:0:9586:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 24 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.791047:0:9585:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 42 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.791058:0:9586:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627631360:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.791058:0:9585:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627631488:192.168.202.3@tcp:104: 00000100:00100000:1.0:1746143853.791069:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17527 00000100:00100000:1.0:1746143853.791076:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625397632:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143853.791091:0:13430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.791100:0:13430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143853.791105:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.791106:0:13430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.791108:0:13430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.791121:0:13430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 24 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746143853.791127:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17528 00000100:00100000:3.0:1746143853.791132:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625397760:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:1.0:1746143853.791133:0:13430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 24 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.791135:0:9585:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801317b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143853.791141:0:13430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800961eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627631616:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.791145:0:9587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.791154:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 42 pid: 9586 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143853.791157:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1746143853.791160:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.791161:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143853.791161:0:13430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746143853.791163:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.791166:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625397888 00000100:00100000:2.0:1746143853.791170:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625397888 00010000:00010000:3.0:1746143853.791177:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 43 pid: 9586 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.791185:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 43 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.791192:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627631744:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.791193:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17529 00000100:00100000:2.0:1746143853.791198:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625397888:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:3.0:1746143853.791211:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746143853.791213:0:3135:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.791219:0:9586:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800973580c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746143853.791234:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 43 pid: 3134 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.791240:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:2.0:1746143853.791241:0:3135:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.791251:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746143853.791251:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398016 00010000:00010000:2.0:1746143853.791252:0:3135:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143853.791254:0:3135:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.791254:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398016 00010000:00010000:2.0:1746143853.791270:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 43 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.791276:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17530 00010000:00010000:2.0:1746143853.791277:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 43 pid: 3135 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143853.791281:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625398016:12345-192.168.202.3@tcp:1:lfs.0 00000100:00100000:2.0:1746143853.791285:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627631872:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143853.791296:0:13436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.791306:0:13436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.791311:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746143853.791313:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746143853.791315:0:3135:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 43 pid: 3134 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.791315:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.791328:0:3135:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 43 pid: 3134 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143853.791330:0:13436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 25 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.791336:0:3135:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627632000:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143853.791338:0:13436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 25 pid: 13436 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143853.791350:0:13436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800961ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627632128:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.791352:0:3135:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746143853.791368:0:13436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c514000 going to sleep for 11 seconds 00000100:00100000:3.0:1746143853.793741:0:9586:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9586:1830963627631360:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.793765:0:9586:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.794452:0:9585:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9585:1830963627631488:192.168.202.3@tcp:104: 00010000:00010000:0.0:1746143853.794470:0:9585:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.802406:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.802485:0:13430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800961eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13430:1830963627631616:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143853.802514:0:13430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.802547:0:13436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800961ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13436:1830963627632128:192.168.202.3@tcp:104: 00010000:00010000:1.0:1746143853.802556:0:13436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.802633:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627631744:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.802649:0:9587:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.802791:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627631872:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.802801:0:3135:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3135:1830963627632000:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143853.802818:0:3135:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.804198:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.804243:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.804270:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398144 00000100:00100000:0.0:1746143853.804278:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398144 00000100:00100000:1.0:1746143853.804289:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398656 00000100:00100000:1.0:1746143853.804294:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398656 00010000:00010000:1.0:1746143853.804314:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 44 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143853.804314:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:0.0:1746143853.804340:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398272 00000100:00100000:0.0:1746143853.804342:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398272 00000100:00100000:1.0:1746143853.804351:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8612 00010000:00010000:0.0:1746143853.804352:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 45 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:1.0:1746143853.804359:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+26:2009:x1830963625398144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746143853.804367:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8613 00000100:00100000:0.0:1746143853.804372:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963625398656:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143853.804375:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.804380:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.804395:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 45 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:1.0:1746143853.804396:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143853.804406:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 45 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:1.0:1746143853.804407:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:1.0:1746143853.804430:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b2400/0x87925e4cb73b7749 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130f5 expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143853.804430:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b3e00/0x87925e4cb73b7757 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413103 expref: 45 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.804560:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8614 00000100:00100000:2.0:1746143853.804568:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+44:2010:x1830963625398272:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.804576:0:10930:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.804585:0:10930:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 44 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.804593:0:10930:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 44 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:1.0:1746143853.804605:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.804605:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.804607:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800820b2c00/0x87925e4cb73b7742 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130ee expref: 44 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:1.0:1746143853.804607:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.804607:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.804612:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.804612:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804620:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.804620:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804621:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.804622:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.804625:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804630:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804641:0:10930:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143853.804641:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746143853.804641:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143853.804684:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7448e42d-373a-41e0-9678-9a18291c6700+43:2010:x1830963625398272:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 117us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.804685:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+25:2009:x1830963625398144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 327us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.804690:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8614 00000100:00100000:1.0:1746143853.804694:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8612 00010000:00010000:3.0:1746143853.804714:0:9587:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804717:0:9585:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804724:0:9587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804728:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804740:0:9587:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804740:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804747:0:9587:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804747:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804754:0:9587:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804754:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804760:0:9587:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d466c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143853.804760:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5b96c00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143853.804764:0:9587:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804764:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804766:0:9586:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804770:0:9587:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804770:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804773:0:9586:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804778:0:9587:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804778:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.804783:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d466c00/0x87925e4cb73b77dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.804783:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b96c00/0x87925e4cb73b77c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804783:0:9586:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804788:0:9586:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804799:0:9586:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804803:0:9586:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ee76e00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143853.804805:0:9586:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804810:0:9586:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.804817:0:9586:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.804822:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625397376:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13892us (15076us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143853.804822:0:9586:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ee76e00/0x87925e4cb73b77ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9586 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.804830:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17525 00000100:00100000:0.0:1746143853.804830:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625398656:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 307us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.804835:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8613 00000100:00100000:3.0:1746143853.804927:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625397760:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13779us (15065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.804933:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17528 00000100:00100000:0.0:1746143853.804937:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.804938:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625397504:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 13998us (15151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.804943:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17526 00000100:00100000:2.0:1746143853.805036:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398528 00000100:00100000:2.0:1746143853.805040:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398528 00002000:00100000:2.0:1746143853.805064:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2191360->2850815) req@ffff880129e6d500 x1830963625398528/t0(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:249/0 lens 488/0 e 0 to 0 dl 1746143864 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143853.805073:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d500 with x1830963625398528 ext(2191360->2850815) 00010000:00010000:2.0:1746143853.805079:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143853.805087:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143853.805092:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6d500 00000100:00100000:2.0:1746143853.805151:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2799 00000100:00100000:2.0:1746143853.805156:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963625398528:12345-192.168.202.3@tcp:4:cat.0 00000100:00100000:1.0:1746143853.805378:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.805412:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.805427:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398400 00000100:00100000:0.0:1746143853.805431:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398400 00000100:00100000:1.0:1746143853.805443:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1746143853.805445:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00000100:00100000:1.0:1746143853.805454:0:12362:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398784 00000100:00100000:1.0:1746143853.805457:0:12362:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398784 00000100:00100000:0.0:1746143853.805461:0:16784:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625398912 00000100:00100000:0.0:1746143853.805463:0:16784:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625398912 00010000:00010000:0.0:1746143853.805472:0:16784:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 41 pid: 3134 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143853.805484:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8615 00000100:00100000:0.0:1746143853.805489:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+26:2010:x1830963625398400:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143853.805496:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.805504:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143853.805512:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143853.805523:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800820b3400/0x87925e4cb73b7750 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c942484130fc expref: 26 pid: 9586 timeout: 1013 lvb_type: 1 00010000:00010000:0.0:1746143853.805531:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.805533:0:16784:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.805536:0:16784:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805542:0:16784:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.805544:0:12362:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 41 pid: 3135 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143853.805555:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143853.805577:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+25:2010:x1830963625398400:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.805583:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8615 00000100:00100000:0.0:1746143853.805593:0:16784:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8616 00000100:00100000:0.0:1746143853.805597:0:16784:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625398912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746143853.805603:0:16784:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.805611:0:16784:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 41 pid: 3134 timeout: 1013 lvb_type: 0 00010000:00010000:0.0:1746143853.805618:0:16784:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 41 pid: 3134 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143853.805624:0:12362:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8617 00010000:00010000:0.0:1746143853.805628:0:16784:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009e55a200/0x87925e4cb73b7788 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413134 expref: 41 pid: 3134 timeout: 1013 lvb_type: 0 00000100:00100000:1.0:1746143853.805630:0:12362:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800961eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+41:2010:x1830963625398784:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746143853.805637:0:12362:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746143853.805637:0:16784:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143853.805645:0:12362:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 40 pid: 3135 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143853.805649:0:16784:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625398912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 52us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1746143853.805653:0:12362:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 40 pid: 3135 timeout: 1013 lvb_type: 0 00000100:00100000:0.0:1746143853.805654:0:16784:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8616 00010000:00010000:1.0:1746143853.805663:0:12362:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7781 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841312d expref: 39 pid: 3135 timeout: 1013 lvb_type: 0 00010000:00010000:1.0:1746143853.805673:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.805674:0:12362:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.805677:0:12362:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805723:0:13430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805730:0:13430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805741:0:13430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805747:0:13430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805752:0:13430:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805756:0:13430:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55b600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143853.805759:0:13430:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805764:0:13430:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805772:0:13430:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.805777:0:13430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55b600/0x87925e4cb73b77d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.805812:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+24:2008:x1830963625397632:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 14737us (15995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.805819:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17527 00010000:00010000:1.0:1746143853.806358:0:12362:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.806374:0:12362:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746143853.806399:0:12362:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7448e42d-373a-41e0-9678-9a18291c6700+38:2010:x1830963625398784:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 764us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.806406:0:12362:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8617 00010000:00010000:3.0:1746143853.806605:0:3135:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806613:0:3135:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806626:0:3135:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806632:0:3135:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806637:0:3135:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806642:0:3135:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143853.806646:0:3135:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806652:0:3135:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806661:0:3135:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.806668:0:3135:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31a00/0x87925e4cb73b77e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3135 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.806711:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7448e42d-373a-41e0-9678-9a18291c6700+37:2008:x1830963625397888:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 15512us (15554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.806717:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17529 00000100:00100000:2.0:1746143853.822059:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+24:2010:x1830963625398528:12345-192.168.202.3@tcp:4:cat.0 Request processed in 16892us (17110us total) trans 21474841407 rc 0/0 00000100:00100000:2.0:1746143853.822072:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2799 00002000:00100000:2.0:1746143853.822084:0:20385:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x3bf:0x0] (2191360->2850815) req@ffff880129e6d500 x1830963625398528/t21474841407(0) o4->7448e42d-373a-41e0-9678-9a18291c6700@192.168.202.3@tcp:249/0 lens 488/448 e 0 to 0 dl 1746143864 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746143853.822093:0:20385:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129e6d500 with x1830963625398528 ext(2191360->2850815) 00010000:00010000:2.0:1746143853.822103:0:20385:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143853.822122:0:20385:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00002000:00010000:2.0:1746143853.822129:0:20385:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880129e6d500 00000100:00100000:0.0:1746143853.830893:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.831028:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399040 00000100:00100000:2.0:1746143853.831038:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399040 00010000:00010000:2.0:1746143853.831081:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143853.831293:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8618 00000100:00100000:2.0:1746143853.831302:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+24:2009:x1830963625399040:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.831318:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746143853.831339:0:7230:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143852 -> 1746143853 00010000:00010000:2.0:1746143853.831345:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143853.831357:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143853.831381:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e30a00/0x87925e4cb73b776c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2850815) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413118 expref: 24 pid: 13436 timeout: 1013 lvb_type: 0 00010000:00010000:2.0:1746143853.831455:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.831458:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.831462:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.831476:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.831510:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746143853.831584:0:13436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831598:0:13436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831615:0:13436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831622:0:13436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831629:0:13436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831636:0:13436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55ba00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143853.831640:0:13436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831648:0:13436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831659:0:13436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.831664:0:13436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b77ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.831841:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+23:2009:x1830963625399040:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 539us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.831849:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8618 00000100:00100000:1.0:1746143853.831933:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800961ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+22:2008:x1830963625398016:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 40650us (40691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.831942:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17530 00000100:00100000:0.0:1746143853.837970:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.839406:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399296 00000100:00100000:3.0:1746143853.839419:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399296 00000100:00100000:3.0:1746143853.839490:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14200 00000100:00100000:3.0:1746143853.839499:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+275:3284:x1830963625399296:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143853.839552:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746143853.839581:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880123268e00/0x87925e4cb73b747f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248412f2e expref: 275 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.839619:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096d9c400/0x87925e4cb73b77ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413142 expref: 274 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.839634:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.839638:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143853.839670:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.839682:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.839690:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000040:00080000:3.0:1746143853.839966:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3366, 88 off284072 00000004:00080000:3.0:1746143853.839974:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064061166ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840049:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3347, 88 off282048 00000004:00080000:3.0:1746143853.840055:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064142727ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840216:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3348, 88 off282136 00000004:00080000:3.0:1746143853.840233:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064320887ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840244:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3367, 88 off284160 00000004:00080000:3.0:1746143853.840386:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064473598ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840416:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3368, 88 off284248 00000004:00080000:3.0:1746143853.840420:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064507800ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840432:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3349, 88 off282224 00000004:00080000:3.0:1746143853.840436:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064524070ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840444:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3350, 88 off282312 00000004:00080000:3.0:1746143853.840446:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064534338ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840453:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3351, 88 off282400 00000004:00080000:3.0:1746143853.840455:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064543338ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840582:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3369, 88 off284336 00000004:00080000:3.0:1746143853.840586:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064673908ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840846:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3352, 88 off282488 00000004:00080000:3.0:1746143853.840850:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064937794ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840874:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3370, 88 off284424 00000004:00080000:3.0:1746143853.840876:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064964249ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840885:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3353, 88 off282576 00000004:00080000:3.0:1746143853.840887:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913064974928ns, next at 850789974850ns, rc = 0 00000040:00080000:3.0:1746143853.840896:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3371, 88 off284512 00000004:00080000:3.0:1746143853.840898:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064986208ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840906:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3372, 88 off284600 00000004:00080000:3.0:1746143853.840908:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913064996109ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840937:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3373, 88 off284688 00000004:00080000:3.0:1746143853.840940:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065027760ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.840950:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3374, 88 off284776 00000004:00080000:3.0:1746143853.840952:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913065039946ns, next at 850790015893ns, rc = 0 00000040:00080000:3.0:1746143853.841063:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3354, 88 off282664 00000004:00080000:3.0:1746143853.841067:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913065154828ns, next at 850789974850ns, rc = 0 00000001:00080000:2.0:1746143853.843636:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945318 is committed 00000004:00080000:2.0:1746143853.843644:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2566 committed 00000004:00080000:2.0:1746143853.843662:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2589 committed 00000004:00080000:2.0:1746143853.844105:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2588 committed 00000004:00080000:2.0:1746143853.844261:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2587 committed 00000004:00080000:2.0:1746143853.844263:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2586 committed 00000100:00100000:1.0:1746143853.844263:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627632256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143853.844265:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2565 committed 00000004:00080000:2.0:1746143853.844267:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2585 committed 00000004:00080000:2.0:1746143853.844268:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2564 committed 00000004:00080000:2.0:1746143853.844270:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2584 committed 00000004:00080000:2.0:1746143853.844272:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2563 committed 00000004:00080000:2.0:1746143853.844273:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2562 committed 00000004:00080000:2.0:1746143853.844275:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2561 committed 00000004:00080000:2.0:1746143853.844277:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2583 committed 00000004:00080000:2.0:1746143853.844280:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2582 committed 00000004:00080000:2.0:1746143853.844282:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2560 committed 00000004:00080000:2.0:1746143853.844283:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2559 committed 00000004:00080000:2.0:1746143853.844284:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2581 committed 00000100:00100000:1.0:1746143853.844344:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.844409:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627632256 00000100:00100000:1.0:1746143853.844417:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627632256 00000001:00100000:2.0:1746143853.844429:0:8209:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7af03b7-614a-4deb-9941-d1d04a49a814 00000001:00080000:2.0:1746143853.844434:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945314 is committed 00000001:00100000:2.0:1746143853.844438:0:8209:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cbf1bf88-cf31-404b-8cff-930e280d3743 00000100:00080000:1.0:1746143853.844443:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1746143853.844445:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945313 is committed 00000020:00000080:2.0:1746143853.844469:0:8209:0:(genops.c:904:class_export_put()) final put ffff88012d964800/f7af03b7-614a-4deb-9941-d1d04a49a814 00000100:00100000:1.0:1746143853.844478:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17531 00000020:00000080:1.0:1746143853.844489:0:12359:0:(genops.c:863:class_export_destroy()) destroying export ffff88012d964800/f7af03b7-614a-4deb-9941-d1d04a49a814 for lustre-MDT0000 00000020:00000080:2.0:1746143853.844498:0:8209:0:(genops.c:904:class_export_put()) final put ffff88009e4d5800/cbf1bf88-cf31-404b-8cff-930e280d3743 00000100:00100000:2.0:1746143853.844514:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627632384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143853.844541:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1746143853.844545:0:12359:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012d965800 for lustre-MDT0000 00000020:00000080:1.0:1746143853.844550:0:12359:0:(genops.c:863:class_export_destroy()) destroying export ffff88009e4d5800/cbf1bf88-cf31-404b-8cff-930e280d3743 for lustre-MDT0000 00000100:00100000:2.0:1746143853.844558:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746143853.844562:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627632512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143853.844577:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1746143853.844579:0:12359:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88009e4d6000 for lustre-MDT0000 00000100:00100000:1.0:1746143853.844591:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627632384 00000100:00100000:1.0:1746143853.844594:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627632384 00000100:00100000:1.0:1746143853.844613:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627632512 00000100:00100000:1.0:1746143853.844614:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627632512 00000004:00010000:2.0:1746143853.844623:0:7243:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e35a300 reply state ffff88012b7f6000 transno 8589945318 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746143853.844634:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17532 00000100:00100000:1.0:1746143853.844639:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3773:x1830963627632384:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746143853.844642:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746143853.844649:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143853.844652:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143853.844656:0:7243:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746143853.844676:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17533 00000100:00100000:2.0:1746143853.844687:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3773:x1830963627632512:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1746143853.844734:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746143853.844744:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3772:x1830963627632256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143853.844786:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963627632512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (207us total) trans 17179874154 rc 0/0 00000100:00100000:1.0:1746143853.844786:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3773:x1830963627632384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (244us total) trans 17179874155 rc 0/0 00000100:00100000:2.0:1746143853.844792:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17533 00000100:00100000:1.0:1746143853.844802:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17532 00000100:00100000:1.0:1746143853.844836:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627632768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.844856:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.844869:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143853.844875:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143853.844883:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627633024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143853.844889:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.844897:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627632640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143853.844906:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.844930:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627632768 00000100:00100000:1.0:1746143853.844933:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627632768 00000100:00100000:3.0:1746143853.844940:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746143853.844944:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627632896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143853.844946:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633280 00000100:00100000:1.0:1746143853.844948:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633280 00000100:00100000:1.0:1746143853.844957:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633024 00000100:00100000:1.0:1746143853.844959:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633024 00000100:00100000:3.0:1746143853.844960:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.844970:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627632896 00000100:00100000:3.0:1746143853.844972:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627633408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143853.844972:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627632896 00000100:00100000:1.0:1746143853.844982:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17534 00000100:00100000:3.0:1746143853.844984:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.844987:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3772:x1830963627632768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143853.844999:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633408 00000100:00100000:3.0:1746143853.845002:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633408 00000100:00100000:3.0:1746143853.845016:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17535 00000100:00100000:3.0:1746143853.845020:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3772:x1830963627633280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143853.845054:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3772:x1830963627632768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (197us total) trans 21474841408 rc 0/0 00000100:00100000:1.0:1746143853.845059:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17534 00000100:00100000:1.0:1746143853.845068:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17536 00000100:00100000:1.0:1746143853.845072:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3774:x1830963627633024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143853.845079:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3772:x1830963627633280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (188us total) trans 17179874156 rc 0/0 00000100:00100000:3.0:1746143853.845084:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17535 00000100:00100000:3.0:1746143853.845093:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17537 00000100:00100000:3.0:1746143853.845097:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3774:x1830963627632896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143853.845108:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17538 00000100:00100000:3.0:1746143853.845112:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3774:x1830963627633408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143853.845129:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3774:x1830963627633024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (222us total) trans 17179874157 rc 0/0 00000100:00100000:1.0:1746143853.845135:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17536 00000100:00100000:1.0:1746143853.845153:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.845164:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746143853.845171:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3774:x1830963627633408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (186us total) trans 17179874158 rc 0/0 00000100:00100000:3.0:1746143853.845176:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17538 00000100:00100000:1.0:1746143853.845180:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143853.845186:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627632640 00000100:00100000:3.0:1746143853.845188:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627632640 00000100:00100000:3.0:1746143853.845199:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633152 00000100:00100000:3.0:1746143853.845201:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633152 00000100:00100000:1.0:1746143853.845202:0:3772:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841403 gen 2 00000004:00080000:1.0:1746143853.845206:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b09f80, transno 21474841376 00000100:00100000:3.0:1746143853.845207:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17539 00000004:00080000:1.0:1746143853.845209:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b08a80, transno 21474841377 00000100:00100000:3.0:1746143853.845211:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627632640:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143853.845211:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0bb80, transno 21474841378 00000004:00080000:1.0:1746143853.845214:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0aa00, transno 21474841379 00000004:00080000:1.0:1746143853.845216:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b09180, transno 21474841380 00000004:00080000:1.0:1746143853.845218:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0ad80, transno 21474841381 00000004:00080000:1.0:1746143853.845232:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0a680, transno 21474841382 00000004:00080000:1.0:1746143853.845233:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135b0a300, transno 21474841383 00000004:00080000:1.0:1746143853.845236:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e490700, transno 21474841388 00000004:00080000:1.0:1746143853.845238:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e491c00, transno 21474841389 00000004:00080000:1.0:1746143853.845240:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e490e00, transno 21474841390 00000004:00080000:1.0:1746143853.845242:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e493100, transno 21474841391 00000004:00080000:1.0:1746143853.845244:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb7100, transno 21474841392 00000004:00080000:1.0:1746143853.845246:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e493b80, transno 21474841393 00000004:00080000:1.0:1746143853.845248:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cb4e00, transno 21474841394 00000004:00080000:1.0:1746143853.845250:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009e493800, transno 21474841395 00000004:00080000:1.0:1746143853.845252:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373ba680, transno 21474841396 00000004:00080000:1.0:1746143853.845255:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bbb80, transno 21474841397 00000004:00080000:1.0:1746143853.845257:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9880, transno 21474841398 00000004:00080000:1.0:1746143853.845259:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373ba300, transno 21474841399 00000004:00080000:1.0:1746143853.845261:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092b71f80, transno 21474841400 00000004:00080000:1.0:1746143853.845263:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b8a80, transno 21474841401 00000004:00080000:1.0:1746143853.845265:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373b9500, transno 21474841402 00000004:00080000:1.0:1746143853.845267:0:3772:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801373bb480, transno 21474841403 00000100:00100000:3.0:1746143853.845270:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009322e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963627632640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (115us total) trans 17179874159 rc 0/0 00000100:00100000:1.0:1746143853.845272:0:3772:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880093f6b480 x1830963627632768/t21474841408(21474841408) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746143869 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:3.0:1746143853.845275:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17539 00000004:00080000:1.0:1746143853.845281:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f6b480/2, rc 0, transno 21474841408 00000100:00100000:3.0:1746143853.845283:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17540 00000100:00100000:1.0:1746143853.845285:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627632768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143853.845286:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3772:x1830963627633152:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143853.845298:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b4176d80/2, rc 0, transno 17179874156 00000100:00100000:1.0:1746143853.845304:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746143853.845311:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7b800/2, rc 0, transno 17179874159 00000100:00100000:1.0:1746143853.845314:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627632640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143853.845388:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:3772:x1830963627632256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 902us (1044us total) trans 21474841409 rc 0/0 00000100:00100000:1.0:1746143853.845393:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17531 00000004:00080000:1.0:1746143853.845409:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f68380/2, rc 0, transno 21474841409 00000100:00100000:1.0:1746143853.845412:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627632256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143853.845464:0:8224:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 6 changes, 2 in progress, 0 in flight, 24 done 00000100:00100000:1.0:1746143853.845731:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.845751:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.845769:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627634304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.845783:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.845794:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746143853.845798:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.845811:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.845821:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627634176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.845833:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.845849:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633792 00000100:00100000:1.0:1746143853.845852:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633792 00000100:00100000:1.0:1746143853.845864:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627634304 00000100:00100000:1.0:1746143853.845866:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627634304 00000100:00100000:1.0:1746143853.845872:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633664 00000100:00100000:1.0:1746143853.845874:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633664 00000100:00100000:1.0:1746143853.845880:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627634176 00000100:00100000:1.0:1746143853.845882:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627634176 00000100:00100000:1.0:1746143853.845889:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17541 00000100:00100000:1.0:1746143853.845893:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627633792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.845976:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963627633792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (223us total) trans 21474841410 rc 0/0 00000100:00100000:1.0:1746143853.845984:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17541 00000100:00100000:1.0:1746143853.845994:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17542 00000100:00100000:1.0:1746143853.845998:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627634304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.846049:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963627634304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (264us total) trans 21474841411 rc 0/0 00000100:00100000:1.0:1746143853.846054:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17542 00000100:00100000:1.0:1746143853.846063:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17543 00000100:00100000:1.0:1746143853.846067:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3772:x1830963627633664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.846112:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963627633664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (300us total) trans 21474841412 rc 0/0 00000100:00100000:0.0:1746143853.846112:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17544 00000100:00100000:1.0:1746143853.846117:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17543 00000100:00100000:0.0:1746143853.846119:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3772:x1830963627634176:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143853.846137:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f68a80/2, rc 0, transno 21474841412 00000100:00100000:1.0:1746143853.846140:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143853.846146:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f6b800/2, rc 0, transno 21474841410 00000100:00100000:1.0:1746143853.846148:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746143853.846153:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b0bb80/2, rc 0, transno 21474841411 00000100:00100000:1.0:1746143853.846155:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627634304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143853.847568:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627633920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143853.847603:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143853.847648:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e78380/2, rc 0, transno 17179874154 00000100:00100000:2.0:1746143853.847653:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627632512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143853.847662:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090e7aa00/2, rc 0, transno 17179874155 00000100:00100000:2.0:1746143853.847665:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627632384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143853.847679:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143853.847688:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627633536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143853.847704:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143853.847729:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627634048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143853.847736:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633920 00000100:00100000:1.0:1746143853.847742:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633920 00000100:00100000:2.0:1746143853.847745:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143853.847764:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627633536 00000100:00100000:1.0:1746143853.847765:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627633536 00000100:00100000:2.0:1746143853.847767:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627634048 00000100:00100000:2.0:1746143853.847770:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627634048 00000100:00100000:1.0:1746143853.847777:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17545 00000100:00100000:1.0:1746143853.847782:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627633920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143853.847788:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17546 00000100:00100000:2.0:1746143853.847794:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3773:x1830963627633536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143853.847886:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3773:x1830963627633536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (180us total) trans 17179874160 rc 0/0 00000100:00100000:2.0:1746143853.847891:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17546 00000100:00100000:2.0:1746143853.847901:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17547 00000100:00100000:2.0:1746143853.847905:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627634048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143853.848085:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963627633152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2797us (2903us total) trans 17179874161 rc 0/0 00000100:00100000:3.0:1746143853.848092:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17540 00000100:00100000:1.0:1746143853.848161:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3773:x1830963627633920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 378us (556us total) trans 21474841414 rc 0/0 00000100:00100000:3.0:1746143853.848162:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3774:x1830963627632896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3064us (3201us total) trans 17179874162 rc 0/0 00000100:00100000:1.0:1746143853.848168:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17545 00000100:00100000:3.0:1746143853.848178:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17537 00000004:00080000:3.0:1746143853.848205:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801373b9f80/2, rc 0, transno 17179874162 00000100:00100000:3.0:1746143853.848208:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801373b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627632896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143853.848275:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3772:x1830963627634176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2156us (2439us total) trans 21474841413 rc 0/0 00000100:00100000:0.0:1746143853.848281:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17544 00000004:00080000:3.0:1746143853.848351:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b4175880/2, rc 0, transno 17179874158 00000100:00100000:3.0:1746143853.848356:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627633408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143853.848369:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b4175c00/2, rc 0, transno 17179874157 00000100:00100000:3.0:1746143853.848373:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627633024:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143853.848398:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b08a80/2, rc 0, transno 21474841413 00000100:00100000:3.0:1746143853.848402:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627634176:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143853.848407:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b4176300/2, rc 0, transno 17179874161 00000100:00100000:3.0:1746143853.848409:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627633152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143853.848875:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3773:x1830963627634048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 969us (1127us total) trans 21474841415 rc 0/0 00000100:00100000:2.0:1746143853.848881:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17547 00010000:00080000:3.0:1746143853.849088:0:7243:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143853.849101:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:3284:x1830963625399296:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 9601us (11139us total) trans 8589945318 rc 0/0 00000100:00100000:3.0:1746143853.849107:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14200 00010000:00010000:3.0:1746143853.849131:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.849140:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.849146:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.849151:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d467c00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:3.0:1746143853.849155:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.849160:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.849174:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.849177:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746143853.849180:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746143853.849185:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d467c00/0x87925e4cb73b77f1 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00000004:00080000:3.0:1746143853.849240:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bded80/2, rc 0, transno 17179874160 00000100:00100000:3.0:1746143853.849243:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627633536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746143853.849252:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135b09f80/2, rc 0, transno 21474841415 00000100:00100000:3.0:1746143853.849254:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135b09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627634048:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143853.849261:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093f69180/2, rc 0, transno 21474841414 00000100:00100000:3.0:1746143853.849263:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627633920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143853.853097:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.853440:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399424 00000100:00100000:2.0:1746143853.853450:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399424 00000100:00100000:2.0:1746143853.853499:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14201 00000100:00100000:2.0:1746143853.853506:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+261:3284:x1830963625399424:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.853529:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143853.853550:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413150 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.853609:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 262 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.853623:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 262 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.853640:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143853.853643:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143853.853646:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:2.0:1746143853.853696:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+262:3284:x1830963625399424:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 190us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.853702:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14201 00000100:00100000:0.0:1746143853.858206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.859532:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399552 00000100:00100000:3.0:1746143853.859544:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399552 00000100:00100000:3.0:1746143853.859670:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14202 00000100:00100000:3.0:1746143853.859677:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+262:3284:x1830963625399552:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.859694:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.859712:0:6587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b77ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413157 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.859782:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b7806 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.859793:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b7806 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.859802:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b7806 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00200000:3.0:1746143853.859827:0:6587:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x34d:0x0]: returning size 9045536 00000004:00200000:3.0:1746143853.859830:0:6587:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746143853.859841:0:6587:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b7806 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.859863:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d466e00/0x87925e4cb73b77ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413157 expref: 264 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.860082:0:6587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b7806 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413157 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.860089:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.860092:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746143853.860094:0:6587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3ba00, rc 0) 00000100:00100000:3.0:1746143853.860477:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:3284:x1830963625399552:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 799us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.860484:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14202 00000100:00100000:0.0:1746143853.864683:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.865783:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.865814:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.865838:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.865840:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399808 00000100:00100000:2.0:1746143853.865847:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399808 00000100:00100000:0.0:1746143853.865851:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400064 00000100:00100000:0.0:1746143853.865852:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400064 00000100:00100000:2.0:1746143853.865884:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400320 00000100:00100000:2.0:1746143853.865886:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400320 00000100:00100000:2.0:1746143853.865896:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399680 00000100:00100000:2.0:1746143853.865898:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399680 00000100:00100000:3.0:1746143853.865952:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17548 00000100:00100000:3.0:1746143853.866124:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+23:2011:x1830963625399808:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.866138:0:1947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.866153:0:1947:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413165 expref: -99 pid: 1947 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746143853.866171:0:1947:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bd:0x0] initial LVB size: 2097152, mtime: 0x68140a6b, atime: 0x68140a6b, ctime: 0x68140a6c, blocks: 0x808 00010000:00010000:3.0:1746143853.866186:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.866187:0:1947:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746143853.866231:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17549 00000100:00100000:1.0:1746143853.866237:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+24:2011:x1830963625400320:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143853.866242:0:3134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143853.866249:0:3134:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413181 expref: -99 pid: 3134 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143853.866259:0:3134:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bf:0x0] initial LVB size: 4194304, mtime: 0x68140a6c, atime: 0x68140a6d, ctime: 0x68140a6c, blocks: 0x1008 00010000:00010000:1.0:1746143853.866265:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.866266:0:3134:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.866270:0:3134:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143853.866283:0:3134:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 25 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746143853.866291:0:3134:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55ba00, rc 0) 00000100:00100000:1.0:1746143853.866326:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963625400320:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 90us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.866331:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17549 00000100:00100000:0.0:1746143853.866391:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17550 00000100:00100000:2.0:1746143853.866395:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17551 00000100:00100000:0.0:1746143853.866397:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625400064:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:2.0:1746143853.866400:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+38:2011:x1830963625399680:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.866404:0:9585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143853.866404:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143853.866413:0:9585:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841315e expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.866413:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413173 expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143853.866424:0:9585:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39c:0x0] initial LVB size: 1048576, mtime: 0x68140a6c, atime: 0x68140a6b, ctime: 0x68140a6c, blocks: 0x800 00002000:00010000:0.0:1746143853.866424:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39e:0x0] initial LVB size: 2097152, mtime: 0x68140a6c, atime: 0x68140a6c, ctime: 0x68140a6c, blocks: 0x808 00010000:00010000:0.0:1746143853.866431:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.866432:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.866433:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.866433:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.866437:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 40 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143853.866437:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 40 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143853.866446:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 40 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.866449:0:9585:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 40 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143853.866452:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880082087200, rc 0) 00010000:00010000:2.0:1746143853.866455:0:9585:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30a00, rc 0) 00000100:00100000:2.0:1746143853.866467:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625399680:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 68us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.866467:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625400064:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 71us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.866472:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17550 00000100:00100000:2.0:1746143853.866474:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17551 00000100:00100000:0.0:1746143853.866496:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.866514:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625399936 00000100:00100000:2.0:1746143853.866517:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625399936 00000100:00100000:2.0:1746143853.866531:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17552 00000100:00100000:2.0:1746143853.866535:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963625399936:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.866541:0:13436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143853.866548:0:13436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841316c expref: -99 pid: 13436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.866550:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00002000:00010000:2.0:1746143853.866558:0:13436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3be:0x0] initial LVB size: 2097152, mtime: 0x68140a6c, atime: 0x68140a6c, ctime: 0x68140a6c, blocks: 0x808 00000100:00100000:0.0:1746143853.866561:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400192 00000100:00100000:0.0:1746143853.866563:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400192 00010000:00010000:2.0:1746143853.866564:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.866566:0:13436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.866569:0:13436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143853.866577:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17553 00010000:00010000:2.0:1746143853.866578:0:13436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 26 pid: 13436 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746143853.866580:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+39:2011:x1830963625400192:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.866585:0:13436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31a00, rc 0) 00010000:00010000:0.0:1746143853.866586:0:9839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746143853.866591:0:9839:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841317a expref: -99 pid: 9839 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.866598:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625399936:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 63us (102us total) trans 0 rc 0/0 00002000:00010000:0.0:1746143853.866599:0:9839:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39f:0x0] initial LVB size: 4851232, mtime: 0x68140a6c, atime: 0x68140a6c, ctime: 0x68140a6c, blocks: 0x1510 00000100:00100000:2.0:1746143853.866602:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17552 00010000:00010000:0.0:1746143853.866605:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.866606:0:9839:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.866609:0:9839:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 40 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143853.866617:0:9839:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 40 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746143853.866624:0:9839:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b97600, rc 0) 00000100:00100000:0.0:1746143853.866637:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625400192:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 56us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.866642:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17553 00010000:00010000:3.0:1746143853.866746:0:1947:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 25 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.866757:0:1947:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 25 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.866769:0:1947:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e3ac00, rc 0) 00000100:00100000:3.0:1746143853.866789:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963625399808:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 668us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.866793:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17548 00000100:00100000:0.0:1746143853.871687:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.871727:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.871756:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.871780:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.871796:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.871817:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400448 00000100:00100000:3.0:1746143853.871818:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400576 00000100:00100000:3.0:1746143853.871824:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400576 00000100:00100000:0.0:1746143853.871824:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400448 00000100:00100000:3.0:1746143853.871854:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400704 00000100:00100000:3.0:1746143853.871856:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400704 00000100:00100000:3.0:1746143853.872082:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400960 00000100:00100000:0.0:1746143853.872082:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625400832 00000100:00100000:3.0:1746143853.872085:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400960 00000100:00100000:0.0:1746143853.872086:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625400832 00000100:00100000:1.0:1746143853.872089:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17554 00000100:00100000:1.0:1746143853.872098:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625400576:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143853.872101:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17555 00000100:00100000:3.0:1746143853.872105:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17556 00000100:00100000:0.0:1746143853.872105:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625400448:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143853.872111:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625400704:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143853.872156:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17557 00000100:00100000:2.0:1746143853.872166:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625400832:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:3.0:1746143853.872176:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625400704:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 65us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.872183:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17556 00000100:00100000:3.0:1746143853.872197:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17558 00000100:00100000:3.0:1746143853.872202:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625400960:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143853.872246:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625400448:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 139us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.872251:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17555 00000100:00100000:1.0:1746143853.872271:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625400576:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 175us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.872277:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17554 00000100:00100000:0.0:1746143853.872289:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.872295:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2008:x1830963625400960:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 93us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.872299:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401088 00000100:00100000:3.0:1746143853.872300:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17558 00000100:00100000:1.0:1746143853.872302:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401088 00000100:00100000:2.0:1746143853.872341:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7448e42d-373a-41e0-9678-9a18291c6700+40:2008:x1830963625400832:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 179us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.872384:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17559 00000100:00100000:1.0:1746143853.872390:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625401088:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143853.872458:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17557 00000100:00100000:1.0:1746143853.872623:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+25:2008:x1830963625401088:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 233us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.872629:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17559 00000100:00100000:0.0:1746143853.875007:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.875028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.875039:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.875048:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.875070:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.875093:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.875122:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401216 00000100:00100000:3.0:1746143853.875129:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401216 00000100:00100000:1.0:1746143853.875159:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401344 00000100:00100000:3.0:1746143853.875162:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401600 00000100:00100000:1.0:1746143853.875163:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401344 00000100:00100000:3.0:1746143853.875164:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401600 00000100:00100000:3.0:1746143853.875174:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401472 00000100:00100000:3.0:1746143853.875177:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401472 00000100:00100000:3.0:1746143853.875255:0:13436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401728 00000100:00100000:2.0:1746143853.875256:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401856 00000100:00100000:3.0:1746143853.875257:0:13436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401728 00000100:00100000:2.0:1746143853.875260:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401856 00000100:00100000:3.0:1746143853.875274:0:13436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17560 00000100:00100000:2.0:1746143853.875279:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17561 00000100:00100000:3.0:1746143853.875281:0:13436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625401216:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143853.875284:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625401600:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143853.875295:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17562 00000100:00100000:2.0:1746143853.875298:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625401344:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143853.875314:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17563 00000100:00100000:1.0:1746143853.875318:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625401472:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:0.0:1746143853.875318:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17564 00000100:00100000:0.0:1746143853.875326:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625401728:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:1.0:1746143853.875362:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625401472:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.875362:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+42:2010:x1830963625401728:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 35us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.875363:0:13436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625401216:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 81us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.875367:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17563 00000100:00100000:0.0:1746143853.875370:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17564 00000100:00100000:2.0:1746143853.875410:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625401344:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 111us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.875540:0:13436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17560 00000100:00100000:0.0:1746143853.875544:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17565 00000100:00100000:0.0:1746143853.875552:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+26:2011:x1830963625401856:12345-192.168.202.3@tcp:23:lfs.0 00000100:00100000:2.0:1746143853.875562:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17562 00000100:00100000:0.0:1746143853.875581:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7448e42d-373a-41e0-9678-9a18291c6700+25:2011:x1830963625401856:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746143853.875586:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17565 00000100:00100000:2.0:1746143853.875598:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7448e42d-373a-41e0-9678-9a18291c6700+40:2011:x1830963625401600:12345-192.168.202.3@tcp:23:lfs.0 Request processed in 314us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.875602:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17561 00000100:00100000:0.0:1746143853.877941:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.877970:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625401984 00000100:00100000:1.0:1746143853.878059:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625401984 00000100:00100000:1.0:1746143853.878093:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17566 00000100:00100000:1.0:1746143853.878100:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+25:3284:x1830963625401984:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1746143853.878111:0:12327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746143853.878126:0:12327:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73b7837 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413188 expref: -99 pid: 12327 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746143853.878143:0:12327:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x3bc:0x0] initial LVB size: 2097152, mtime: 0x68140a3f, atime: 0x0, ctime: 0x68140a3f, blocks: 0xf28 00010000:00010000:1.0:1746143853.878159:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.878161:0:12327:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.878166:0:12327:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73b7837 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413188 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.878183:0:12327:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009e55aa00/0x87925e4cb73b7837 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413188 expref: 26 pid: 12327 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.878190:0:12327:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e55aa00, rc 0) 00000100:00100000:1.0:1746143853.878236:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+26:3284:x1830963625401984:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746143853.878242:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17566 00000100:00100000:0.0:1746143853.879565:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.879633:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625402112 00000100:00100000:2.0:1746143853.879639:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625402112 00000100:00100000:2.0:1746143853.879720:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17567 00000100:00100000:2.0:1746143853.879727:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+26:2008:x1830963625402112:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:2.0:1746143853.879871:0:9587:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143853.879874:0:9587:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143853.879876:0:9587:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746143853.879878:0:9587:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:2.0:1746143853.879879:0:9587:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:2.0:1746143853.880138:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625402112:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 410us (573us total) trans 21474841416 rc 0/0 00000100:00100000:2.0:1746143853.880144:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17567 00000100:00100000:0.0:1746143853.882116:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.882168:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625402240 00000100:00100000:2.0:1746143853.882174:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625402240 00000100:00100000:2.0:1746143853.882209:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17568 00000100:00100000:2.0:1746143853.882215:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+40:3284:x1830963625402240:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.882235:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143853.882250:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e30200/0x87925e4cb73b783e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841318f expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746143853.882267:0:9587:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x39d:0x0] initial LVB size: 4194304, mtime: 0x68140a3f, atime: 0x0, ctime: 0x68140a3f, blocks: 0x1f28 00010000:00010000:2.0:1746143853.882282:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.882283:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.882289:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30200/0x87925e4cb73b783e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841318f expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.882301:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090e30200/0x87925e4cb73b783e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841318f expref: 41 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.882308:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e30200, rc 0) 00000100:00100000:2.0:1746143853.882334:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+41:3284:x1830963625402240:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 120us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.882343:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17568 00000100:00100000:0.0:1746143853.883741:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.883825:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625402368 00000100:00100000:1.0:1746143853.883831:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625402368 00000100:00100000:1.0:1746143853.883883:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17569 00000100:00100000:1.0:1746143853.883888:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+41:2009:x1830963625402368:12345-192.168.202.3@tcp:22:lfs.0 00002000:00010000:1.0:1746143853.884023:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746143853.884025:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143853.884026:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746143853.884028:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:1.0:1746143853.884029:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:1.0:1746143853.884057:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625402368:12345-192.168.202.3@tcp:22:lfs.0 Request processed in 168us (318us total) trans 17179874163 rc 0/0 00000100:00100000:1.0:1746143853.884063:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17569 00000100:00100000:0.0:1746143853.887559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.887636:0:20385:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625402624 00000100:00100000:2.0:1746143853.887644:0:20385:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625402624 00000100:00100000:2.0:1746143853.887706:0:20385:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7672 00000100:00100000:2.0:1746143853.887713:0:20385:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625402624:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:2.0:1746143853.887744:0:20385:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.887761:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.887763:0:20385:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.887768:0:20385:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.887779:0:20385:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.889334:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.889405:0:20386:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625402880 00000100:00100000:1.0:1746143853.889410:0:20386:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625402880 00000100:00100000:1.0:1746143853.889461:0:20386:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7673 00000100:00100000:1.0:1746143853.889468:0:20386:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+27:2010:x1830963625402880:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143853.889491:0:20386:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.889502:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.889503:0:20386:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.889507:0:20386:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.889517:0:20386:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.890602:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.891193:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625403136 00000100:00100000:3.0:1746143853.891200:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625403136 00000100:00100000:3.0:1746143853.891253:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7674 00000100:00100000:3.0:1746143853.891259:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625403136:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143853.891283:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.891294:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.891296:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.891299:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.891309:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.892953:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.893449:0:13437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625403392 00000100:00100000:3.0:1746143853.893457:0:13437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625403392 00000100:00100000:3.0:1746143853.893504:0:13437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7675 00000100:00100000:3.0:1746143853.893510:0:13437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625403392:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143853.893536:0:13437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.893547:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.893549:0:13437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.893552:0:13437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.893562:0:13437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.893999:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.894038:0:13453:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625403648 00000100:00100000:0.0:1746143853.894042:0:13453:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625403648 00000100:00100000:0.0:1746143853.894068:0:13453:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7676 00000100:00100000:0.0:1746143853.894073:0:13453:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625403648:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143853.894087:0:13453:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.894095:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.894096:0:13453:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.894099:0:13453:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.894107:0:13453:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.896872:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.896951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.897033:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625403904 00000100:00100000:3.0:1746143853.897041:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625403904 00000100:00100000:3.0:1746143853.897100:0:20387:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625404160 00000100:00100000:3.0:1746143853.897103:0:20387:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625404160 00000100:00100000:3.0:1746143853.897124:0:20387:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7677 00000100:00100000:3.0:1746143853.897132:0:20387:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625403904:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:3.0:1746143853.897160:0:20387:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.897172:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.897174:0:20387:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.897178:0:20387:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.897190:0:20387:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.898028:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7678 00000100:00100000:0.0:1746143853.898036:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963625404160:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:0.0:1746143853.898056:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.898065:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.898066:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746143853.898070:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.898078:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.900674:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1746143853.903601:0:29556:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625404416 00000100:00100000:1.0:1746143853.903612:0:29556:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625404416 00000100:00100000:1.0:1746143853.903671:0:29556:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7679 00000100:00100000:1.0:1746143853.903678:0:29556:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+33:2011:x1830963625404416:12345-192.168.202.3@tcp:3:lfs.0 00010000:00010000:1.0:1746143853.903709:0:29556:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.903720:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.903721:0:29556:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746143853.903726:0:29556:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.903736:0:29556:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905067:0:20385:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905078:0:20385:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905085:0:20385:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905090:0:20385:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090e31600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143853.905094:0:20385:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905101:0:20385:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905116:0:20385:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.905122:0:20385:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e31600/0x87925e4cb73b7845 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.905200:0:20385:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7448e42d-373a-41e0-9678-9a18291c6700+48:2011:x1830963625402624:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 17485us (17645us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746143853.905210:0:20385:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7672 00010000:00010000:1.0:1746143853.913562:0:20386:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.913576:0:20386:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.913584:0:20386:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.913589:0:20386:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d7c600 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143853.913592:0:20386:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.913598:0:20386:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.913615:0:20386:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.913619:0:20386:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d7c600/0x87925e4cb73b784c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20386 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.913705:0:20386:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7448e42d-373a-41e0-9678-9a18291c6700+33:2010:x1830963625402880:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 24234us (24373us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143853.913716:0:20386:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7673 00010000:00010000:3.0:1746143853.918873:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.918892:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.918899:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.918905:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3b200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143853.918908:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.918938:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.918954:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.918960:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3b200/0x87925e4cb73b7853 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.919040:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7448e42d-373a-41e0-9678-9a18291c6700+31:2011:x1830963625403136:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 27777us (28438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143853.919049:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7674 00010000:00010000:0.0:1746143853.921526:0:13437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.921540:0:13437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.921547:0:13437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.921558:0:13437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e3be00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:0.0:1746143853.921561:0:13437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.921569:0:13437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.921583:0:13437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746143853.921589:0:13437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e3be00/0x87925e4cb73b785a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746143853.921674:0:13437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7448e42d-373a-41e0-9678-9a18291c6700+46:2011:x1830963625403392:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 28160us (28724us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746143853.921683:0:13437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7675 00010000:00010000:2.0:1746143853.924620:0:13453:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.924635:0:13453:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.924643:0:13453:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.924649:0:13453:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8ac00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143853.924653:0:13453:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.924660:0:13453:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.924679:0:13453:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.924685:0:13453:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8ac00/0x87925e4cb73b7861 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13453 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.924776:0:13453:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7448e42d-373a-41e0-9678-9a18291c6700+44:2011:x1830963625403648:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 30699us (30773us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746143853.925214:0:13453:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7676 00010000:00010000:3.0:1746143853.928330:0:20387:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.928343:0:20387:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.928355:0:20387:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.928360:0:20387:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74a00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:3.0:1746143853.928364:0:20387:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.928371:0:20387:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.928387:0:20387:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.928393:0:20387:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091d74a00/0x87925e4cb73b7868 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20387 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.928469:0:20387:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7448e42d-373a-41e0-9678-9a18291c6700+29:2011:x1830963625403904:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 31334us (31600us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143853.928478:0:20387:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7677 00010000:00010000:2.0:1746143853.932179:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.932194:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.932201:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.932208:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb8a200 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:2.0:1746143853.932211:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.932229:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.932245:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.932256:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb8a200/0x87925e4cb73b786f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.932408:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7448e42d-373a-41e0-9678-9a18291c6700+42:2011:x1830963625404160:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 34369us (35453us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746143853.932417:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7678 00010000:00010000:1.0:1746143853.933202:0:29556:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.933211:0:29556:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.933217:0:29556:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.933233:0:29556:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009e55be00 already unused, calling callback (ffffffffa0864d70) 00010000:00010000:1.0:1746143853.933235:0:29556:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.933241:0:29556:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.933250:0:29556:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746143853.933256:0:29556:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55be00/0x87925e4cb73b7876 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29556 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746143853.933313:0:29556:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7448e42d-373a-41e0-9678-9a18291c6700+27:2011:x1830963625404416:12345-192.168.202.3@tcp:3:lfs.0 Request processed in 29633us (32644us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746143853.933320:0:29556:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7679 00000100:00100000:0.0:1746143853.942582:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.942731:0:6587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625404672 00000100:00100000:3.0:1746143853.942740:0:6587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625404672 00000100:00100000:3.0:1746143853.942791:0:6587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14203 00000100:00100000:3.0:1746143853.942797:0:6587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+263:3284:x1830963625404672:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1746143853.942837:0:6587:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143853.942860:0:6587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e3ba00/0x87925e4cb73b7806 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x34d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413157 expref: 263 pid: 6587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.942878:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.942882:0:6587:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746143853.942942:0:6587:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.942952:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.942958:0:6587:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00000004:00010000:3.0:1746143853.943040:0:6587:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136634a80 reply state ffff88009b567000 transno 8589945319 ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.943048:0:6587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:3.0:1746143853.943053:0:6587:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143853.943055:0:6587:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746143853.943057:0:6587:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143853.943140:0:6587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7448e42d-373a-41e0-9678-9a18291c6700+264:3284:x1830963625404672:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 342us (563us total) trans 8589945319 rc 0/0 00000100:00100000:3.0:1746143853.943146:0:6587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14203 00000100:00100000:0.0:1746143853.945874:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.945962:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625404800 00000100:00100000:2.0:1746143853.945969:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625404800 00000100:00100000:2.0:1746143853.946012:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17570 00000100:00100000:2.0:1746143853.946019:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:3284:x1830963625404800:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.946033:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143853.946047:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73b7884 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c94248413196 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.946070:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.946077:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.946078:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.946081:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73b7884 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413196 expref: 43 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.946104:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.946114:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.946123:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627634432:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.946617:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746143853.948196:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627634432:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143853.948235:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73b7884 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413196 expref: 43 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.948249:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d849600, rc 0) 00000100:00100000:2.0:1746143853.948281:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:3284:x1830963625404800:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2261us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.948294:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17570 00000100:00100000:0.0:1746143853.949070:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.949144:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625404928 00000100:00100000:2.0:1746143853.949150:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625404928 00010000:00010000:2.0:1746143853.949172:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.949205:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8619 00000100:00100000:2.0:1746143853.949212:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625404928:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.949232:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.949249:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.949259:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.949278:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090e30a00/0x87925e4cb73b781b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841315e expref: 43 pid: 9585 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.949508:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.949510:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.949516:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73b7884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413196 expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.949524:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73b7884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413196 expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.949548:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d849600/0x87925e4cb73b7884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413196 expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.949558:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627634560:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143853.949710:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746143853.953820:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.953903:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627634560:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143853.953933:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143853.953938:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405056 00000100:00100000:3.0:1746143853.953944:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405056 00000100:00100000:2.0:1746143853.954405:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4c57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625404928:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5191us (5334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.954412:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17571 00000100:00100000:2.0:1746143853.954414:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8619 00000100:00100000:3.0:1746143853.954420:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:3284:x1830963625405056:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.954434:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.954451:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b788b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c9424841319d expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.954477:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.954484:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.954485:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.954488:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b788b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841319d expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.954512:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.954522:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.954532:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627634688:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143853.957692:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143853.959975:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627634688:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.960002:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b788b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841319d expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.960018:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74e00, rc 0) 00000100:00100000:3.0:1746143853.960069:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:3284:x1830963625405056:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 5649us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.960078:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17571 00000100:00100000:0.0:1746143853.965592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.965669:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405184 00000100:00100000:2.0:1746143853.965677:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405184 00010000:00010000:2.0:1746143853.965717:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.965758:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8620 00000100:00100000:2.0:1746143853.965766:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625405184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.965783:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.965801:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.965812:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.965832:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e3ac00/0x87925e4cb73b780d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413165 expref: 28 pid: 1947 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.965859:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.965861:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.965866:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b788b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841319d expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.965873:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b788b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841319d expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.965899:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d74e00/0x87925e4cb73b788b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841319d expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.965909:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627634816:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143853.966552:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143853.968998:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.969051:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405312 00000100:00100000:3.0:1746143853.969059:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405312 00000100:00100000:2.0:1746143853.969084:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627634816:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143853.969100:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143853.969103:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17572 00000100:00100000:3.0:1746143853.969110:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:3284:x1830963625405312:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.969124:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746143853.969134:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625405184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3369us (3548us total) trans 0 rc 0/0 00010000:00010000:3.0:1746143853.969137:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b7892 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484131a4 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.969159:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.969164:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.969166:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.969170:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b7892 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131a4 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.969192:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 29 pid: 13436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.969201:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 29 pid: 13436 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.969210:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627634944:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143853.969262:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143853.969652:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8620 00000100:00100000:3.0:1746143853.971906:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627634944:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.971955:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b7892 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131a4 expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.971967:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75800, rc 0) 00000100:00100000:3.0:1746143853.972008:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:3284:x1830963625405312:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2898us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.972015:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17572 00000100:00100000:0.0:1746143853.972373:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.972809:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405440 00000100:00100000:2.0:1746143853.972814:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405440 00010000:00010000:2.0:1746143853.972835:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 28 pid: 13436 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.972864:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8621 00000100:00100000:2.0:1746143853.972870:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+28:2008:x1830963625405440:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.972880:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.972896:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 28 pid: 13436 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.972905:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 28 pid: 13436 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.972947:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090e31a00/0x87925e4cb73b7829 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3be:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841316c expref: 28 pid: 13436 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.972961:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.972963:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.972968:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b7892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131a4 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.972975:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b7892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131a4 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.972997:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091d75800/0x87925e4cb73b7892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3be:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131a4 expref: 27 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.973007:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627635072:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143853.973066:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143853.976034:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.976157:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405568 00000100:00100000:3.0:1746143853.976165:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405568 00000100:00100000:3.0:1746143853.976207:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17573 00000100:00100000:3.0:1746143853.976213:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:3284:x1830963625405568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.976238:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.976252:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b7899 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484131ab expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.976275:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.976282:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.976283:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.976286:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b7899 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131ab expref: 43 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.976310:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.976319:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.976329:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627635200:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143853.976384:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746143853.976590:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627635072:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143853.976604:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143853.976635:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2008:x1830963625405440:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3764us (4262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.976642:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8621 00000100:00100000:0.0:1746143853.978891:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.978977:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627635200:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.978999:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b7899 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131ab expref: 43 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.979013:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d74000, rc 0) 00000100:00100000:3.0:1746143853.979058:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:3284:x1830963625405568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2844us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.979065:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17573 00000100:00100000:2.0:1746143853.979456:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405696 00000100:00100000:2.0:1746143853.979462:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405696 00010000:00010000:2.0:1746143853.979485:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.979515:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8622 00000100:00100000:2.0:1746143853.979521:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625405696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746143853.979532:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746143853.979548:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.979558:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.979576:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880082087200/0x87925e4cb73b7822 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413173 expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00010000:00010000:2.0:1746143853.979591:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.979593:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.979599:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b7899 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131ab expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.979606:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b7899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131ab expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.979629:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d74000/0x87925e4cb73b7899 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131ab expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746143853.979639:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627635328:192.168.202.3@tcp:105: 00000100:00100000:2.0:1746143853.979695:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143853.980949:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627635328:192.168.202.3@tcp:105: 00010000:00010000:2.0:1746143853.980961:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746143853.980999:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625405696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1478us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.981006:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8622 00000100:00100000:0.0:1746143853.981361:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.981482:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405824 00000100:00100000:3.0:1746143853.981487:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405824 00000100:00100000:3.0:1746143853.981519:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17574 00000100:00100000:3.0:1746143853.981524:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+42:3284:x1830963625405824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1746143853.981537:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746143853.981549:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b78a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484131b2 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.981568:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.981574:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.981575:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.981578:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b78a0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b2 expref: 43 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.981601:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746143853.981609:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.981617:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627635456:192.168.202.3@tcp:104: 00000100:00100000:3.0:1746143853.981667:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143853.983536:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9587:1830963627635456:192.168.202.3@tcp:104: 00010000:00010000:3.0:1746143853.983555:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b78a0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b2 expref: 43 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.983569:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091d75e00, rc 0) 00000100:00100000:3.0:1746143853.983596:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+43:3284:x1830963625405824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2071us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.983603:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17574 00000100:00100000:0.0:1746143853.983838:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.984210:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625405952 00000100:00100000:3.0:1746143853.984215:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625405952 00010000:00010000:3.0:1746143853.984244:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.984272:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8623 00000100:00100000:3.0:1746143853.984278:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093100000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+43:2008:x1830963625405952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143853.984287:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143853.984302:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143853.984311:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143853.984328:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5b97600/0x87925e4cb73b7830 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x39f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c9424841317a expref: 43 pid: 9839 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143853.984352:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.984354:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.984359:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b78a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b2 expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.984366:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b78a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b2 expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.984387:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091d75e00/0x87925e4cb73b78a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b2 expref: 42 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.984397:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627635584:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143853.985340:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746143853.986459:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7230:1830963627635584:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143853.986473:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746143853.986508:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.986513:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093100000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+42:2008:x1830963625405952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2235us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.986521:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8623 00000100:00100000:2.0:1746143853.986554:0:9587:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406080 00000100:00100000:2.0:1746143853.986559:0:9587:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406080 00000100:00100000:2.0:1746143853.986593:0:9587:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17575 00000100:00100000:2.0:1746143853.986598:0:9587:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+27:3284:x1830963625406080:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143853.986610:0:9587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143853.986623:0:9587:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b78a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484131b9 expref: -99 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.986645:0:9587:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 28 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.986651:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.986652:0:9587:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746143853.986655:0:9587:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b78a7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b9 expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.986675:0:9587:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 28 pid: 3134 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746143853.986684:0:9587:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 28 pid: 3134 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.986693:0:9587:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627635712:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.986731:0:9587:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:0.0:1746143853.990064:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143853.990164:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406208 00000100:00100000:3.0:1746143853.990171:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406208 00010000:00010000:3.0:1746143853.990196:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 29 pid: 3134 timeout: 1013 lvb_type: 1 00000100:00100000:3.0:1746143853.990228:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8624 00000100:00100000:3.0:1746143853.990235:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625406208:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143853.990246:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143853.990262:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 29 pid: 3134 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143853.990272:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 29 pid: 3134 timeout: 1013 lvb_type: 1 00010000:00010000:3.0:1746143853.990293:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.990295:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746143853.990301:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b78a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b9 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.990308:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b78a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b9 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746143853.990338:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b78a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b9 expref: 29 pid: 9587 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143853.990351:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627635840:192.168.202.3@tcp:105: 00000100:00100000:3.0:1746143853.990422:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097358c00 going to sleep for 11 seconds 00010000:00010000:2.0:1746143853.990501:0:9587:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009e55ba00/0x87925e4cb73b7814 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3bf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413181 expref: 29 pid: 3134 timeout: 1013 lvb_type: 1 00000100:00100000:2.0:1746143853.990517:0:9587:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9587:1830963627635712:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143853.990534:0:9587:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d848600/0x87925e4cb73b78a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3bf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131b9 expref: 28 pid: 9587 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.990542:0:9587:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d848600, rc 0) 00000100:00100000:2.0:1746143853.990560:0:9587:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093100380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7448e42d-373a-41e0-9678-9a18291c6700+28:3284:x1830963625406080:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3962us (4054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143853.990566:0:9587:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17575 00000100:00100000:3.0:1746143853.992872:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b4177480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7230:1830963627635840:192.168.202.3@tcp:105: 00010000:00010000:3.0:1746143853.992889:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746143853.992944:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625406208:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2709us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1746143853.992953:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8624 00000100:00100000:0.0:1746143853.993335:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.993363:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.993378:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406336 00000100:00100000:0.0:1746143853.993383:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406336 00000100:00100000:0.0:1746143853.993406:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406592 00000100:00100000:0.0:1746143853.993408:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406592 00000100:00100000:0.0:1746143853.993418:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17576 00000100:00100000:0.0:1746143853.993424:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+42:2009:x1830963625406336:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143853.993530:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746143853.993533:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143853.993534:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143851 -> 1746143853 00002000:00010000:0.0:1746143853.993536:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143852 -> 1746143854 00002000:00010000:0.0:1746143853.993538:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746143853.993553:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625406336:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 129us (219us total) trans 17179874164 rc 0/0 00000100:00100000:0.0:1746143853.993557:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17576 00000100:00100000:0.0:1746143853.993566:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17577 00000100:00100000:0.0:1746143853.993570:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+27:2009:x1830963625406592:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143853.993612:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143853.993614:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143853.993616:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143852 -> 1746143853 00002000:00010000:0.0:1746143853.993617:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143852 -> 1746143854 00002000:00010000:0.0:1746143853.993619:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143853.993632:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625406592:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 62us (268us total) trans 21474841417 rc 0/0 00000100:00100000:0.0:1746143853.993637:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17577 00000100:00100000:0.0:1746143853.993658:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.993668:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406848 00000100:00100000:0.0:1746143853.993671:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406848 00000100:00100000:0.0:1746143853.993684:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17578 00000100:00100000:0.0:1746143853.993688:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093101180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+43:2009:x1830963625406848:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143853.993722:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:0.0:1746143853.993724:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143853.993726:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143852 -> 1746143853 00002000:00010000:0.0:1746143853.993727:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143852 -> 1746143854 00002000:00010000:0.0:1746143853.993729:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:0.0:1746143853.993743:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093101180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625406848:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 54us (84us total) trans 17179874165 rc 0/0 00000100:00100000:0.0:1746143853.993747:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17578 00000100:00100000:0.0:1746143853.993766:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.993774:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406464 00000100:00100000:0.0:1746143853.993776:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406464 00000100:00100000:0.0:1746143853.993786:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17579 00000100:00100000:0.0:1746143853.993789:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+28:2009:x1830963625406464:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143853.993818:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143853.993820:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143851 -> 1746143852 00002000:00010000:0.0:1746143853.993822:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143851 -> 1746143853 00002000:00010000:0.0:1746143853.993823:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143852 -> 1746143854 00002000:00010000:0.0:1746143853.993825:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143853.993836:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093101500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625406464:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 47us (69us total) trans 21474841418 rc 0/0 00000100:00100000:0.0:1746143853.993841:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17579 00000100:00100000:0.0:1746143853.993858:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.993864:0:12327:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406720 00000100:00100000:0.0:1746143853.993866:0:12327:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406720 00000100:00100000:0.0:1746143853.993876:0:12327:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17580 00000100:00100000:0.0:1746143853.993879:0:12327:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+44:2009:x1830963625406720:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143853.993906:0:12327:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143853.993908:0:12327:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143853.993909:0:12327:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143852 -> 1746143853 00002000:00010000:0.0:1746143853.993928:0:12327:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143852 -> 1746143854 00002000:00010000:0.0:1746143853.993930:0:12327:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746143853.993942:0:12327:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7448e42d-373a-41e0-9678-9a18291c6700+45:2009:x1830963625406720:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 63us (84us total) trans 17179874166 rc 0/0 00000100:00100000:0.0:1746143853.993947:0:12327:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17580 00000100:00100000:0.0:1746143853.993971:0:3766:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1746143853.993979:0:9839:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625406976 00000100:00100000:0.0:1746143853.993981:0:9839:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625406976 00000100:00100000:0.0:1746143853.993992:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17581 00000100:00100000:0.0:1746143853.993995:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+29:2009:x1830963625406976:12345-192.168.202.3@tcp:2:lfs.0 00002000:00010000:0.0:1746143853.994026:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143853.994028:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143853.994030:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:0.0:1746143853.994031:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143852 -> 1746143854 00002000:00010000:0.0:1746143853.994033:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746143853.994045:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7448e42d-373a-41e0-9678-9a18291c6700+30:2009:x1830963625406976:12345-192.168.202.3@tcp:2:lfs.0 Request processed in 49us (73us total) trans 21474841419 rc 0/0 00000100:00100000:0.0:1746143853.994049:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17581 00000100:00100000:0.0:1746143853.996573:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143853.996635:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625407232 00000100:00100000:2.0:1746143853.996643:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625407232 00000100:00100000:2.0:1746143853.996689:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5555 00000100:00100000:2.0:1746143853.996695:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+264:3284:x1830963625407232:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:2.0:1746143853.996739:0:24157:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x34d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b77b9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413149 expref: 264 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.996777:0:24157:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143853.996787:0:24157:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 264 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.996793:0:24157:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 4/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143853.996817:0:24157:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 264 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143853.996827:0:24157:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 264 pid: 7243 timeout: 1013 lvb_type: 0 00000100:00100000:2.0:1746143853.996838:0:24157:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24157:1830963627635968:192.168.202.3@tcp:104: 00000100:00100000:2.0:1746143853.996907:0:24157:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093fd2900 going to sleep for 11 seconds 00000100:00100000:2.0:1746143853.999408:0:24157:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095e30a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:24157:1830963627635968:192.168.202.3@tcp:104: 00010000:00010000:2.0:1746143853.999428:0:24157:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00000100:00100000:0.0:1746143854.002234:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1746143854.003245:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625407360 00000100:00100000:3.0:1746143854.003255:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625407360 00010000:00010000:3.0:1746143854.003588:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 265 pid: 7243 timeout: 1013 lvb_type: 0 00000100:00080000:1.0:1746143854.003674:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746143854.003703:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8625 00000100:00100000:3.0:1746143854.003710:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093102300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+265:2009:x1830963625407360:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746143854.003721:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746143854.003726:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 265 pid: 7243 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143854.003736:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 265 pid: 7243 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143854.003753:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b77f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x2c51c94248413150 expref: 265 pid: 7243 timeout: 1013 lvb_type: 0 00010000:00010000:3.0:1746143854.003776:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:3.0:1746143854.003780:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00010000:00010000:3.0:1746143854.003788:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24157 initiator: MDT0 00010000:00010000:3.0:1746143854.003797:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 24157 initiator: MDT0 00010000:00010000:3.0:1746143854.003821:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746143854.003855:0:24157:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.003862:0:24157:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00000040:00080000:2.0:1746143854.004093:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3375, 88 off284864 00000004:00080000:2.0:1746143854.004099:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228186371ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004134:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3355, 88 off282752 00000100:00100000:3.0:1746143854.004138:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093102300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7448e42d-373a-41e0-9678-9a18291c6700+264:2009:x1830963625407360:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 428us (1918us total) trans 0 rc 0/0 00000004:00080000:2.0:1746143854.004139:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228226967ns, next at 850789974850ns, rc = 0 00000100:00100000:3.0:1746143854.004144:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8625 00000040:00080000:2.0:1746143854.004150:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3356, 88 off282840 00000004:00080000:2.0:1746143854.004153:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228240802ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143854.004160:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3376, 88 off284952 00000004:00080000:2.0:1746143854.004163:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228250851ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004170:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3377, 88 off285040 00000004:00080000:2.0:1746143854.004172:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228260261ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004179:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3357, 88 off282928 00000004:00080000:2.0:1746143854.004182:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228269707ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143854.004717:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3358, 88 off283016 00000004:00080000:2.0:1746143854.004722:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228810096ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143854.004753:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3359, 88 off283104 00000004:00080000:2.0:1746143854.004757:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228844431ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143854.004767:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3378, 88 off285128 00000004:00080000:2.0:1746143854.004770:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228857607ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004777:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3360, 88 off283192 00000004:00080000:2.0:1746143854.004780:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228867621ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143854.004787:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3379, 88 off285216 00000004:00080000:2.0:1746143854.004790:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228877769ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004797:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3361, 88 off283280 00000004:00080000:2.0:1746143854.004798:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228886349ns, next at 850789974850ns, rc = 0 00000040:00080000:2.0:1746143854.004806:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3380, 88 off285304 00000004:00080000:2.0:1746143854.004808:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228895824ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004815:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3381, 88 off285392 00000004:00080000:2.0:1746143854.004817:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228904666ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004822:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3382, 88 off285480 00000004:00080000:2.0:1746143854.004825:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228913069ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004830:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3383, 88 off285568 00000004:00080000:2.0:1746143854.004832:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 913228920291ns, next at 850790015893ns, rc = 0 00000040:00080000:2.0:1746143854.004838:0:24157:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3362, 88 off283368 00000004:00080000:2.0:1746143854.004840:0:24157:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 913228927972ns, next at 850789974850ns, rc = 0 00010000:00010000:0.0:1746143854.005409:0:10929:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1746143854.008165:0:8209:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945320 is committed 00000004:00080000:3.0:1746143854.008174:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2574 committed 00000004:00080000:3.0:1746143854.008190:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2598 committed 00000004:00080000:3.0:1746143854.008196:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2597 committed 00000004:00080000:3.0:1746143854.008197:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2596 committed 00000004:00080000:3.0:1746143854.008199:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2595 committed 00000004:00080000:3.0:1746143854.008200:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2573 committed 00000004:00080000:3.0:1746143854.008202:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2594 committed 00000004:00080000:3.0:1746143854.008203:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2572 committed 00000004:00080000:3.0:1746143854.008204:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2593 committed 00000004:00080000:3.0:1746143854.008205:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2571 committed 00000004:00080000:3.0:1746143854.008207:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2570 committed 00000004:00080000:3.0:1746143854.008208:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2569 committed 00000004:00080000:3.0:1746143854.008209:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2592 committed 00000004:00080000:3.0:1746143854.008211:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2591 committed 00000004:00080000:3.0:1746143854.008212:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2568 committed 00000004:00080000:3.0:1746143854.008213:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2567 committed 00000004:00080000:3.0:1746143854.008227:0:8209:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2590 committed 00010000:00010000:0.0:1746143854.008308:0:3757:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143854.008317:0:3757:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143854.008323:0:3757:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143854.008328:0:3757:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091d74a00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:0.0:1746143854.008331:0:3757:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143854.008337:0:3757:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143854.008349:0:3757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00000100:00100000:1.0:1746143854.008351:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627636352:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746143854.008351:0:3757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746143854.008354:0:3757:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00010000:00010000:0.0:1746143854.008358:0:3757:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091d74a00/0x87925e4cb73b787d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6587 initiator: MDT0 00000100:00100000:3.0:1746143854.008408:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627636224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143854.008423:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627636096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143854.008434:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143854.008445:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143854.008459:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627636736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746143854.008471:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746143854.008479:0:24157:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093101f80 reply state ffff8800941ab400 transno 8589945320 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008489:0:24157:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24157 initiator: MDT0 00000100:00100000:3.0:1746143854.008490:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627636480:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143854.008495:0:24157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143854.008497:0:24157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746143854.008500:0:24157:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746143854.008502:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746143854.008505:0:24157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143854.008506:0:24157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:3.0:1746143854.008510:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627636992:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143854.008511:0:24157:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ee76400/0x87925e4cb73b77b9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x34d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x2c51c94248413149 expref: 261 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746143854.008520:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746143854.008539:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636224 00000100:00100000:3.0:1746143854.008545:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636224 00000100:00100000:3.0:1746143854.008568:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636096 00000100:00100000:3.0:1746143854.008569:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636096 00010000:00080000:2.0:1746143854.008576:0:24157:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746143854.008577:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636736 00000100:00100000:3.0:1746143854.008578:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636736 00000100:00100000:2.0:1746143854.008585:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:3284:x1830963625407232:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 11890us (12017us total) trans 8589945320 rc 0/0 00000100:00100000:3.0:1746143854.008586:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636480 00000100:00100000:3.0:1746143854.008587:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636480 00000100:00100000:3.0:1746143854.008594:0:1947:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636992 00000100:00100000:2.0:1746143854.008594:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5555 00000100:00100000:3.0:1746143854.008596:0:1947:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636992 00000100:00100000:3.0:1746143854.008605:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17582 00000100:00100000:3.0:1746143854.008609:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3774:x1830963627636224:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746143854.008613:0:3758:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008617:0:3758:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008621:0:3758:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008625:0:3758:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d848e00 already unused, calling callback (ffffffffa0f2a690) 00010000:00010000:2.0:1746143854.008627:0:3758:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008631:0:3758:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008637:0:3758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143854.008639:0:3758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143854.008640:0:3758:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24157 initiator: MDT0 00010000:00010000:2.0:1746143854.008644:0:3758:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d848e00/0x87925e4cb73b78ae lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24157 initiator: MDT0 00000100:00100000:2.0:1746143854.008657:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17583 00000100:00100000:2.0:1746143854.008662:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3773:x1830963627636096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143854.008698:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746143854.008698:0:12328:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746143854.008700:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143854.008700:0:12328:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:3.0:1746143854.008702:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:2.0:1746143854.008702:0:12328:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:3.0:1746143854.008704:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb ctime from disk: 1746143854 -> 1746143854 00002000:00010000:2.0:1746143854.008704:0:12328:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb ctime from disk: 1746143854 -> 1746143854 00002000:00010000:3.0:1746143854.008706:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3be:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:2.0:1746143854.008706:0:12328:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bd:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143854.008723:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3773:x1830963627636096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (277us total) trans 21474841421 rc 0/0 00000100:00100000:3.0:1746143854.008724:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963627636224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (290us total) trans 21474841420 rc 0/0 00000100:00100000:2.0:1746143854.008728:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17583 00000100:00100000:1.0:1746143854.009244:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143854.009263:0:3771:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627636864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746143854.009279:0:3771:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143854.009298:0:1945:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636352 00000100:00100000:1.0:1746143854.009301:0:1945:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636352 00000100:00100000:0.0:1746143854.009340:0:9586:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636864 00000100:00100000:0.0:1746143854.009343:0:9586:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636864 00000100:00100000:3.0:1746143854.009509:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17582 00000100:00100000:3.0:1746143854.009522:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17584 00000100:00100000:3.0:1746143854.009528:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3774:x1830963627636736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143854.009582:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17585 00000100:00100000:3.0:1746143854.009588:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3774:x1830963627636736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1115us total) trans 21474841422 rc 0/0 00000100:00100000:0.0:1746143854.009589:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3772:x1830963627636480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746143854.009632:0:9586:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143854.009635:0:9586:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143854.009637:0:9586:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143854.009638:0:9586:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143854.009640:0:9586:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bc:0x0] updating lvb blocks from disk: 3880 -> 3880 00000100:00100000:0.0:1746143854.009664:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963627636480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (1161us total) trans 21474841423 rc 0/0 00000100:00100000:1.0:1746143854.009680:0:1945:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17586 00000100:00100000:3.0:1746143854.009684:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17584 00000100:00100000:1.0:1746143854.009686:0:1945:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3772:x1830963627636992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143854.009687:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17585 00000100:00100000:3.0:1746143854.009695:0:1947:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17587 00000100:00100000:0.0:1746143854.009698:0:9586:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17588 00000100:00100000:3.0:1746143854.009700:0:1947:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963627636352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143854.009702:0:9586:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3771:x1830963627636864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746143854.009733:0:1947:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746143854.009735:0:1947:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:3.0:1746143854.009736:0:1947:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:3.0:1746143854.009738:0:1947:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb ctime from disk: 1746143854 -> 1746143854 00002000:00010000:3.0:1746143854.009739:0:1947:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x3bf:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746143854.009740:0:1945:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4177100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3772:x1830963627636992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (1218us total) trans 21474841424 rc 0/0 00000100:00100000:0.0:1746143854.009740:0:9586:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3771:x1830963627636864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (461us total) trans 21474841425 rc 0/0 00000100:00100000:0.0:1746143854.009745:0:9586:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17588 00000100:00100000:3.0:1746143854.009756:0:1947:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3771:x1830963627636352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (513us total) trans 21474841426 rc 0/0 00000004:00080000:0.0:1746143854.009774:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30380/2, rc 0, transno 21474841423 00000100:00100000:0.0:1746143854.009778:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627636480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746143854.009783:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4d180/2, rc 0, transno 21474841424 00000100:00100000:0.0:1746143854.009786:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627636992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746143854.010011:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c30e00/2, rc 0, transno 21474841421 00000100:00100000:2.0:1746143854.010015:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627636096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143854.010020:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627636608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143854.010038:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143854.010056:0:12328:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627636608 00000100:00100000:2.0:1746143854.010058:0:12328:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627636608 00000100:00100000:1.0:1746143854.010322:0:1945:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17586 00000100:00100000:3.0:1746143854.010348:0:1947:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17587 00000004:00080000:3.0:1746143854.010374:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31f80/2, rc 0, transno 21474841420 00000100:00100000:3.0:1746143854.010377:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627636224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143854.010384:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c33b80/2, rc 0, transno 21474841422 00000100:00100000:3.0:1746143854.010387:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3774:1830963627636736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746143854.010484:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143854.010490:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627637376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.010510:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143854.010517:0:3135:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637376 00000100:00100000:1.0:1746143854.010519:0:3135:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637376 00000100:00100000:0.0:1746143854.010522:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627637504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143854.010534:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17589 00000100:00100000:0.0:1746143854.010534:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746143854.010538:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3772:x1830963627637376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.010542:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627638016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.010555:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143854.010563:0:3772:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746143854.010566:0:3772:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627637888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.010577:0:3772:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746143854.010592:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637504 00002000:00010000:1.0:1746143854.010593:0:3135:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb size from disk: 4851232 -> 4851232 00002000:00010000:1.0:1746143854.010595:0:3135:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00000100:00100000:0.0:1746143854.010595:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637504 00002000:00010000:1.0:1746143854.010596:0:3135:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:1.0:1746143854.010598:0:3135:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb ctime from disk: 1746143854 -> 1746143854 00002000:00010000:1.0:1746143854.010600:0:3135:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39f:0x0] updating lvb blocks from disk: 5392 -> 5392 00000100:00100000:0.0:1746143854.010605:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627638016 00000100:00100000:0.0:1746143854.010607:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627638016 00000100:00100000:0.0:1746143854.010615:0:13430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637888 00000100:00100000:0.0:1746143854.010617:0:13430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637888 00000100:00100000:1.0:1746143854.010618:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3772:x1830963627637376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (108us total) trans 17179874167 rc 0/0 00000100:00100000:1.0:1746143854.010623:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17589 00000100:00100000:0.0:1746143854.010625:0:13430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17590 00000100:00100000:0.0:1746143854.010629:0:13430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3772:x1830963627637504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143854.010630:0:3135:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17591 00000100:00100000:1.0:1746143854.010634:0:3135:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3772:x1830963627638016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.010666:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17592 00000100:00100000:0.0:1746143854.010670:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3772:x1830963627637888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746143854.010679:0:3135:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3772:x1830963627638016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (124us total) trans 17179874168 rc 0/0 00000100:00100000:1.0:1746143854.010684:0:3135:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17591 00002000:00010000:0.0:1746143854.010705:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746143854.010708:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb mtime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143854.010710:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746143854.010711:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb ctime from disk: 1746143807 -> 1746143807 00002000:00010000:0.0:1746143854.010713:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39d:0x0] updating lvb blocks from disk: 7976 -> 7976 00000100:00100000:1.0:1746143854.010730:0:13430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3772:x1830963627637504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (196us total) trans 17179874169 rc 0/0 00000100:00100000:0.0:1746143854.010730:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3772:x1830963627637888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (151us total) trans 17179874170 rc 0/0 00000100:00100000:0.0:1746143854.010734:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17592 00000100:00100000:1.0:1746143854.010736:0:13430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17590 00000004:00080000:0.0:1746143854.010753:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4df80/2, rc 0, transno 17179874170 00000100:00100000:0.0:1746143854.010757:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627637888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143854.010763:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4e680/2, rc 0, transno 17179874169 00000100:00100000:0.0:1746143854.010765:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627637504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143854.010772:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4c380/2, rc 0, transno 17179874168 00000100:00100000:0.0:1746143854.010775:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627638016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746143854.010780:0:3772:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4f800/2, rc 0, transno 17179874167 00000100:00100000:0.0:1746143854.010782:0:3772:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3772:1830963627637376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.010803:0:12328:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17593 00000100:00100000:2.0:1746143854.010809:0:12328:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3773:x1830963627636608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143854.010857:0:12328:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3773:x1830963627636608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (818us total) trans 21474841427 rc 0/0 00000100:00100000:2.0:1746143854.010861:0:12328:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17593 00000100:00100000:2.0:1746143854.010876:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.010888:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143854.010925:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.010942:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143854.010950:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627638144:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.010964:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746143854.010978:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c33480/2, rc 0, transno 21474841427 00000100:00100000:2.0:1746143854.010980:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627636608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143854.010986:0:3773:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746143854.010988:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.010999:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143854.011008:0:3773:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.011020:0:3773:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746143854.011039:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637120 00000100:00100000:2.0:1746143854.011042:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637120 00000100:00100000:2.0:1746143854.011053:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637632 00000100:00100000:2.0:1746143854.011055:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637632 00000100:00100000:2.0:1746143854.011061:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627638144 00000100:00100000:2.0:1746143854.011063:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627638144 00000100:00100000:2.0:1746143854.011069:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637248 00000100:00100000:2.0:1746143854.011071:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637248 00000100:00100000:2.0:1746143854.011079:0:3134:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963627637760 00000100:00100000:2.0:1746143854.011080:0:3134:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963627637760 00000100:00100000:2.0:1746143854.011088:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17594 00000100:00100000:2.0:1746143854.011091:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627637120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746143854.011129:0:3134:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746143854.011131:0:3134:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:2.0:1746143854.011133:0:3134:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:2.0:1746143854.011134:0:3134:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb ctime from disk: 1746143854 -> 1746143854 00002000:00010000:2.0:1746143854.011136:0:3134:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39c:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746143854.011153:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627637120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (264us total) trans 17179874171 rc 0/0 00000100:00100000:2.0:1746143854.011157:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17594 00000100:00100000:2.0:1746143854.011165:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17595 00000100:00100000:2.0:1746143854.011168:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627637632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.011213:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627637632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (270us total) trans 17179874172 rc 0/0 00000100:00100000:2.0:1746143854.011230:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17595 00000100:00100000:2.0:1746143854.011241:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17596 00000100:00100000:2.0:1746143854.011245:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627638144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746143854.011293:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627638144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (327us total) trans 17179874173 rc 0/0 00000100:00100000:2.0:1746143854.011298:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17596 00000100:00100000:0.0:1746143854.011314:0:9839:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17597 00000100:00100000:0.0:1746143854.011319:0:9839:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3773:x1830963627637248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746143854.011355:0:9839:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746143854.011357:0:9839:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb mtime from disk: 1746143852 -> 1746143852 00002000:00010000:0.0:1746143854.011358:0:9839:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb atime from disk: 1746143853 -> 1746143853 00002000:00010000:0.0:1746143854.011360:0:9839:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb ctime from disk: 1746143854 -> 1746143854 00002000:00010000:0.0:1746143854.011362:0:9839:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x39e:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746143854.011377:0:3134:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17598 00000100:00100000:0.0:1746143854.011377:0:9839:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627637248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (377us total) trans 17179874174 rc 0/0 00000100:00100000:2.0:1746143854.011381:0:3134:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627637760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.011381:0:9839:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17597 00000004:00080000:3.0:1746143854.011467:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c32300/2, rc 0, transno 21474841426 00000100:00100000:3.0:1746143854.011470:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627636352:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746143854.011476:0:3771:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095c31880/2, rc 0, transno 21474841425 00000100:00100000:3.0:1746143854.011478:0:3771:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3771:1830963627636864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746143854.011971:0:3134:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095e32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3773:x1830963627637760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (407us total) trans 17179874175 rc 0/0 00000100:00100000:2.0:1746143854.011977:0:3134:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17598 00000004:00080000:2.0:1746143854.011999:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4ed80/2, rc 0, transno 17179874174 00000100:00100000:2.0:1746143854.012002:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637248:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143854.012008:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4d880/2, rc 0, transno 17179874175 00000100:00100000:2.0:1746143854.012010:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637760:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143854.012015:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4c700/2, rc 0, transno 17179874171 00000100:00100000:2.0:1746143854.012017:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143854.012022:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091d4dc00/2, rc 0, transno 17179874172 00000100:00100000:2.0:1746143854.012024:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627637632:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746143854.012028:0:3773:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ef1500/2, rc 0, transno 17179874173 00000100:00100000:2.0:1746143854.012031:0:3773:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ef1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3773:1830963627638144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746143854.013051:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143854.013119:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625407488 00000100:00100000:2.0:1746143854.013125:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625407488 00000100:00100000:2.0:1746143854.013688:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14204 00000100:00100000:2.0:1746143854.013695:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+260:3284:x1830963625407488:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1746143854.013712:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746143854.013727:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b78b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2c51c942484131c0 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143854.013766:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b78b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131c0 expref: 261 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143854.013776:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090e31000/0x87925e4cb73b78b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x34d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x2c51c942484131c0 expref: 261 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746143854.013788:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x34d:0x0].0x0 (ffff8800a5bc9900) 00010000:00010000:2.0:1746143854.013790:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746143854.013793:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090e31000, rc 0) 00000100:00100000:2.0:1746143854.013858:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7448e42d-373a-41e0-9678-9a18291c6700+261:3284:x1830963625407488:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 163us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746143854.013863:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14204 00000100:00100000:0.0:1746143854.015951:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1746143854.016009:0:24157:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830963625407744 00000100:00100000:2.0:1746143854.016016:0:24157:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830963625407744 00000100:00100000:2.0:1746143854.016055:0:24157:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5556 00000100:00100000:2.0:1746143854.016061:0:24157:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b495050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+261:3284:x1830963625407744:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1746143854.016195:0:24157:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b495050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7448e42d-373a-41e0-9678-9a18291c6700+262:3284:x1830963625407744:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 133us (248us total) trans 8589945321 rc 0/0 00000100:00100000:2.0:1746143854.016204:0:24157:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5556 00000001:00080000:0.0:1746143854.472596:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874175 is committed 00000001:00080000:0.0:1746143854.472665:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874166 is committed 00000001:00100000:0.0:1746143854.472686:0:32086:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7af03b7-614a-4deb-9941-d1d04a49a814 00000001:00100000:0.0:1746143854.472691:0:32086:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cbf1bf88-cf31-404b-8cff-930e280d3743 00000001:00080000:0.0:1746143854.472695:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874153 is committed 00000001:00080000:0.0:1746143854.472733:0:32086:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874131 is committed 00000020:00000080:0.0:1746143854.472739:0:32086:0:(genops.c:904:class_export_put()) final put ffff88012d7df800/f7af03b7-614a-4deb-9941-d1d04a49a814 00000020:00000080:2.0:1746143854.472884:0:1012:0:(genops.c:863:class_export_destroy()) destroying export ffff88012d7df800/f7af03b7-614a-4deb-9941-d1d04a49a814 for lustre-OST0001 00000020:00000080:2.0:1746143854.472934:0:1012:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012d7dc000 for lustre-OST0001 00000020:00000080:0.0:1746143854.472936:0:32086:0:(genops.c:904:class_export_put()) final put ffff88012d7dd000/cbf1bf88-cf31-404b-8cff-930e280d3743 00000020:00000080:2.0:1746143854.472940:0:1012:0:(genops.c:863:class_export_destroy()) destroying export ffff88012d7dd000/cbf1bf88-cf31-404b-8cff-930e280d3743 for lustre-OST0001 00000020:00000080:2.0:1746143854.472955:0:1012:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012d7d9800 for lustre-OST0001 00000001:02000400:0.0:1746143854.797343:0:13898:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:0.0:1746143855.007309:0:7232:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 70472 lines, 70472 kept, 0 dropped, 0 bad.